It’s important to remember what large-language model text generators like ChatGPT do. They:
- have a model based on scraping large amounts of the internet
- use that model to predict likely next words, just like predictive typing on your phone
- can “interpolate” to find next-likely words for situations it hasn’t exactly recorded (just like filling in the color orange given R_YGBP)
- slightly randomizes the pick to make it seem less robotic.