The brain is a predicting machine. We form a model of the world and the brain keeps on predicting outcomes and updating its model based on the outcome of the prediction. I think this much everyone is in agreement with now.
But somehow, I still can't believe language as a predictive system. Vision and sound maybe. But not language.
But almost all NLP now focuses on next word prediction.
Lets do a small experiment to see if language generation is predictive:
Open a speed reading app, an app which shows one word at a time( for ex https://spreeder.com/app.php?intro=1). And start reading. Keep the speed at maybe one word for 2 secs so that you can analyze what your brain is doing. What is your brain doing. Are you predicting the next word. Or are you ruminating on the past words trying to form a model of what the author is trying to say?
In my case, I am not predicting the next word.
I try to re read the previous words in my mind and try to re verify my mental model. So reading and language does not seem to be predictive. It is reactive.We read words, form the mental model and every new word updates our mental model. Try it and share your thoughts.
I've found that when I reach the end of a page I often automatically predict the next word and get it right a lot of the time