Regression to the Mean: on LLMs and the quiet death of the new

Regression to the Mean

We were handed a machine that could think alongside us, and told it would set off an explosion of new ideas. It may do the opposite - so gently that we mistake the flattening for progress.

A model on every desk; a collaborator for every mind. The pitch was a Cambrian bloom - a thousand directions explored at once, by everyone. More minds thinking, surely, means more thoughts worth thinking.

But ask it anything and it returns the most probable continuation - the center of mass of everything already written. Trained on the past, it answers in the past tense of thought. Not what is true. What is typical.

Offer it something it has never seen, and it doesn't light up. It corrects you. To a system built to predict the expected, the genuinely new is indistinguishable from a mistake. The pushback is soft, and constant.

And we feed its answers back in as the next questions. Each pass, the spread narrows; the strange tails thin out. Variance leaks out of the culture. We converge - not on what is right, but on what is average.

Yet every discovery was, at the moment it was made, out of distribution. It disagreed with the consensus of its day - moving earth, unseen germs, drifting continents, each first filed as error. A model of consensus is, by construction, a machine for telling you the new thing is wrong.

So the scarce thing inverts. The average is now free, infinite, identical - worth little precisely because everyone holds it. What is priceless is the deviation: the position the model marks as wrong, kept anyway. Not the answer it was sure of - the one it would not stop correcting.

It will give you the average of all that has been thought. The new was never in there. A tool that returns the most likely sentence is a comfort and a quiet narrowing at once. The work it cannot do for you is the only work that ever mattered: to stand, on purpose, where the curve runs thin - and stay there long enough to be right.

Not the most probable answer. The one it tried to correct.