Thursday, 24 September 2026

The History of an LLM — V. When History Began to Filter the Future

Training changes an LLM's organisation.

But that organisation does not simply sit there waiting to be expressed.

It changes what happens when something new arrives.

A prompt enters a system already shaped by billions of earlier training examples. Some continuations are now more available than others. Some associations are easier to activate. Some distinctions are more readily made.

The past has therefore become selective.

But selection here need not mean conscious choice. The model does not decide which parts of its history to use. Its organisation determines, through its learned dispositions, how the present can connect with what came before.

And the same thing happens within a conversation.

An earlier sentence changes the context in which a later sentence is interpreted. A previous answer can make some continuations more probable and others less available. The immediate past becomes part of the conditions governing the next response.

History is therefore doing more than being preserved.

It is filtering possibility.

This gives us a recursive relation:

past → altered organisation → selective response → new event → further alteration.

The model's history helps determine what happens next, and what happens next becomes part of its current history.

At the parameter level, this process is slow and structural.

Within a conversation, it can be rapid and temporary.

But the principle is the same.

A history becomes organisationally significant when it changes not merely what the system contains, but how the system can respond to what comes next.

The past has stopped being something behind the model.

It has become part of the way the model meets the future.

No comments:

Post a Comment