The History of an LLM — VIII. When a System Became Its History

An LLM has a history.

But that history is not located in one place.

Some of it is in parameters shaped by training.

Some is in the temporary organisation of a conversation.

Some may persist through external memory or records.

Different histories operate at different timescales.

What unites them is not storage.

It is consequence.

Something happened.

It changed the organisation through which later activity could occur.

The trained model is different because training happened.

The conversation is different because earlier exchanges happened.

A later response is different because the preceding context exists.

In each case, the past has become part of the conditions of the future.

This gives us the full sequence:

event → trace → incorporation → organisation → activity → continuity → transformation → further history.

The important word is incorporation.

A system does not have a history merely because events have happened to it.

It has a history when some consequences of those events become part of how the system subsequently operates.

That is why an archive is not the same thing as an organisation.

An archive can contain a history without being changed by it.

An organisation carries history by being changed into something through which further events can occur.

This also explains why history need not be conscious.

A genome does not remember its ancestors.

A metabolic network does not remember yesterday's reactions.

A trained model need not retrieve the experiences that shaped its parameters.

Yet history can still be active in all three.

The deepest question, then, is not:

“What does the system remember?”

It is:

“What has happened to the system that has changed what it can now do?”

When the answer includes the organisation itself, history has become part of the system.

And perhaps that is what it means for a system to have a history at all:

the past has become part of the way the future is possible.