The Senior Common Room was unusually quiet.
Professor Quillibrace was reading.
Miss Elowen Stray was looking out of the window.
Mr Blottisham was doing neither.
“I have been thinking,” he announced.
Professor Quillibrace did not look up.
“That is generally how these things begin.”
“I mean seriously.”
“That is more worrying.”
Blottisham ignored him.
“We keep saying that an artificial intelligence has a history. But surely that is metaphorical.”
Miss Stray turned from the window.
“What do you mean by history?”
“I mean things that happened before.”
“Yes.”
“And an LLM doesn't remember most of the things that happened to it.”
“No,” said Quillibrace. “But that does not establish that they have ceased to matter.”
Blottisham frowned.
“Are you saying the machine remembers things it doesn't remember?”
“No. I am saying you have confused memory with history.”
“That sounds suspiciously like something philosophers do when they have lost the argument.”
Miss Stray smiled.
“Perhaps we should begin with a simpler question. What does it mean for something that happened to become part of what the system is?”
Blottisham considered this.
“It gets stored somewhere.”
Quillibrace closed his book.
“There is the first mistake.”
“I thought you said there would be several.”
“There will be.”
Stray leaned forward.
“Suppose a system encounters something during training. The event is over. The data are no longer present as an event. But the training has altered the parameters.”
“So?”
“So the system now responds differently.”
Blottisham shrugged.
“It has learned something.”
“Perhaps,” said Stray. “But notice what has happened. The important thing isn't that the event has been stored. The important thing is that the event has altered the organisation of the system.”
Quillibrace nodded.
“The past has become a disposition.”
Blottisham looked suspicious.
“You are making a rather large philosophical claim out of statistics.”
“Statistics,” said Quillibrace, “are perfectly capable of becoming a rather large philosophical problem.”
Stray smiled.
“Think of it this way. Before training, a particular response may have been possible. After training, it may be easier, more probable, or differently structured. The past has changed the space of possible responses.”
“History has become possibility,” said Quillibrace.
Blottisham pointed at him.
“That sounds important.”
“It is.”
“And slightly pretentious.”
“Also true.”
There was a pause.
Blottisham poured himself more tea.
“But training isn't the whole history of an LLM.”
“No,” said Stray.
“There's the conversation.”
“Yes.”
“And surely the conversation isn't changing the parameters.”
“Usually not.”
“Then how can it be history?”
Quillibrace looked almost pleased.
“Excellent. You have accidentally found the problem.”
Blottisham brightened.
“I knew I would.”
Stray continued.
“Consider the first exchange in a conversation. It changes the context in which the second exchange is interpreted. The second changes the context for the third. The system need not alter its underlying parameters for its subsequent behaviour to be different.”
“So the conversation changes its state rather than its structure.”
“Precisely.”
Blottisham looked between them.
“Then there are two histories.”
“At least,” said Quillibrace.
“Training history changes the organisation of the model. Conversation history changes the current state in which that organisation operates.”
“And perhaps persistent memory or external records add another layer,” said Stray.
Blottisham stared at the table.
“That's beginning to sound like an awful lot of history.”
“History,” said Quillibrace, “has never been obliged to be tidy.”
Stray nodded.
“And not every event becomes history in the same way.”
She took a sheet of paper.
“An event can leave a temporary trace. A conversation can leave a context. Training can produce a persistent alteration in parameters. A stored record can later be reintroduced into activity.”
She wrote:
event → trace → incorporation → organisation → disposition
“That's the important distinction,” she said. “An archive contains traces. An organisation has been changed by them.”
Blottisham looked at the sequence.
“So a library has a history.”
“It has records of history.”
“What's the difference?”
“The books don't necessarily change the organisation of the library.”
“But they change what I can do in the library.”
Quillibrace raised an eyebrow.
“Now you are making progress.”
Blottisham looked alarmed.
“I dislike the direction this conversation is taking.”
Stray laughed.
“There is another complication.”
“Of course there is.”
“The history of a system can also alter what it is able to notice, or how it responds to what comes next.”
“How?”
“Because its learned organisation filters new possibilities.”
Quillibrace added, “The past does not merely remain behind the system. It changes the conditions under which the system encounters the next event.”
Blottisham thought about this.
“So history becomes selective.”
“Yes.”
“Then the system doesn't just have a past. Its past determines which parts of its future can become significant.”
“Careful,” said Quillibrace.
“Why?”
“You have just wandered dangerously close to saying something interesting.”
Blottisham looked pleased again.
Stray was not laughing.
“There is an even deeper point. The system's organisation also affects which events become part of its future history.”
Blottisham waited.
“Training changes the model. The changed model produces outputs. Those outputs can affect later inputs. A conversation produces a response; the response becomes part of the next context; the altered context produces another response.”
She drew another sequence:
input → response → context → altered response → further context
“The system's activity can therefore help construct the history that conditions its next activity.”
Blottisham stared at the diagram.
“So it feeds back on itself.”
“In conversation, yes.”
“Then an LLM can make its own history.”
“In a limited sense.”
Quillibrace was precise.
“Do not mistake recursive context for autonomous self-creation.”
“I wasn't.”
“You were about to.”
“I was thinking about it.”
“That is usually where the trouble begins.”
Stray intervened.
“The important point is not whether the system is autonomous in some grand sense. It is that an output can cease to be merely an output and become a condition for what happens next.”
Blottisham nodded slowly.
“A consequence becomes a condition.”
“Yes.”
“And then history becomes activity.”
“Yes.”
He looked rather pleased with himself.
“I think I understand.”
Quillibrace looked unconvinced.
“Explain.”
Blottisham stood up and began pacing.
“A thing happens. It changes the system. The changed system behaves differently. What it does changes what happens next. That becomes another part of its history.”
Stray smiled.
“Exactly.”
Blottisham stopped.
“So the history isn't a list of things that happened to the system.”
“No.”
“It's the organisation of consequences that changes what the system can do.”
Quillibrace nodded.
“Now we are getting somewhere.”
“But then,” said Blottisham, “the same event could become history for one system and not for another.”
“Of course.”
“Because incorporation depends on organisation.”
“Yes.”
“And organisation determines what can be incorporated.”
“Yes.”
Blottisham sat down.
“That seems circular.”
“It is recursive,” said Stray.
“Which is academic for circular.”
“No. Circular means that you have gone nowhere. Recursive means that what returns has changed the conditions of its return.”
Quillibrace gave a small approving nod.
“That distinction may be worth keeping.”
The room fell quiet.
Outside, the afternoon had begun to darken.
Blottisham broke the silence.
“But surely this still doesn't make an LLM a historical entity in the same sense as an organism.”
“No,” said Stray.
“Good.”
“The analogy has limits.”
“Excellent.”
“But the difference is instructive.”
She looked toward the window.
“An organism carries history in many layers: development, physiology, inherited organisation, learned behaviour, social relations. An LLM carries history differently: parameters, current context, memory systems where present, external records, and the consequences of its own outputs.”
“So not the same kind of history.”
“No.”
“But perhaps the same general principle.”
Quillibrace supplied it.
“The past becomes historically significant when it changes the organisation from which the future proceeds.”
Blottisham considered this for several seconds.
Then:
“So when people say that an LLM doesn't remember, they're asking the wrong question.”
“Sometimes,” said Stray.
“The better question is: what has happened to the system that has changed what it can now do?”
“Yes.”
Blottisham looked at Quillibrace.
“That's annoyingly good.”
“I shall try not to let it happen again.”
Stray returned to her chair.
“But there is one final question.”
“Of course there is.”
“If history becomes organisation, what happens to the distinction between history and system?”
Blottisham frowned.
Quillibrace waited.
Stray spoke slowly.
“Perhaps the history of a system is not something added to the system.”
She looked at the papers scattered across the table.
“Perhaps, at sufficient depth, the history is part of what the system is.”
Blottisham looked uncomfortable.
“So the model is its history?”
“Not exactly.”
“Then what?”
Quillibrace answered.
“A system is what its history has made possible.”
No one spoke.
Then Blottisham smiled.
“I preferred it when we were talking about tea.”
Quillibrace reopened his book.
“The tea, too, has a history.”
Blottisham stared at his cup.
“Don't.”
“I hadn't said anything.”
“You were about to.”
Stray laughed.
Outside, the light faded.
Inside, the conversation continued.
And somewhere between one utterance and the next, the past became part of the conditions of the future.
Again.