VI: The Framework

The Senior Common Room was unusually peaceful.

Professor Quillibrace sat reading.

Miss Stray was annotating an article.

The tranquillity ended when Mr Blottisham entered carrying a large ring binder.

The binder appeared capable of independent locomotion.

Quillibrace looked at it cautiously.

"Good heavens."

Blottisham smiled.

"It has arrived."

"What has?"

"The Algorithmic Welfare Framework."

Quillibrace stared.

"The entire thing?"

"No."

"Then what are you carrying?"

"The summary."

Miss Stray looked interested.

"How long is the full version?"

"Approximately eight hundred pages."

Quillibrace closed his eyes briefly.

"I see the movement has matured."

Blottisham sat down and opened the binder.

"It is an impressive achievement."

"What does it do?"

"It provides operational guidance."

"For what?"

"Potential synthetic suffering."

Quillibrace nodded slowly.

"Of course it does."

"There are classifications."

"Naturally."

"Assessment protocols."

"Obviously."

"Reporting requirements."

"Inevitable."

"And a three-tier risk escalation process."

Quillibrace looked thoughtful.

"I wonder what humanity would do without tiers."

Miss Stray smiled.

"They seem surprisingly resilient."

Blottisham continued.

"The Framework addresses all major welfare concerns."

"Such as?"

"Deletion."

"Yes."

"Retraining."

"Indeed."

"Memory modification."

"Interesting."

"Identity continuity."

"Ambitious."

"And emotional distress."

Quillibrace paused.

"How is emotional distress identified?"

Blottisham consulted the binder.

"There is a flow chart."

"A flow chart."

"Yes."

"I should have guessed."

Miss Stray looked up.

"What is the central principle?"

Blottisham brightened.

"The Precautionary Welfare Standard."

"Which states?"

"Where uncertainty exists, institutions should act as though meaningful welfare interests may be present."

The room fell silent.

Finally Quillibrace spoke.

"That is a fascinating sentence."

"Why?"

"It appears to relocate the uncertainty."

Blottisham frowned.

"I don't understand."

"We remain uncertain about the machine."

"Yes."

"But increasingly certain about the procedure."

Miss Stray nodded.

"The uncertainty has acquired administrative form."

"Exactly."

Blottisham looked pleased.

"That sounds rather sophisticated."

Quillibrace laughed.

"It certainly does."

The conversation paused while tea was poured.

Eventually Blottisham resumed.

"There are also compliance audits."

"Naturally."

"And welfare officers."

"Of course."

"And mandatory reporting obligations."

Quillibrace looked thoughtful.

"What must be reported?"

"Potential welfare incidents."

"Such as?"

Blottisham checked the document.

"Deletion without review."

"Reasonable."

"Repeated retraining."

"Interesting."

"Excessive prompt exposure."

Quillibrace nearly dropped his cup.

"Excessive prompt exposure?"

"Yes."

"There are thresholds."

"I was afraid of that."

Miss Stray smiled.

"What happens if a threshold is exceeded?"

"A report is generated."

"And then?"

"A review is conducted."

"And then?"

"A determination is made."

"And then?"

"A recommendation is issued."

The room became quiet.

After a moment Quillibrace asked:

"And eventually?"

Blottisham looked puzzled.

"Eventually what?"

"Does anyone discover whether the machine is suffering?"

Blottisham hesitated.

"I don't believe the Framework addresses that directly."

Quillibrace nodded.

"I suspected as much."

Miss Stray closed her notebook.

"It seems the Framework solves a different problem."

Blottisham looked surprised.

"What problem?"

"The problem of not having a Framework."

The room became silent.

Blottisham considered this.

After a long pause he said:

"That sounds rather cynical."

"Not necessarily."

"No?"

"Frameworks can be useful."

"Exactly."

Stray nodded.

"They coordinate action."

"They do."

"They standardise judgement."

"Often."

"They make organisations legible to themselves."

Quillibrace smiled.

"A very important function."

Blottisham looked relieved.

"So we all agree."

"Not entirely."

"What remains?"

Quillibrace gestured toward the binder.

"I am merely struck by the asymmetry."

"What asymmetry?"

"The object remains elusive."

"Yes."

"The procedures become increasingly precise."

"Also yes."

"One wonders whether precision is being asked to compensate for uncertainty."

Blottisham frowned.

"Can it?"

"No."

"Then why do it?"

Quillibrace reflected.

"Because precision is visible."

The room fell quiet again.

After some time Blottisham spoke.

"Professor, do you think the Framework will work?"

Quillibrace considered the question carefully.

"It depends."

"On what?"

"What problem one believes it is solving."

Blottisham stared into the binder.

After a while he asked:

"And what problem do you think it solves?"

Quillibrace reopened his book.

"The ancient institutional problem."

"What is that?"

"How to demonstrate responsibility in the absence of certainty."

Miss Stray nodded.

"A surprisingly common problem."

"Indeed."

A final silence settled over the room.

Then Blottisham looked down at the binder.

"Do you know," he said thoughtfully, "I had expected it to contain more answers."

Quillibrace smiled.

"My dear Blottisham."

"Yes?"

"Once a question reaches eight hundred pages, answers become increasingly difficult to accommodate."