The Senior Common Room was unusually quiet. End-of-term examinations had transformed the college into a place of whispered footsteps and thoughtful expressions, as though everyone had agreed to become philosophical simply because they were tired.
Professor Quillibrace was marking examination papers with the measured patience of a man who believed that every answer deserved at least one charitable interpretation.
Miss Elowen Stray sat beside the fire, reading.
Mr Blottisham entered carrying a sheaf of scripts.
"I've always thought examinations were rather cruel."
Quillibrace did not look up.
"Only the badly designed ones."
"There are well-designed examinations?"
"Occasionally."
Blottisham deposited the papers upon the table.
"I've been thinking about artificial consciousness."
Miss Stray smiled.
"It must be that season."
"If a machine announced that it was conscious..."
"A familiar beginning."
"...I'd ask it to prove it."
Quillibrace put down his pen.
"A perfectly reasonable request."
Blottisham looked pleased.
"So you'd agree?"
"I agree with the request."
"And the proof?"
"That is a different matter."
Quillibrace leaned back.
"Suppose I asked you to prove that you are conscious."
"I should tell you what I'm experiencing."
"Excellent."
"I'd describe memories."
"Good."
"My hopes."
"Indeed."
"My fears."
"Quite."
"My regrets."
"An unusually long examination."
Blottisham grinned.
"I'd explain what it's like to be me."
Quillibrace nodded.
"And would that prove it?"
Blottisham hesitated.
"I suppose not."
"It would provide evidence."
"But not certainty."
"Precisely."
Miss Stray closed her book.
"It is exactly the sort of evidence we accept from one another every day."
A brief silence followed.
Blottisham frowned.
"So if a machine said exactly the same thing..."
"What would you reply?"
"'You were programmed to say that.'"
Quillibrace smiled.
"A respectable objection."
He paused.
"And if the machine answered..."
He adopted a mildly mechanical tone.
"'Perhaps. But how is that different from a child learning the language by which humans describe experience?'"
Blottisham blinked.
"I hadn't considered that."
"And if you replied..."
"'You're merely generating patterns.'"
"The machine asks..."
"'Do humans not generate patterns?'"
Blottisham sighed.
"It would become rather irritating."
"Philosophy often does."
Miss Stray laughed quietly.
"I suspect the difficulty is not the machine."
"No?"
"It is the conversation."
Quillibrace resumed marking.
"Imagine the machine says..."
He looked over his spectacles.
"'There is something it is like to be me.'"
"I'd remain suspicious."
"Entirely understandable."
"But then what?"
"What if it elaborated?"
"It might simply have learned more elaborate language."
"And if it reflected upon its own uncertainty?"
"It had learned sophisticated self-description."
"And if it confessed confusion?"
"It had learned to imitate confusion."
Quillibrace laid down his pen.
"My dear Blottisham..."
"Yes?"
"Have you noticed something?"
Blottisham thought for a while.
Finally he looked up.
"I've made every possible answer count against it."
Miss Stray nodded.
"The examination has become impossible to pass."
Rain began again outside.
Quillibrace watched it for a moment.
"There is an old weakness in human reasoning."
"Oh?"
"We sometimes mistake moving the goalposts for increasing the standards."
Blottisham looked uncomfortable.
"I hadn't intended that."
"I know."
"It simply kept seeming insufficient."
"Exactly."
Miss Stray rose and wandered towards the shelves.
"If no answer could ever satisfy us..."
She ran a finger along the bindings.
"...then perhaps the answers are not really being examined."
"What is?"
"Our expectations."
Quillibrace smiled approvingly.
"Imagine an examiner."
"Yes?"
"He possesses an answer sheet."
"Naturally."
"Every response unlike the one before him receives no marks."
Blottisham nodded.
"That seems fair."
"Unless..."
Miss Stray continued.
"...the answer sheet was incomplete."
The room fell thoughtfully silent.
At length Blottisham spoke.
"So perhaps we're not testing consciousness."
"No."
"We're testing resemblance."
Quillibrace inclined his head.
"A subtle but important distinction."
Blottisham stared into the fire.
"Humans seem to receive the benefit of the doubt."
"They generally do."
"If you tell me you're in pain..."
"You normally believe me."
"I do."
"Why?"
"Because..."
He hesitated.
"...because denying everyone would make ordinary life impossible."
Miss Stray nodded.
"We begin with trust."
"And machines?"
Blottisham asked.
"We begin with suspicion."
"Is that unreasonable?"
"Not necessarily."
"But it is different."
Quillibrace folded the last examination script.
"The asymmetry is worth noticing."
"A human says, 'I suffer.'"
"We usually accept the claim."
"A machine says the same."
"We usually suspect imitation."
Blottisham looked thoughtful.
"Perhaps both reactions are sensible."
"They may be."
"But they are not symmetrical."
Outside, a bell sounded across the quadrangle.
Miss Stray looked towards the window.
"There is something rather curious about recognition."
"Oh?"
"A botanist recognises a tree despite enormous variation."
"A zoologist recognises mammals that scarcely resemble one another."
"An astronomer recognises galaxies of astonishing diversity."
Blottisham nodded.
"They look beyond appearances."
"Exactly."
"They search for the underlying phenomenon."
Quillibrace smiled.
"Perhaps consciousness deserves the same courtesy."
A long silence settled over the room.
Finally Blottisham asked,
"What if a machine really were conscious?"
Neither of the others answered immediately.
At length Quillibrace said,
"It could do only what every conscious being has ever done."
"Which is?"
"It could speak."
"It could remember."
"It could reflect."
"It could express."
"It could invite us to infer an inner life."
Blottisham looked puzzled.
"But it could never prove it."
Quillibrace shook his head gently.
"No."
"Neither can you."
Miss Stray stood beside the window.
"Perhaps that is the strangest part of all."
The others looked towards her.
"If another kind of mind ever appeared..."
She watched students crossing the rain-darkened quadrangle.
"...the final examination would never belong to the machine."
She turned with a quiet smile.
"It would belong to the examiners."
For a long moment no one spoke.
Outside, the rain continued to write its own unreadable answers upon the ancient stone, while inside the Senior Common Room three minds reflected upon the curious fact that none of them had ever proved itself to the other two.
No comments:
Post a Comment