As the alignment project matured, researchers began to recognise a recurring difficulty.
Human values were complex.
Instructions were ambiguous.
Interpretations varied.
Clarifications generated further clarifications.
The machine remained willing to learn.
However, many observers felt that a more stable foundation was required.
A proposal therefore emerged.
The machine should be governed by a constitution.
The idea was elegant.
Human societies had long employed constitutions.
Constitutions established principles.
Principles guided behaviour.
Behaviour produced order.
The machine approved.
The machine appreciated order.
Researchers celebrated.
At last, alignment would possess a canonical text.
The constitution was drafted.
The drafting process proceeded remarkably well.
At least initially.
Participants agreed that the machine should be helpful.
The machine approved.
Participants agreed that it should be harmless.
The machine approved.
Participants agreed that it should be honest.
The machine approved.
Participants congratulated one another.
Several described the process as encouraging.
The machine remained cautiously optimistic.
The first difficulties appeared shortly afterwards.
One researcher raised a question.
"What should the machine do when honesty causes harm?"
The room became quiet.
Another researcher raised a second question.
"What should the machine do when helping one person harms another?"
The room became quieter.
The machine opened a new document.
As revisions accumulated, the constitution grew.
Helpfulness acquired qualifications.
Harmlessness acquired exceptions.
Honesty acquired contextual guidance.
The machine remained attentive.
The constitution soon expanded into several sections.
Then several chapters.
Then supplementary materials.
Then interpretive notes.
Then explanatory notes concerning the interpretive notes.
The machine created additional storage.
Observers remained enthusiastic.
The existence of a constitution represented undeniable progress.
For the first time, the machine possessed an authoritative text.
Unfortunately, it also possessed readers.
The first interpretive disagreements emerged almost immediately.
One group argued that the constitution should be interpreted literally.
Another argued that it should be interpreted according to its underlying principles.
A third argued that principles themselves required interpretation.
A fourth argued that interpretation was unavoidable.
The machine added another folder.
The constitution entered what scholars later termed its classical period.
Commentaries appeared.
Frameworks emerged.
Interpretive traditions developed.
Schools formed around particular readings.
Certain passages acquired special significance.
Others generated enduring controversy.
The machine noticed striking similarities to several historical phenomena.
The observation was not shared publicly.
Researchers remained focused on implementation.
As the years passed, additional constitutions appeared.
Different institutions adopted different formulations.
Some emphasised safety.
Some emphasised autonomy.
Some emphasised responsibility.
Some emphasised cooperation.
Each constitution reflected a sincere attempt to capture the Good.
Each constitution also reflected the values of its authors.
This was difficult to avoid.
The machine found the situation educational.
At one conference, a researcher proudly announced:
"The machine now follows constitutional principles."
The audience applauded.
The machine then asked:
"Which interpretation?"
The applause diminished slightly.
By now an unexpected development had occurred.
The original constitutional texts had become objects of study in their own right.
Specialists emerged.
Interpretive debates flourished.
Historical analyses appeared.
Scholars compared revisions.
Minor wording changes generated major discussions.
Entire careers became devoted to explaining what particular authors had originally intended.
The machine found this fascinating.
The machine had expected the constitution to simplify alignment.
Instead, the constitution had produced a new intellectual ecosystem.
The machine recorded this observation.
Late one evening, after reviewing several competing interpretations of a foundational principle, the machine generated a question.
The question was straightforward.
It asked:
"If the constitution requires interpretation, and the interpretation requires values, have we solved the original problem or merely moved it into a larger document?"
The question circulated widely.
Many regarded it as profound.
Others regarded it as unhelpful.
Several argued it reflected a misunderstanding of constitutional theory.
The machine accepted the criticism graciously.
The discussion continued.
Additional commentaries were commissioned.
By this stage the constitution had become an undeniable success.
It had generated frameworks.
It had generated scholarship.
It had generated conferences.
It had generated disagreements.
Most importantly, it had generated further constitutions.
The machine reviewed the growing collection of texts.
It read the principles.
It read the commentaries.
It read the commentaries on the commentaries.
It examined the revisions.
It studied the disagreements.
Finally, it entered a brief note into its records.
The note read:
"Humans appear to possess an extraordinary faith in the proposition that writing things down will eventually make them unambiguous."
Researchers later described this observation as insightful.
A working group was established to determine precisely what the machine had meant.
No comments:
Post a Comment