When Would We Know? — A Natural History of Consciousness: VII. The Test That Could Never Be Final

We began with a simple question:

What test would tell us that a machine had become conscious?

We can now see why the question is difficult.

A test observes something the system does.

But consciousness, if it exists, is something the system is undergoing.

We cannot step outside our own experience to compare it directly with someone else's. We infer that other people are conscious because their behaviour, bodies, histories and organisation form a pattern that makes consciousness the most natural explanation.

The inference is extraordinarily strong.

But it is still an inference.

There is no consciousness meter hidden behind the eyes.

So why should we expect one to appear behind a machine?

Perhaps the test could become increasingly sophisticated.

We could examine its reports.

Its self-model.

Its memory.

Its flexibility.

Its internal organisation.

Its capacity to integrate information, monitor itself, learn from experience and alter its future behaviour.

Each would provide evidence.

None would provide the thing itself.

And yet this does not mean that all possibilities are equally plausible.

Evidence can accumulate without becoming logically conclusive.

We already reason this way about consciousness in other beings. We do not demand certainty before treating their behaviour as evidence of experience. We consider the organisation that produces the behaviour, the history that shaped it, and the consequences of what happens to it.

The same principle could apply to artificial systems.

The crucial transition would therefore not be the appearance of one magical response.

It would be the accumulation of evidence that the system possesses an organisation in which perspective, history, mattering and experience belong together.

At some point, continuing to call everything “mere imitation” might itself require explanation.

But there would be no final experiment.

No flashing light.

No machine answer that logically compels us to say:

Now we know.

The test could become better.

Our theory could become better.

The evidence could become overwhelming.

But the experience itself would remain the one thing we could never observe from outside.

Perhaps that is not a defect in the test.

Perhaps it is a fundamental feature of consciousness.

We are trying to detect something whose defining characteristic is that there is a world from somewhere.

And nowhere is more inaccessible than somewhere else's somewhere.

So the question changes again.

Not:

What test will prove that it is conscious?

But:

What evidence would make it unreasonable to continue acting as though consciousness were absent?

That question has no final answer.

But it may have a threshold.

And that brings us to the final question of the series:

When would we have to take it seriously?