The Turing Test Was Never About Machines: II. When Conversation Became Evidence

We do not see intelligence.

We see what something does.

A person speaks, and we hear an answer. Someone solves a problem, remembers a name, notices a mistake, changes their mind. From these events we infer something about the organisation producing them.

Conversation is particularly powerful because it is not merely a sequence of outputs.

An answer changes what can sensibly be said next.

A question establishes a possibility. A reply takes up that possibility and changes it. The next response depends upon what has just happened. Conversation therefore creates a history in which each contribution becomes part of the conditions for the next.

This is why conversation can become evidence of intelligence.

Not because intelligence is hidden inside words, waiting to be detected, but because patterns of responsiveness reveal something about the organisation producing them.

We recognise another person as intelligent partly because they can do things with a conversation. They can follow an implication, repair a misunderstanding, recognise a joke, shift perspective, connect something said earlier with something said now. Their responses form a history rather than merely a succession of sentences.

The Turing Test exploits this.

If a machine can participate in conversation in ways that sustain the same kinds of expectations, the conversation becomes evidence for treating the machine as an intelligent interlocutor.

But evidence is not identity.

A thermometer provides evidence of temperature without being temperature. A footprint provides evidence that something passed by without being the thing that made it.

And a conversation may provide evidence of intelligence without telling us exactly what kind of organisation produced the evidence.

This is the difficulty hidden inside the test.

We have become accustomed to treating conversational behaviour as evidence because, with other humans, the inference is usually secure enough to be taken for granted. When the interlocutor is a machine, however, the inference becomes visible.

We suddenly notice something that was there all along:

We never encounter another intelligence except through what it does.

The Turing Test did not solve that problem.

It made the problem impossible to ignore.