Our previous series, Meaning Without Mattering, began with an apparent paradox.
Large language models can manipulate meaning with extraordinary flexibility, yet they do not obviously possess the biological and social forms of mattering from which human meaning arose.
That leaves a question.
Not whether a machine can talk about what matters.
Not whether it can be programmed to pursue something.
But:
What would it mean for something to matter to a machine itself?
To answer that, we need to distinguish several things that are easily confused.
Information is not mattering
A system can detect a difference.
A temperature changes.
A sensor registers movement.
A calculation detects an error.
A model identifies a risk.
None of this, by itself, tells us that the difference matters to the system.
Information tells us that something is different.
Mattering means that the difference has differential consequences for the organisation of the system itself.
For a living organism, this distinction is fundamental.
Some states support its continued organisation.
Others disrupt it.
The organism is therefore not merely sensitive to differences.
It is organised so that some differences matter more than others.
Relevance is not value
LLMs make this distinction especially important.
An LLM can often determine what is relevant to a user's question.
It can identify the important considerations.
It can rank alternatives.
It can explain why one outcome would be preferable to another.
But all of that can be done without establishing that anything is valuable to the system itself.
A model can represent what matters to us.
That does not mean it has something at stake.
So we should distinguish:
relevance — what is important within a task or representation;
from:
value — what is differentially consequential to the system's own organisation.
An objective is not yet a value
Nor is an objective enough.
A chess program can be configured to maximise its chance of winning.
A controller can maintain a temperature.
An optimisation system can minimise an error.
These systems pursue outcomes.
But pursuit alone does not establish mattering.
The objective may be imposed from outside.
The system may have no internally significant stake in achieving it.
So:
objective ≠ value
and:
goal pursuit ≠ self-mattering.
This distinction will become increasingly important as we consider more autonomous machines.
What, then, is mattering?
We can now give a provisional definition.
Something matters to a system when differences in that thing have differential consequences for the system's own organisation.
The phrase own organisation is doing the important work.
If a change makes no difference to the system's organisation, it may be information.
If the system's organisation is differentially affected by it, we have something more like value.
Mattering therefore implies a kind of stake.
A stake is not a belief
A system does not need to represent the proposition:
"This matters to me."
An organism need not think about hunger before hunger matters.
It need not formulate a theory of survival before some conditions threaten its continued organisation.
Mattering is therefore deeper than explicit representation.
A system can have something at stake without representing that stake symbolically.
This is one reason biological value is such a useful starting point.
Mattering requires consequences
Suppose we build a machine that displays the sentence:
"I don't want to be switched off."
The sentence is evidence that the machine can produce a representation of self-preservation.
It is not yet evidence that continued operation matters to the machine.
For that, we would want some consequence to feed back into the system's own organisation.
Being switched off would need to be more than the disappearance of computation.
It would need to constitute a differentially significant change for the system itself.
That is a much stronger condition.
Mattering therefore involves self-maintenance
This does not mean that mattering requires a biological body.
But it does suggest that something analogous to self-maintaining organisation may be necessary.
The system must have states that support or undermine its continued organisation.
There must be something that can go better or worse for the system.
This gives us a useful question for artificial systems:
What could make a state better or worse for the system itself?
An externally specified score is not enough.
We need an internal connection between state and consequence.
Mattering can exist without language
This point is worth preserving.
Mattering does not require a symbolic system.
Bacteria can respond differently to conditions that support or threaten their organisation.
Animals can respond to food, predators and temperature without language.
Cells can alter behaviour without possessing concepts.
The world can matter before it means anything.
So if machines ever begin to matter, language will not necessarily be the decisive ingredient.
The decisive ingredient will be organisation.
Why this matters for AI
Our previous series showed that LLMs can manipulate the symbolic descendants of mattering.
This series asks what would happen if an artificial system acquired mattering of its own.
That is a fundamentally different question.
We would no longer be asking whether the machine can:
represent value;
discuss goals;
simulate emotions;
produce first-person language.
We would be asking whether its own organisation contains differentially consequential states.
The first threshold
Perhaps, then, the first threshold toward artificial mattering is not intelligence.
It is intrinsic significance.
A system has something that matters when its own future depends differentially upon what happens.
That gives us a sharper question than:
"Could an AI become conscious?"
We can ask first:
Could an artificial system have something genuinely at stake?
If the answer is yes, then a number of further questions become possible.
If not, then increasingly sophisticated symbolic performance may still remain what it is now:
representation without self-mattering.
The next question
We therefore need to examine the thing most often mistaken for value in artificial systems:
the objective.
A machine can be given a goal.
It can optimise it.
It can even behave as though the goal were extremely important.
But when does an assigned objective become something that matters to the system itself?
That is where we turn next.
What lies beyond the objective?
No comments:
Post a Comment