Claims › Concept · What a machine cannot be said to do
Form–meaning gap
Can a system trained only on form learn what the language is about?
Training on form alone leaves meaning out of reach: what reads as understanding is a property of the text, not of the system.
Linked concepts: Agent model · Imitative falsehood · Sequence without recurrence
Where it sits
How its claims lean on each other
The claims
-
“Moreover, the current debate suggests a fascinating divergence in how to think about understanding in intelligent systems, in particular the contrast between mental models that rely on statistical correlations and those that rely on causal mechanisms.”
The dispute over machine understanding is not one question but two pictures of what understanding is: tracking statistical regularities, or holding a causal model of how things work. Naming the split explains why the two camps talk past each other.
Mitchell & Krakauer 2023 · p. 1 · used · weight 1.25 · presupposes C008 · open C007
-
“We argue that the language modeling task, because it only uses form as training data, cannot in principle lead to learning of meaning.”
A system trained only on the shape of language has nothing in its input that could tell it what the language is about. The argument is about what the training signal contains, not about how well the system performs today.
Bender & Koller 2020 · §1 Introduction · assumed · weight 1 · open C008