Claims › Form–meaning gap › C008
C008
In their own words · Bender & Koller 2020 · §1 Introduction · assumed
…From our perspective, these are overclaims caused by a misunderstanding of the relationship between linguistic form and meaning.
“We argue that the language modeling task, because it only uses form as training data, cannot in principle lead to learning of meaning.”
We take the term language model to refer to any system trained only on the task of string prediction, whether it operates over characters, words or sentences, and sequentially or not.…
A system trained only on the shape of language has nothing in its input that could tell it what the language is about. The argument is about what the training signal contains, not about how well the system performs today.
The five layers, for this claim
The same core in the infographic, with the claims it touches.
Relations
- ← presupposes C007 The dispute over machine understanding is not one question but two pictures of what understanding is: tracking statistical regularities, or holding a causal model of how things work. The debate it describes has Bender and Koller’s thesis as one of its poles.
- ← contests C006 Predicting the next word can require the model to build a partial picture of what the writer believed and wanted. If the model infers representations of intentions, form alone does not stay mute, as Bender and Koller claim it must.
Notation
- Claim typeWhat kind of statement it is, so that the right test can be applied. Proposed until checked by hand.
- D1.14 · metaphysical-ontological
- FunctionWhat a claim does for the programme: a conceptual tool, a working method, corrective evidence, a technical reference.
- technical reference
- StanceHow the programme holds the claim: assumed, used, or contested.
- assumed
- Used in
- /lab/2026-02-03-the-seven-dimensional-taxonomy-v2/
- Cite this
- claudiocammarano.com/en/claims/c008/