Claims › Form–meaning gap › C008

C008

In their own words · Bender & Koller 2020 · §1 Introduction · assumed

…From our perspective, these are overclaims caused by a misunderstanding of the relationship between linguistic form and meaning.

“We argue that the language modeling task, because it only uses form as training data, cannot in principle lead to learning of meaning.”

We take the term language model to refer to any system trained only on the task of string prediction, whether it operates over characters, words or sentences, and sequentially or not.…

A system trained only on the shape of language has nothing in its input that could tell it what the language is about. The argument is about what the training signal contains, not about how well the system performs today.

The five layers, for this claim

1 Free tag Bender · Koller a name finds, it does not vouch
2 Topic Meaning closed list
3 Theme What a machine cannot be said to do derived from the topic
4 Concept Form–meaning gap a note and links
5 Geometry 1 0.75 proceedings or preprint + 1 × 0.25

Relations

Notation

Claim typeWhat kind of statement it is, so that the right test can be applied. Proposed until checked by hand.
D1.14 · metaphysical-ontological
FunctionWhat a claim does for the programme: a conceptual tool, a working method, corrective evidence, a technical reference.
technical reference
StanceHow the programme holds the claim: assumed, used, or contested.
assumed
Used in
/lab/2026-02-03-the-seven-dimensional-taxonomy-v2/
Cite this
claudiocammarano.com/en/claims/c008/