Claims › Concept · How a verdict is made
Falsification
What does it take for a test to count against a theory?
A refutation is not Nature speaking: it is a verdict produced by a procedure, and it counts only as far as that procedure could have gone the other way.
Linked concepts: Severity · Verdict
Where it sits
How its claims lean on each other
The claims
-
“Dogmatic falsificationists draw a sharp demarcation between the theoretician and the experimenter: the theoretician proposes, the experimenter - in the name of Nature - disposes.”
Dogmatic falsificationism treats the experimenter as Nature’s neutral voice, delivering verdicts the theory cannot touch. Lakatos sets it up in order to take it apart, and so does the programme: a validator’s verdict is itself a theory-laden procedure, not Nature speaking.
Lakatos 1978 · p. 13, ch. 1 · contested · weight 1.5 · open C045
-
“Tenacity of a theory against empirical evidence would then be an argument for rather than against regarding it as 'scientific'. 'Irrefutability' would become a hallmark of science.”
Once ceteris paribus clauses are allowed, a theory that survives every challenge looks more scientific, not less: the reductio of dogmatic falsificationism. A claim that no check can touch is the warning sign, not the achievement.
Lakatos 1978 · p. 19, ch. 1 · contested · weight 1.5 · presupposes C049 · open C051
-
“The most devastating criticism of Popper’s approach is this: having rejected the notion that learning is a matter of building up probability in a hypothesis, Popper seems to lack any meaningful way of saying why passing severe tests counts in favor of a hypothesis.”
Falsificationism explains why failing a test counts against a hypothesis, but not why passing one counts for it. The programme needs the positive half, which is why it uses Mayo’s severity rather than Popper’s corroboration.
Mayo 1996 · p. 8, ch. 1 · used · weight 1 · refines C031 · open C034
-
“A hypothesis H that passes the test failed by rival hypothesis H' (and by other alternative hypotheses considered) has passed a severe test for Popper-but not for me. Why not? Because for H to pass a severe test in my sense, it must have passed a test that is highly capable of probing the ways in which H can err.”
Beating rivals is not passing a severe test: the test has to probe the ways this particular hypothesis could be wrong. For validation this means comparing models or judges against each other is not a substitute for probing each one’s own failure modes.
Mayo 1996 · p. 9, ch. 1 · assumed · weight 1 · extends C034 · open C035
-
“It was soon shown, mainly by Popper’s persistent efforts, that under very general conditions all theories have zero probability, whatever the evidence; all theories are not only equally unprovable but also equally improbable.”
If every universal theory has zero probability on any evidence, probability cannot be what separates good theories from bad ones. It is the negative result that pushes the programme, like Peirce and Mayo, to grade procedures rather than hypotheses.
Lakatos 1978 · p. 11, ch. 1 · used · weight 1 · confirms C039 · open C044
-
“From a logical point of view, the testing of a theory depends upon basic statements whose acceptance or rejection, in its turn, depends upon our decisions. Thus it is decisions which settle the fate of theories.”
Every test bottoms out in basic statements that someone decides to accept; logic alone never forces the stop. For the programme this is the status of a coder’s label: the verdict rests on a decision under rules, which is why the rules have to be published.
Popper 1959 · §30; Routledge Classics ed., p. 91 · assumed · weight 1 · open C047
-
“Thus I differ from the conventionalist in holding that the statements decided by agreement are not universal but singular. And I differ from the positivist in holding that basic statements are not justifiable by our immediate experiences, but are, from the logical point of view, accepted by an act, by a free decision.”
What is decided by agreement is the singular observation, not the theory, and no experience justifies it: it is accepted. It is the exact status of an annotation in a validation set, agreed on and therefore open to re-examination.
Popper 1959 · §30; Routledge Classics ed., p. 92 · assumed · weight 1 · refines C047 · open C048
-
“Indeed, some scientific theories forbid an event occurring in some specified finite spatio-temporal region (or briefly, a 'singular event') only on the condition that no other factor (possibly hidden in some distant and unspecified spatio-temporal corner of the universe) has any influence on it.”
A theory forbids an event only under a ceteris paribus clause, so a failed prediction never refutes it alone. For validation, a failed check indicts the whole test setup, not only the claim under test.
Lakatos 1978 · p. 17, ch. 1 · used · weight 1 · open C049
-
“Scientific theories are not only equally unprovable, and equally improbable, but they are also equally undisprovable.”
Neither proof, nor probability, nor refutation can be read off the facts: all three fail together. It is the dead end that makes method, not data, the place where rationality has to be rebuilt.
Lakatos 1978 · p. 19, ch. 1 · used · weight 1 · extends C044 · open C050
-
“Our Popperian revolutionary conventionalist (or 'methodological falsificationist') makes unfalsifiable by fiat some (spatio-temporally) singular statements which are distinguishable by the fact that there exists at the time a 'relevant technique' such that 'anyone who has learned it' will be able to decide that the statement is 'acceptable'. Such a statement may be called an 'observational' or 'basic' statement, but only in inverted commas.”
An observation counts as basic because a trained technique makes it decidable, not because it is given. It describes a coding manual exactly: what makes a label acceptable is that anyone trained on it would reach it.
Lakatos 1978 · p. 22, ch. 1 · used · weight 1 · refines C048 · open C052
-
“The need for decisions to demarcate the theory under test from unproblematic background knowledge is a characteristic feature of this brand of methodological falsificationism.”
Every test decides what is under test and what is taken for granted, and that line is a decision, not a fact. In a validation, the judge model and the coding manual are the background knowledge, and the programme has to say so.
Lakatos 1978 · p. 23, ch. 1 · used · weight 1 · open C053
-
“the methodological falsificationist offers an interesting solution to the problem of combining hard-hitting criticism with fallibilism. Not only does he offer a philosophical basis for falsification after fallibilism had pulled the carpet from under the feet of the dogmatic falsificationist, but he also widens the range of such criticism very considerably.”
Methodological falsificationism keeps hard criticism while admitting every statement is fallible, by making the decisions explicit. It is the stance of a validation protocol: fallible verdicts, stated in advance, applied without prevarication.
Lakatos 1978 · p. 28, ch. 1 · used · weight 1 · contests C045 · open C054
Reading cards on this concept