Claims › Severity › C032

C032

In their own words · Mayo 2018 · p. 17, Excursion 1, Tour I · used

…We want to tell what’s true about statistical inference. Among the most notable of these truths is:

“P-values can be readily invalidated due to how the data (or hypotheses!) are generated or selected for testing.”

If you fool around with the results afterwards, reporting only successful guesses, your report will be invalid.…

A significance level is valid only relative to how data and hypotheses were selected; selective reporting makes a hard result look easy to explain away as chance. For the programme this is the warning attached to any choice of which outputs or cases enter a validation set.

From the reading card: Mayo 2018, Statistical Inference as Severe Testing: How to Get Beyond the Statistics Wars →

The five layers, for this claim

1 Free tag — a name finds, it does not vouch
2 Topic Severity closed list
3 Theme How a verdict is made derived from the topic
4 Concept Severity a note and links
5 Geometry 1 1 peer-reviewed

Relations

No relation to another claim has been declared yet.

Notation

Claim typeWhat kind of statement it is, so that the right test can be applied. Proposed until checked by hand.
D1.4 · mathematical-analytic
FunctionWhat a claim does for the programme: a conceptual tool, a working method, corrective evidence, a technical reference.
corrective datum
StanceHow the programme holds the claim: assumed, used, or contested.
used
Cite this
claudiocammarano.com/en/claims/c032/