The Practical Alternative to the p Value Is the Correctly Used p Value

Because of the strong overreliance on p values in the scientific literature, some researchers have argued that we need to move beyond p values and embrace practical alternatives. When proposing alternatives to p values statisticians often commit the statistician's fallacy, whereby they declare which statistic researchers really want to know. Instead of telling researchers what they want to know, statisticians should teach researchers which questions they can ask. In some situations, the answer to the question they are most interested in will be the p value. As long as null-hypothesis tests have been criticized, researchers have suggested including minimum-effect tests and equivalence tests in our statistical toolbox, and these tests have the potential to greatly improve the questions researchers ask. If anyone believes p values affect the quality of scientific research, preventing the misinterpretation of p values by developing better evidence-based education and user-centered statistical software should be a top priority. Polarized discussions about which statistic scientists should use has distracted us from examining more important questions, such as asking researchers what they want to know when they conduct scientific research. Before we can improve our statistical inferences, we need to improve our statistical questions.

Automated summary

Due to the strong reliance on p values in scientific literature, some researchers argue for moving beyond p values and embracing practical alternatives. It is suggested that statisticians should teach researchers what questions they can ask rather than telling them what they want to know, and including minimum-effect tests and equivalence tests in statistical toolbox may greatly improve the questions researchers ask. Developing better evidence-based education and user-centered statistical software to prevent misinterpretation of p values is seen as a top priority.