Science with or without statistics: Discover-generalize-replicate? Discover-replicate-generalize? Comment

Overstated generalizability (external validity) is common in research. It may coexist with inflation of the magnitude and statistical support for effects and dismissal of internal validity problems. Generalizability may be secured before attempting replication of proposed discoveries or replication may precede efforts to generalize. These opposite approaches may decrease or increase, respectively, the use of inferential statistics with advantages and disadvantages.

Automated summary

Overstating generalizability in research is common and may lead to neglect of internal validity issues. Different approaches to securing generalizability before replication or vice versa can have varying effects on the use of inferential statistics.