Abstract
Hypothesis testing, while by far the most common statistical technique for generating conclusions from data, is nonetheless not very informative. It emphasizes a banal and confusing question (“Is it true that some set of population means are not all identical to one another?”) whose answer is, in a mathematical sense, almost inevitably known (“No”). Hypothesis testing, as it is customarily implemented, ignores two issues that are generally much more interesting, important, and relevant: What is thepattern of population means over conditions, and what are the magnitudes of various variability measures (e.g., standard errors of the mean, estimates of population standard deviations)? The simple expedient of plotting relevant sample statistics with associated variability bars is a substantially better way of conveying the results of an experiment. In today’s microcomputer environment, there are many relatively cheap and easily available applications that allow one to do this. I make some brief, informal comments about some of these applications.
Article PDF
Similar content being viewed by others
References
Bakan, D. (1966). The test of significance in psychological research.Psychological Bulletin,66, 423–437.
Cohen, J. (1990). Things I have learned (so far).American Psychologist,45, 1304–1312.
Glgerenzer, G., Swutink, Z., Porter, T., Daston, L., Beatty, J., &Kjruger, L. (1989).The Empire of chance: How probability changed science and everyday life. Cambridge, U.K.: Cambridge University Press.
Loftus, G. R. (1991). On the tyranny of hypothesis testing in the social sciences.Contemporary Psychology,36, 102–105.
Loftus, G. R. (1993). Editorial comment.Memory & Cognition,21, 1–3.
Melton, A. W. (1962). Editorial.Journal of Experimental Psychology,64, 553–557.
Nunnally, J. (1960). The place of statistics in psychology.Educational & Psychological Measurement,20, 641–650.
Tufte, E. R. (1983).The visual display of quantitative information. Cheshire, CT: Graphics Press.
Tufte, E. R. (1990).Envisioning information. Cheshire, CT: Graphics Press.
Tukey, J. W. (1977).Exploratory data analysis. Reading, MA: Addison-Wesley.
Author information
Authors and Affiliations
Corresponding author
Additional information
The writing of this manuscript was supported by an NIMH grant to G. Loftus.
Rights and permissions
About this article
Cite this article
Loftus, G.R. A picture is worth a thousandp values: On the irrelevance of hypothesis testing in the microcomputer age. Behavior Research Methods, Instruments, & Computers 25, 250–256 (1993). https://doi.org/10.3758/BF03204506
Issue Date:
DOI: https://doi.org/10.3758/BF03204506