Random measurement error and the replication crisis: A statistical analysis
This is a draft of a commentary on Loken and Gelman’s Science article “Measurement error and the replication crisis. Comments are welcome. Random Measurement Error Reduces Power, Replicability, and...
View ArticleHidden Figures: Replication Failures in the Stereotype Threat Literature
In the past five years, it has become apparent that many classic and important findings in social psychology fail to replicate (Schimmack, 2016). The replication crisis is often considered a new...
View ArticleHow replicable are statistically significant results in social psychology? A...
Forthcoming article: Motyl, M., Demos, A. P., Carsel, T. S., Hanson, B. E., Melton, Z. J., Mueller, A. B., Prims, J., Sun, J., Washburn, A. N., Wong, K., Yantis, C. A., & Skitka, L. J. (in press)....
View ArticleWhat would Cohen say? A comment on p < .005
Most psychologists are trained in Fisherian statistics, which has become known as Null-Hypothesis Significance Testing (NHST). NHST compares an observed effect size against a hypothetical effect size....
View ArticleReplicability 101: How to interpret the results of replication studies
Even statistically sophisticated psychologists struggle with the interpretation of replication studies (Maxwell et al., 2015). This article gives a basic introduction to the interpretation of...
View ArticleA critique of Stroebe and Strack’s Article “The Alleged Crisis and the...
The article by Stroebe and Strack (2014) [henceforth S&S] illustrates how experimental social psychologists responded to replication failures in the beginning of the replicability revolution. The...
View ArticleMost Between-Subject Experimental Social Psychology (BS-ESP) Results Could Be...
Introduction Richard Nisbett has been an influential experimental social psychologist. His co-authored book on faulty human information processing (Nisbett & Ross, 1980) provided the foundation of...
View ArticleThe Replicability Index Is the Most Powerful Tool to Detect Publication Bias...
Abstract Methods for the detection of publication bias in meta-analyses were first introduced in the 1980s (Light & Pillemer, 1984). However, existing methods tend to have low statistical power to...
View ArticleReplicability Rankings 2010-2020
Welcome to the replicability rankings for 120 psychology journals. More information about the statistical method that is used to create the replicability rankings can be found elsewhere (Z-Curve;...
View ArticleThe Power-Corrected H-Index
I was going to write this blog post eventually, but the online first publication of Radosic and Diener’s (2021) article “Citation Metrics in Psychological Science” provided a good opportunity to do so...
View Article