Replicability-Report for JOURNAL OF EXPERIMENTAL SOCIAL PSYCHOLOGY

JOURNAL OF EXPERIMENTAL SOCIAL PSYCHOLOGY is published by Elsevier. The journal started publishing articles in 1965.

SCImago ranks JOURNAL OF EXPERIMENTAL SOCIAL PSYCHOLOGY as #51 of all psychology journals with an SJR-Impact-Factor of 2.2 in 2014. The replicability-report is based on articles published from 1971 to 2015. The years from 1965 to 1970 were excluded because they provided insufficient data. Since 1971, the journal published 2,884 articles. The replicability-report is based on 2,402 articles that reported one or more t or F-test in the text of the results section (results reported in Figures or Tables are not included).  The test-statistic was converted into z-scores to estimate post-hoc-power.  The analysis is based on 17,179 z-scores in the range from 2, just above the 1.96 criterion value for p < .05 (two-tailed), to 4.

PHP-Curve JESP

Based on the distribution of z-scores in the range between 2 and 4, the average power for significant results in this range is estimated to be 52%. This estimate suggests that 52% of the published significant results in this range are predicted to produce a significant results in an exact replication study with the same sample size and power (results with z > 4 are expected to replicate with nearly 100%).

The same method was used to estimate power for individual years.

PHP-Trend JESP

The results show a decreasing trend. 16 of the replicability scores in the past 17 years have been below the historic average. The only exception is the replicability score in 2015, which was 55. It is too early to tell whether this reflects a real improvement in power in response to the replicability crisis in psychology. The score for 2015 can still change as more data become available.

Advertisements

One thought on “Replicability-Report for JOURNAL OF EXPERIMENTAL SOCIAL PSYCHOLOGY

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s