Replicability-Report for JOURNAL OF EXPERIMENTAL PSYCHOLOGY: GENERAL

JOURNAL OF EXPERIMENTAL PSYCHOLOGY: GENERAL (JEP:G) is published by the American Psychological Association (APA). The journal started publishing articles in 1982.

SCImago ranks JOURNAL OF EXPERIMENTAL PSYCHOLOGY: GENERAL as #20 of all psychology journals with an SJR-Impact-Factor of 3.4 in 2014. At present, the replicability-report is based on articles published from 2004 to 2015. During this time, JEP:General published 666 articles. The replicability-report is based on 595 articles that reported one or more t or F-test in the text of the results section (results reported in Figures or Tables are not included).  The test-statistic was converted into z-scores to estimate post-hoc-power.  The analysis is based on 6,125 z-scores in the range from 2, just above the 1.96 criterion value for p < .05 (two-tailed), to 4.

PHP-Curve JEP.G

Based on the distribution of z-scores in the range between 2 and 4, the average power for significant results in this range is estimated to be 64%. This estimate suggests that 64% of the published significant results in this range are predicted to produce a significant results in an exact replication study with the same sample size and power (results with z > 4 are expected to replicate with nearly 100%).

The same method was used to estimate power for individual years.

PHP-Trend JEP.G

The results show a small linear decrease over time. However, in the past 4 years power increased and the replicability score in 2015 is slightly above the historic average.  Future data will show whether JEP:GENERAL can build on this positive trend and increase replicability of reported results.

Advertisements

One thought on “Replicability-Report for JOURNAL OF EXPERIMENTAL PSYCHOLOGY: GENERAL

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s