Replicability Report for PERSONALITY AND SOCIAL PSYCHOLOGY BULLETIN

Personality and Social Psychology Bulletin (PSPB) is the official journal of the Society for Personality and Social Psychology (SPSP).

SCImago rankings of all psychology journals ranked Personality and Social Psychology Bulletin #38 with an SJR-Impact-Factor of 2.5 in 2014.

At present, the replicability-report is based on articles published from 1999 to 2015. During this time, PSBP published 2,141 articles. The replicability-report is based on 1,653 articles that reported one or more t or F-test in the text of the results section (results reported in Figures or Tables are not included).  The test-statistic was converted into z-scores to estimate post-hoc-power.  The analysis is based on 11,426 z-scores in the range from 2 (just above the 1.96 criterion value for p < .05 (two-tailed) to 4.

PHP-Curve PSPB

Based on the distribution of z-scores in the range between 2 and 4, the average power for significant results in this range is estimated to be 51%. This estimate suggests that only half of the published significant results in this range are predicted to produce a significant results in an exact replication study with the same sample size and power (results with z > 4 are expected to replicate with nearly 100%).

The same method was used to estimate power for individual years.

PHP-Trend PSPB

The results show a mild decrease in power over time.  There is no evidence that the replicability crisis in psychology has led to an increase in power in the past years. The replicability score in 2015 is 50.  Based on this score JPSP:IRGP currently ranks 17 out of 27 journals in psychology. This ranking is subject to change when more data from articles in 2015 become available and more journals are included in the ranking.

Advertisements

One thought on “Replicability Report for PERSONALITY AND SOCIAL PSYCHOLOGY BULLETIN

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s