Replicability-Report for SOCIAL PSYCHOLOGY AND PERSONALITY SCIENCE

SOCIAL PSYCHOLOGY AND PERSONALITY SCIENCE (SPPS) is sponsored by several psychological organizations: Association for Research in Personality (ARP), the European Association of Social Psychology (EASP), the Society of Experimental Social Psychology (SESP), the Society for Personality and Social Psychology (SPSP). The journal started publishing articles in 2010.

SCImago ranks SPPS as #57 of all psychology journals with an SJR-Impact-Factor of 2.1 in 2014.At present, the replicability-report is based on articles published from inception in 2010 to 2015. During this time, SPPS published 520 articles. The replicability-report is based on 378 articles that reported one or more t or F-test in the text of the results section (results reported in Figures or Tables are not included).  The test-statistic was converted into z-scores to estimate post-hoc-power.  The analysis is based on 1,879 z-scores in the range from 2, just above the 1.96 criterion value for p < .05 (two-tailed), to 4.

PHP-Curve SPPS

Based on the distribution of z-scores in the range between 2 and 4, the average power for significant results in this range is estimated to be 52%. This estimate suggests that only half of the published significant results in this range are predicted to produce a significant results in an exact replication study with the same sample size and power (results with z > 4 are expected to replicate with nearly 100%).

The same method was used to estimate power for individual years.

PHP-Trend SPPS

The results show a notable increase in the current year.  This increase may represent a change in the selection criteria in response to the replicability crisis in psychology. However, the 2015 score can still change as more data are becoming available.

Advertisements

One thought on “Replicability-Report for SOCIAL PSYCHOLOGY AND PERSONALITY SCIENCE

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s