ranks JOURNAL OF POSITIVE PSYCHOLOGY
as #277 of all psychology journals with an SJR-Impact-Factor
of 0.9 in 2014. At present, the replicability-report is based on articles published from 2006 to 2015. During this time, JOURNAL OF POSITIVE PSYCHOLOGY published 370 articles. The replicability-report is based on 213 articles that reported one or more t or F-test in the text of the results section (results reported in Figures or Tables are not included). The test-statistic was converted into z-scores to estimate post-hoc-power
. The analysis is based on 671 z-scores in the range from 2 (just above the 1.96 criterion value for p < .05 (two-tailed)) to 4.
Based on the distribution of z-scores in the range between 2 and 4, the average power for significant results in this range is estimated to be 56% with the homogeneous model that is currently being used for the replicability rankings. The heterogeneous model fits the actual data better and produces an estimate of 51% power in this range. Power for all significant results is estimated to be 64%. A power estimate of 56% implies that 56% of the published significant results in this range are predicted to produce a significant results in an exact replication study with the same sample size and power (results with z > 4 are expected to replicate with nearly 100%).
The same method was used to estimate power for individual years.
The time trend is essentially flat. Due to the relatively small number of observations, variability across years is mostly random. The average for the years 2010-2014 is 53%, which is close to the historic average. The current power estimate for 2015 is 63%, but it is not clear whether this is an actual positive trend in response to the replicability crisis in psychology.