arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Computer Science · Information Systems

Research Article Editors Can Lead Researchers to Confidence Intervals, but Can’t Make Them Think Statistical Reform Lessons From Medicine

Fiona Fidler, Neil Thomason, Geoff Cumming, Sue Finch, Joanna Leeman

See on the map

Abstract

ABSTRACT—Since the mid-1980s, confidence intervals (CIs) have been standard in medical journals. We sought lessons for psy-chology from medicine’s experience with statistical reform by investigating two attempts by Kenneth Rothman to change sta-tistical practices. We examined 594 American Journal of Public Health (AJPH) articles published between 1982 and 2000 and 110 Epidemiology articles published in 1990 and 2000. Roth-man’s editorial instruction to report CIs and not p values was largely effective: In AJPH, sole reliance on p values dropped from 63 % to 5%, and CI reporting rose from 10 % to 54%; Epidemiology showed even stronger compliance. However, compliance was superficial: Very few authors referred to CIs when discussing results. The results of our survey support what other research has indicated: Editorial policy alone is not a sufficient mechanism for statistical reform. Achieving substan-

More like this