Small proportions: what to report for confidence intervals?
Hilde Tobi, Paul B. van den Berg, Lolkje TW de Jong-van den Berg
PURPOSE: It is generally agreed that a confidence interval (CI) is usually more informative than a point estimate or p-value, but we rarely encounter small proportions with CI in the pharmaco-epidemiological literature. When a CI is given it is sporadically reported, how it was calculated. This incorrectly suggests one single method to calculate CIs. To identify the method best suited for small proportions, seven approximate methods and the Clopper-Pearson Exact method to calculate CIs were compared. METHODS: In a simulation study for 90-, 95- and 99%CIs, with sample size 1000 and proportions ranging from 0.001 to 0.01, were evaluated systematically. Main quality criteria were coverage and interval width. The methods are illustrated using data from pharmaco-epidemiology studies. RESULTS: Simulations showed that standard Wald methods have insufficient coverage probability regardless of…