McMaster University

McMaster University

Multiple testing in orthopedic literature: a common problem?

We are pleased to share with you the most recent publication from the MacOrtho team titled “Multiple testing in orthopedic literature: a common problem”.

Find the abstract below and click here to access the full-version of the article.

Walenkamp NN, Roes KC, Bhandari M, Goslings JC, Schep NW. Multiple testing in orthopedic literature: a common problem? BMC Res Notes. 2013 Sep 21;6(1):374.


BACKGROUND: Performing multiple tests in primary research is a frequent subject of discussion. This discussion originates from the fact that when multiple tests are performed, it becomes more likely to reject one of the null hypotheses, conditional on that these hypotheses are true and thus commit a type one error. Several correction methods for multiple testing are available. The primary aim of this study was to assess the quantity of articles published in two highly esteemed orthopedic journals in which multiple testing was performed. The secondary aims were to determine in which percentage of these studies a correction was performed and to assess the risk of committing a type one error if no correction was applied.

METHODS: The 2010 annals of two orthopedic journals (A and B) were systematically hand searched by two independent investigators. All articles on original research in which statistics were applied were considered. Eligible publications were reviewed for the use of multiple testing with respect to predetermined criteria.

RESULTS: A total of 763 titles were screened and 127 articles were identified and included in the analysis. A median of 15 statistical inference results were reported per publication in both journal A and B. Correction for multiple testing was performed in 15% of the articles published in journal A and in 6% from journal B. The estimated median risk of obtaining at least one significant result for uncorrected studies was calculated to be 54% for both journals.

CONCLUSION: This study shows that the risk of false significant findings is considerable and that correcting for multiple testing is only performed in a small percentage of all articles published in the orthopedic literature reviewed.

Valid XHTML 1.0 Transitional Level Double-A conformance, W3C WAI Web Content Accessibility Guidelines 2.0