Methodological quality of case series studies: an introduction to the JBI critical appraisal tool

Introduction: Systematic reviews provide a rigorous synthesis of the best available evidence regarding a certain question. Where high-quality evidence is lacking, systematic reviewers may choose to rely on case series studies to provide information in relation to their question. However, to date there has been limited guidance on how to incorporate case series studies within systematic reviews assessing the effectiveness of an intervention, particularly with reference to assessing the methodological quality or risk of bias of these studies.

Methods: An international working group was formed to review the methodological literature regarding case series as a form of evidence for inclusion in systematic reviews. The group then developed a critical appraisal tool based on the epidemiological literature relating to bias within these studies. This was then piloted, reviewed, and approved by JBI's international Scientific Committee.

Results: The JBI critical appraisal tool for case series studies includes 10 questions addressing the internal validity and risk of bias of case series designs, particularly confounding, selection, and information bias, in addition to the importance of clear reporting.

Conclusion: In certain situations, case series designs may represent the best available evidence to inform clinical practice. The JBI critical appraisal tool for case series offers systematic reviewers an approved method to assess the methodological quality of these studies.

Similar articles

Gomersall JS, Jadotte YT, Xue Y, Lockwood S, Riddle D, Preda A. Gomersall JS, et al. Int J Evid Based Healthc. 2015 Sep;13(3):170-8. doi: 10.1097/XEB.0000000000000063. Int J Evid Based Healthc. 2015. PMID: 26288063

Peters MDJ, Marnie C, Tricco AC, Pollock D, Munn Z, Alexander L, McInerney P, Godfrey CM, Khalil H. Peters MDJ, et al. JBI Evid Synth. 2020 Oct;18(10):2119-2126. doi: 10.11124/JBIES-20-00167. JBI Evid Synth. 2020. PMID: 33038124 Review.

Zeng X, Zhang Y, Kwong JS, Zhang C, Li S, Sun F, Niu Y, Du L. Zeng X, et al. J Evid Based Med. 2015 Feb;8(1):2-10. doi: 10.1111/jebm.12141. J Evid Based Med. 2015. PMID: 25594108 Review.

Peters MDJ, Marnie C, Tricco AC, Pollock D, Munn Z, Alexander L, McInerney P, Godfrey CM, Khalil H. Peters MDJ, et al. JBI Evid Implement. 2021 Mar;19(1):3-10. doi: 10.1097/XEB.0000000000000277. JBI Evid Implement. 2021. PMID: 33570328

Munn Z, Stone JC, Aromataris E, Klugar M, Sears K, Leonardi-Bee J, Barker TH. Munn Z, et al. JBI Evid Synth. 2023 Mar 1;21(3):467-471. doi: 10.11124/JBIES-22-00224. JBI Evid Synth. 2023. PMID: 36476419

Cited by

Gaudex Y, Gandillot V, Fontanille I, Bouchard P, Kerner S, Carra MC. Gaudex Y, et al. BMC Oral Health. 2024 Sep 4;24(1):1037. doi: 10.1186/s12903-024-04771-z. BMC Oral Health. 2024. PMID: 39232693

He Y, Wang S, Xiong H. He Y, et al. Int J Dent. 2024 Aug 24;2024:5020873. doi: 10.1155/2024/5020873. eCollection 2024. Int J Dent. 2024. PMID: 39220102 Free PMC article. Review.

Gholamali Nezhad F, Martin J, Tassone VK, Swiderski A, Demchenko I, Khan S, Chaudhry HE, Palmisano A, Santarnecchi E, Bhat V. Gholamali Nezhad F, et al. Front Psychiatry. 2024 Aug 14;15:1419243. doi: 10.3389/fpsyt.2024.1419243. eCollection 2024. Front Psychiatry. 2024. PMID: 39211537 Free PMC article.

Aledavoud A, Mohammadi M, Ataei A, Shahesmaeilinejad A, Harandi MF. Aledavoud A, et al. BMC Infect Dis. 2024 Aug 29;24(1):889. doi: 10.1186/s12879-024-09778-z. BMC Infect Dis. 2024. PMID: 39210268 Free PMC article.

Niyangoda D, Muayad M, Tesfaye W, Bushell M, Ahmad D, Samarawickrema I, Sinclair J, Kebriti S, Maida V, Thomas J. Niyangoda D, et al. Pharmaceutics. 2024 Aug 17;16(8):1081. doi: 10.3390/pharmaceutics16081081. Pharmaceutics. 2024. PMID: 39204426 Free PMC article. Review.