Assessing the quality of randomized trials: reliability of the Jadad scale
- PMID: 10503804
- DOI: 10.1016/s0197-2456(99)00026-4
Assessing the quality of randomized trials: reliability of the Jadad scale
Abstract
An instrument was developed and validated by Jadad, et al. to assess the quality of clinical trials using studies from the pain literature. Our study determined the reliability of the Jadad scale and the effect of blinding on interrater agreement in another group of primary studies. Four raters independently assessed blinded and unblinded versions of 76 randomized trials. Interrater agreement was calculated among combinations of four raters for blinded and unblinded versions of the studies. A 4 x 2 x 2 repeated measures design was employed to evaluate the effect of blinding. The interrater agreement for the Jadad scale was poor (kappa 0.37 to 0.39), but agreement improved substantially (kappa 0.53 to 0.59) with removal of the third item (an explanation of withdrawals). Blinding did not significantly affect the Jadad scale scores. A more precise description of how to score the withdrawal item and careful conduct of a practice set of articles might improve interrater agreement. In contrast with the conclusions reached by Jadad, we were unable to demonstrate a significant effect of blinding on the quality scores.
Comment in
-
Quality in the reporting of randomized trials in surgery: is the Jadad scale reliable?Control Clin Trials. 2001 Dec;22(6):687-8. doi: 10.1016/s0197-2456(01)00147-7. Control Clin Trials. 2001. PMID: 11738124 No abstract available.
Similar articles
-
Methodological quality of randomized controlled trials of postoperative epidural analgesia: validation of the Epidural Analgesia Trial Checklist as a specific instrument to evaluate methodology.Reg Anesth Pain Med. 2010 Nov-Dec;35(6):549-55. doi: 10.1097/AAP.0b013e3181fa114e. Reg Anesth Pain Med. 2010. PMID: 20975473 Review.
-
Reporting of outcomes in orthopaedic randomized trials: does blinding of outcome assessors matter?J Bone Joint Surg Am. 2007 Mar;89(3):550-8. doi: 10.2106/JBJS.F.00683. J Bone Joint Surg Am. 2007. PMID: 17332104 Review.
-
Reliability of 3 assessment tools used to evaluate randomized controlled trials for treatment of neck pain.Spine (Phila Pa 1976). 2012 Mar 15;37(6):515-22. doi: 10.1097/BRS.0b013e31822671eb. Spine (Phila Pa 1976). 2012. PMID: 21673624
-
The quality of reporting and outcome measures in randomized clinical trials related to upper-extremity disorders.J Hand Surg Am. 2004 Jul;29(4):727-34; discussion 735-7. doi: 10.1016/j.jhsa.2004.04.003. J Hand Surg Am. 2004. PMID: 15249101
-
Assessing the quality of reports of randomized clinical trials: is blinding necessary?Control Clin Trials. 1996 Feb;17(1):1-12. doi: 10.1016/0197-2456(95)00134-4. Control Clin Trials. 1996. PMID: 8721797
Cited by
-
Effectiveness of nursing educational interventions in managing post-surgical pain. Systematic review.Invest Educ Enferm. 2019 May;37(2):e10. doi: 10.17533/udea.iee.v37n2e10. Invest Educ Enferm. 2019. PMID: 31487447 Free PMC article.
-
Users' guide to the surgical literature: how to use a systematic literature review and meta-analysis.Can J Surg. 2004 Feb;47(1):60-7. Can J Surg. 2004. PMID: 14997929 Free PMC article. No abstract available.
-
Effects of Tai Chi on Self-Efficacy: A Systematic Review.Evid Based Complement Alternat Med. 2018 Aug 15;2018:1701372. doi: 10.1155/2018/1701372. eCollection 2018. Evid Based Complement Alternat Med. 2018. PMID: 30186352 Free PMC article. Review.
-
Health Benefits of Bread Fortification: A Systematic Review of Clinical Trials according to the PRISMA Statement.Nutrients. 2023 Oct 20;15(20):4459. doi: 10.3390/nu15204459. Nutrients. 2023. PMID: 37892534 Free PMC article. Review.
-
The efficacy of psychological interventions on psoriasis treatment: a systematic review and meta-analysis of randomized controlled trials.Psychol Res Behav Manag. 2019 Feb 7;12:97-106. doi: 10.2147/PRBM.S195181. eCollection 2019. Psychol Res Behav Manag. 2019. PMID: 30799963 Free PMC article. Review.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources