The Journal of Bone and Joint Surgery (American). 2007;89:1970-1978.
doi:10.2106/JBJS.F.01591
© 2007 The Journal of Bone and Joint Surgery, Inc.
This Article
Right arrow Full Text
Right arrow Full Text (PDF)
Right arrow [Supplementary Material]
Right arrow Letters to the Editor: Submit a response
Right arrow Alert me when this article is cited
Right arrow Alert me when Letters to the Editor are posted
Right arrow Alert me if a correction is posted
Services
Right arrow E-mail this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My File Cabinet
Right arrow Download to citation manager
Right arrow Rights and Permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Chan, S.
Right arrow Articles by Bhandari, M.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Chan, S.
Right arrow Articles by Bhandari, M.
Related Collections
Right arrow Adult Trauma
Right arrow Spine
Right arrow Adult Hip
Right arrow Adult Knee
Right arrow Foot/Ankle
Right arrow Shoulder
Right arrow Elbow
Right arrow Hand/Wrist
Right arrow Sports
Right arrow Pediatrics
Right arrow Oncology
Right arrow Rehabilitation
Right arrow Pain Management
Social Bookmarking
Add to CiteULike   Add to Connotea   Add to Del.icio.us   Add to Facebook   Add to Technorati   Add to Twitter  
What's this?

The Quality of Reporting of Orthopaedic Randomized Trials with Use of a Checklist for Nonpharmacological Therapies

Simon Chan, BSc1 and Mohit Bhandari, MD1

1 Hamilton Health Sciences-General Hospital, 237 Barton Street East, 7 North Wing, Suite 727, Hamilton, ON L8L 2X2, Canada. E-mail address for M. Bhandari: bhandam{at}mcmaster.ca

Investigation performed at the Division of Orthopaedic Surgery, McMaster University, Hamilton, Ontario, Canada

Disclosure: In support of their research for or preparation of this work, one or more of the authors received, in any one year, outside funding or grants of less than $10,000 from the Canadian Institutes of Health Research and of more than $10,000 from a Canada Research Chair and McMaster University. Neither they nor a member of their immediate families received payments or other benefits or a commitment or agreement to provide such benefits from a commercial entity. No commercial entity paid or directed, or agreed to pay or direct, any benefits to any research fund, foundation, division, center, clinical practice, or other charitable or nonprofit organization with which the authors, or a member of their immediate families, are affiliated or associated.

Background: The Consolidated Standards of Reporting Trials statement for the reporting of randomized controlled trials has been limited by its applicability to surgical trials. In response, a Checklist to Evaluate a Report of a Nonpharmacological Trial was recently developed by the Consolidated Standards of Reporting Trials group to address reporting issues in surgical trials. We aimed (1) to apply the checklist for nonpharmacological therapies to orthopaedic randomized controlled trials across multiple journals from 2004 through 2005, and (2) to survey authors when methodological safeguards itemized in the checklist were not reported to determine whether they actually had been performed. We hypothesized that lack of reporting of a methodological safeguard did not necessarily mean it had not been conducted.

Methods: We searched for relevant orthopaedic randomized controlled trials across eight journals in the period from January 2004 through December 2005. We applied the Checklist to Evaluate a Report of a Nonpharmacological Trial to all eligible studies. We contacted authors to determine what methodological safeguards were actually used, especially when details remained unclear from the publication.

Results: We included eighty-seven randomized controlled trials from eighty-five scientific reports. In assessing the randomized controlled trials with the checklist for nonpharmacological therapies, seventy-three studies (84%) had unclear reporting of treatment allocation concealment. Only seventeen studies (20%) mentioned surgeon skill or experience. The blinding of patients, ward staff, rehabilitation staff, clinical outcome assessors, and nonclinical outcome assessors was unclear in forty-eight (55%), sixty-three (72%), sixty-four (74%), forty (46%), and thirty-three studies (38%), respectively. Authors from forty-three randomized controlled trials responded to our survey. The results of the survey showed that 41% (95% confidence interval, 25% to 58%) of the trials had adequate allocation concealment when this had been unclear from the report. Although the surgical experience of the investigators was rarely reported, most authors (70%) acknowledged that they had defined "surgical expertise criteria" such as minimum case criteria, specialized training, and clinical performance. The survey also showed that 28% to 40% of the trials had blinding of relevant groups despite the fact that the reporting of such blinding had been unclear in the publications.

Conclusions: The quality of reporting in the orthopaedic literature was highly variable. Readers should not assume that bias-reducing safeguards that were not reported in a randomized controlled trial did not occur. Our study reinforces the need for the consistent use of a tool like the Checklist to Evaluate a Report of a Nonpharmacological Trial to assess the methodology of surgical trials.


Add to CiteULike CiteULike   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Facebook Facebook   Add to Technorati Technorati   Add to Twitter Twitter    What's this?


This article has been cited by other articles:


Home page
 JBJSHome page
A. Herman, I. B. Botser, S. Tenenbaum, and A. Chechick
Intention-to-Treat Analysis and Accounting for Missing Data in Orthopaedic Randomized Clinical Trials
J. Bone Joint Surg. Am., September 1, 2009; 91(9): 2137 - 2143.
[Abstract] [Full Text] [PDF]

Home page
 Am J Sports MedHome page
R. B. Meredick, K. J. Vance, D. Appleby, and J. H. Lubowitz
Outcome of Single-Bundle Versus Double-Bundle Reconstruction of the Anterior Cruciate Ligament: A Meta-Analysis
Am. J. Sports Med., July 1, 2008; 36(7): 1414 - 1421.
[Abstract] [Full Text] [PDF]