The Journal of Bone and Joint Surgery (American). 2005;87:2632-2638.
doi:10.2106/JBJS.E.00370
© 2005 The Journal of Bone and Joint Surgery, Inc.
This Article
Right arrow Full Text
Right arrow Full Text (PDF)
Right arrow CME: Take the exam for this article:
 CME 4: October, November, December 2005
Right arrow [Supplementary Material]
Right arrow Letters to the Editor: Submit a response
Right arrow Alert me when this article is cited
Right arrow Alert me when Letters to the Editor are posted
Right arrow Alert me if a correction is posted
Services
Right arrow E-mail this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Add to My File Cabinet
Right arrow Download to citation manager
Right arrowReprints and Permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Obremskey, W. T.
Right arrow Articles by Bhandari, M.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Obremskey, W. T.
Right arrow Articles by Bhandari, M.
Social Bookmarking
Add to CiteULike   Add to Connotea   Add to Del.icio.us   Add to Technorati  
What's this?

Level of Evidence in Orthopaedic Journals

William T. Obremskey, MD, MPH1, Nick Pappas, MS2, Emad Attallah-Wasif, MD1, Paul Tornetta, III, MD3 and Mohit Bhandari, MD4

1 Department of Orthopaedic Surgery, Vanderbilt University, 131 Medical Center South, 2100 Pierce Avenue, Nashville, TN 37212. E-mail address for W.T. Obremskey: william.obremskey{at}vanderbilt.edu
2 3104 Dudley Avenue, Nashville, TN 37212
3 Department of Orthopaedic Surgery, Boston Medical Center, Dowling 2 North, 850 Harrison Avenue, Boston, MA 02118
4 Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton Health Sciences–General Site, 7 North, Suite 723, Hamilton, ON L8L 2X2, Canada

Investigation performed at the Departments of Orthopaedic Surgery at Vanderbilt University, Nashville, Tennessee; Boston Medical Center, Boston University, Boston, Massachusetts; and McMaster University, Hamilton, Ontario, Canada

The authors did not receive grants or outside funding in support of their research or preparation of this manuscript. They did not receive payments or other benefits or a commitment or agreement to provide such benefits from a commercial entity. No commercial entity paid or directed, or agreed to pay or direct, any benefits to any research fund, foundation, educational institution, or other charitable or nonprofit organization with which the authors are affiliated or associated.

Background: The American edition of The Journal of Bone and Joint Surgery (JBJS-A) has included a level-of-evidence rating for each of its clinical scientific papers published since January 2003. The purpose of this study was to assess the type and level of evidence found in nine different orthopaedic journals by applying this level-of-evidence rating system.

Methods: We reviewed all clinical articles published from January through June 2003 in nine orthopaedic journals. Studies of animals, studies of cadavera, basic-science articles, review articles, case reports, and expert opinions were excluded. The remaining 382 clinical articles were randomly assigned to three experienced reviewers and two inexperienced reviewers, who rated them with the JBJS-A grading system. Each reviewer determined whether the studies were therapeutic, prognostic, diagnostic, or economic, and each rated the level of evidence as I, II, III, or IV. Reviewers were blinded to the grades assigned by the other reviewers.

Results: According to the reviewers' ratings, 70.7% of the articles were therapeutic, 19.9% were prognostic, 8.9% were diagnostic, and 0.5% were economic. The reviewers graded 11.3% as Level I, 20.7% as Level II, 9.9% as Level III, and 58.1% as Level IV. The kappa values for the interobserver agreement between the experienced reviewers and the inexperienced reviewers were 0.62 for the level of evidence and 0.76 for the study type. The kappa values for the interobserver agreement between the experienced reviewers were 0.75 for the level of evidence and 0.85 for the study type. The kappa values for the agreement between the reviewers' grades and the JBJS-A grades were 0.84 for the level of evidence and 1.00 for the study type. All kappa values were significantly different from zero (p < 0.0001 for all). The percentage of articles that were rated Level I or II increased in accordance with the 2003 journal impact factors for the individual journals (p = 0.0061).

Conclusions: Orthopaedic journals with a higher impact factor are more likely to publish Level-I or II articles. The type and level of information in orthopaedic journals can be reliably classified, and clinical investigators should pursue studies with a higher level of evidence whenever feasible.


Add to CiteULike CiteULike   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Technorati Technorati    What's this?


This article has been cited by other articles:


Home page
 Am J Sports MedHome page
P. R. Chavan, T. R. Duquin, and L. J. Bisson
Repair of the Ruptured Distal Biceps Tendon: A Systematic Review
Am. J. Sports Med., August 1, 2008; 36(8): 1618 - 1624.
[Abstract] [Full Text] [PDF]

Home page
 JBJSHome page
K. Okike, M. S. Kocher, C. T. Mehlman, J. D. Heckman, and M. Bhandari
Publication Bias in Orthopaedic Research: An Analysis of Scientific Factors Associated with Publication in The Journal of Bone and Joint Surgery (American Volume)
J. Bone Joint Surg. Am., March 1, 2008; 90(3): 595 - 601.
[Abstract] [Full Text] [PDF]

Home page
 JBJSHome page
N. Fletcher, D. Sofianos, M. B. Berkes, and W. T. Obremskey
Prevention of Perioperative Infection
J. Bone Joint Surg. Am., July 1, 2007; 89(7): 1605 - 1618.
[Full Text] [PDF]

Home page
 JBJSHome page
J. G. Wright
A Practical Guide to Assigning Levels of Evidence
J. Bone Joint Surg. Am., May 1, 2007; 89(5): 1128 - 1130.
[Full Text] [PDF]

Home page
 JBJSHome page
A. I. Leet, C. P. Pichard, and M. C. Ain

J. Bone Joint Surg. Am., August 1, 2006; 88(8): 1891 - 1892.
[Full Text] [PDF]