The Journal of Bone and Joint Surgery 83:15 (2001)
© 2001 The Journal of Bone and Joint Surgery, Inc.
Meta-Analyses in Orthopaedic Surgery
A Systematic Review of Their Methodologies
Mohit Bhandari, MDMSc(Epid),
Farrah Morrow, BSc,
Abhaya V. Kulkarni, MD, MSc(Epid) and
Paul Tornetta, III, MD
Investigation performed at the Department of Clinical Epidemiology
and Biostatistics, and the Department of Surgery, McMaster University,
Hamilton, Ontario, Canada; the Department of Surgery, the University
of Toronto, Toronto, Ontario, Canada; and the Department of Orthopaedic
Surgery, Boston Medical Center, Boston, Massachusetts
Mohit Bhandari, MD, MSc(Epid)
Farrah Morrow, BSc
Department of Clinical Epidemiology and Biostatistics, Room 2C12
(M.B.), and Department of Surgery (F.M.), McMaster University, 1200
Main Street West, Hamilton, ON L8N 3Z5, Canada. E-mail address for
M. Bhandari: bhandari{at}netinc.ca
Abhaya V. Kulkarni, MD, MSc(Epid)
Department of Surgery, University of Toronto, Toronto ON M5G
1X5, Canada
Paul Tornetta III, MD
Department of Orthopaedic Surgery, Boston Medical Center, 720
Harrison Avenue, Boston, MA 02118
No benefits in any form have been received or will be received
from a commercial party related directly or indirectly to the subject
of this article. No funds were received in support of this study.
Dr. M. Bhandari was supported by the Ronald K. Fraser Foundation
Research Fellowship, Hamilton, Ontario, Canada. Dr. A.V. Kulkarni
was supported by the Duncan L. Gordon Fellowship from the Hospital
for Sick Children Foundation, Toronto, Ontario, Canada.
Background: The number and quality of well-designed
scientific studies in the orthopaedic literature are limited. The
purpose of this review was to determine the methodological qualities of
published meta-analyses on orthopaedic-surgery-related topics.
Methods: A systematic review of meta-analyses was
conducted. A search of the Medline database provided lists of meta-analyses
in orthopaedics published from 1969 to 1999. Extensive manual searches
of major orthopaedic journals, bibliographies of major orthopaedic
texts, and personal files identified additional studies. Of 601
studies identified, forty met the criteria for eligibility. Two
investigators each assessed the quality of the studies under blinded
conditions, and they abstracted relevant data.
Results: More than 50% of the meta-analyses included
in this review were published after 1994. We found that 88% had methodological
flaws that could limit their validity. The main deficiency was a
lack of information on the methods used to retrieve and assess the
validity of the primary studies. Regression analysis revealed that
meta-analyses authored in affiliation with an epidemiology department
and those published in nonsurgical journals were associated with
higher scores for quality. Meta-analyses with lower scores for quality
tended to report positive findings. The meta-analyses that focused
upon fracture treatment and degenerative disease (hip, knee, or spine)
had significantly lower mean quality scores than did meta-analyses
that examined thrombosis prevention and diagnostic tests (p < 0.05).
Conclusions: The majority of meta-analyses on orthopaedic-surgery-related
topics have methodological limitations. Limitation of bias and improvement
in the validity of the meta-analyses can be achieved by adherence
to strict scientific methodology. However, the ultimate quality
of a meta-analysis depends on the quality of the primary studies
on which it is based. A meta-analysis is most persuasive when data
from high-quality randomized trials are pooled.

CiteULike Connotea Del.icio.us Technorati What's this?
This article has been cited by other articles:

|
 |

|
 |
 
R. T. Ballock and R. J. O'Keefe
The Biology of the Growth Plate
J. Bone Joint Surg. Am.,
March 31, 2003;
85(4):
715 - 726.
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
M. Bhandari, G. H. Guyatt, V. Montori, P. J. Devereaux, and M. F. Swiontkowski
User's Guide to the Orthopaedic Literature: How to Use a Systematic Literature Review
J. Bone Joint Surg. Am.,
September 3, 2002;
84(9):
1672 - 1682.
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
R. Rivas and F. Shapiro
Structural Stages in the Development of the Long Bones and Epiphyses : A Study in the New Zealand White Rabbit
J. Bone Joint Surg. Am.,
January 1, 2002;
84(1):
85 - 100.
[Abstract]
[Full Text]
|
 |
|
|