American Journal of Epidemiology Advance Access originally published online on August 21, 2007
American Journal of Epidemiology 2007 166(10):1203-1209; doi:10.1093/aje/kwm189
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
PRACTICE OF EPIDEMIOLOGY |
Should Meta-Analyses of Interventions Include Observational Studies in Addition to Randomized Controlled Trials? A Critical Examination of Underlying Principles
1 Centre for Clinical Epidemiology and Community Studies, Lady Davis Institute for Medical Research, SMBD-Jewish General Hospital, McGill University, Montreal, Quebec, Canada
2 Department of Epidemiology and Biostatistics, McGill University, Montreal, Quebec, Canada
3 Department of Mathematics and Statistics, McGill University, Montreal, Quebec, Canada
4 Department of Pediatrics, McGill University, Montreal, Quebec, Canada
5 Institute for Work and Health, Toronto, Ontario, Canada
6 Department of Medicine, McGill University Health Centre, McGill University, Montreal, Quebec, Canada
Correspondence to Dr. Ian Shrier, Centre for Clinical Epidemiology and Community Studies, SMBD-Jewish General Hospital, 3755 Cote Ste Catherine Road, Montreal, Quebec H3T 1E2, Canada (e-mail: ian.shrier{at}mcgill.ca).
Received for publication December 13, 2006. Accepted for publication May 25, 2007.
Some authors argue that systematic reviews and meta-analyses of intervention studies should include only randomized controlled trials because the randomized controlled trial is a more valid study design for causal inference compared with the observational study design. However, a review of the principal elements underlying this claim (randomization removes the chance of confounding, and the double-blind process minimizes biases caused by the placebo effect) suggests that both classes of study designs have strengths and weaknesses, and including information from observational studies may improve the inference based on only randomized controlled trials. Furthermore, a review of empirical studies suggests that meta-analyses based on observational studies generally produce estimates of effect similar to those from meta-analyses based on randomized controlled trials. The authors found that the advantages of including both observational studies and randomized studies in a meta-analysis could outweigh the disadvantages in many situations and that observational studies should not be excluded a priori.
intervention studies; meta-analysis; observation; randomized controlled trials
Abbreviations: RCT, randomized controlled trial
![]()
CiteULike
Connotea
Del.icio.us What's this?
This article has been cited by other articles:
![]() |
S. A. R. Doi and A. Onitilo Author Reply Clin. Med. Res., June 1, 2009; 7(1-2): 2 - 3. [Full Text] [PDF] |
||||
![]() |
N. Simunovic, S. Sprague, and M. Bhandari Methodological Issues in Systematic Reviews and Meta-Analyses of Observational Studies in Orthopaedic Research J. Bone Joint Surg. Am., May 1, 2009; 91(Supplement_3): 87 - 94. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. Pereira and E. Castilho RE: "SHOULD META-ANALYSES OF INTERVENTIONS INCLUDE OBSERVATIONAL STUDIES IN ADDITION TO RANDOMIZED CONTROLLED TRIALS? A CRITICAL EXAMINATION OF UNDERLYING PRINCIPLES" Am. J. Epidemiol., March 15, 2009; 169(6): 783 - 783. [Full Text] [PDF] |
||||
![]() |
R. J. Steele, R. W. Platt, and I. Shrier THREE OF THE AUTHORS REPLY Am. J. Epidemiol., March 15, 2009; 169(6): 783 - 784. [Full Text] [PDF] |
||||
![]() |
L. W Green Making research relevant: if it is an evidence-based practice, where's the practice-based evidence? Fam. Pract., December 1, 2008; 25(suppl_1): i20 - i24. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. P A Ioannidis, N. A Patsopoulos, and H. R Rothstein Reasons or excuses for avoiding meta-analysis in forest plots BMJ, June 21, 2008; 336(7658): 1413 - 1415. [Full Text] [PDF] |
||||
![]() |
J. M. Robbins, G. E. Thatcher, D. A. Webb, and V. G. Valdmanis Nutritionist Visits, Diabetes Classes, and Hospitalization Rates and Charges: The Urban Diabetes Study Diabetes Care, April 1, 2008; 31(4): 655 - 660. [Abstract] [Full Text] [PDF] |
||||





