Evidence-based or biased? The quality of published reviews of evidence-based practices

Aos, 2001 Bacon, 1621 Becker, B. J., Hedges, L., & Pigott, T. D. (2004). Campbell Collaboration Statistical Analysis Policy Brief. Retrieved June 12, 2006, from http://www.campbellcollaboration.org/MG/StatsPolicyBrief.pdf Begg, 1994, Publication bias Borduin, 1999, Multisystemic treatment of criminality and violence in adolescents, Journal of the American Academy of Child and Adolescent Psychiatry, 38, 242, 10.1097/00004583-199903000-00009 Borduin, 2000, Community-based treatments of serious antisocial behavior in adolescents, 113 Borduin, 2003, Multisystemic treatment of serious antisocial behavior in adolescents, 299 Brestan, 1998, Effective psychosocial treatments of conduct-disordered children and adolescents: 29 years, 82 studies, and 5,272 kids, Journal of Clinical Child Psychology, 27, 180, 10.1207/s15374424jccp2702_5 Brosnan, 2000, Adolescent conduct problems, 131 Brunk, 1987, A comparison of multisystemic therapy and parent training in the brief treatment of child abuse and neglect, Journal of Consulting and Clinical Psychology, 55, 311, 10.1037/0022-006X.55.2.171 Burns, 2003, Children and evidence-based practice, Psychiatric Clinics of North America, 26, 10.1016/S0193-953X(03)00071-6 Burns, 1999, Effective treatment for mental disorders in children and adolescents, Clinical Child and Family Psychology Review, 2, 199, 10.1023/A:1021826216025 Burns, 2000, Comprehensive community-based interventions for youth with severe emotional disorders: Multisystemic therapy and the wraparound process, Journal of Child and Family Studies, 9, 283, 10.1023/A:1026440406435 Bushman, 1994, Vote-counting procedures in meta-analysis, 193 Bushman, 2001, Narrative impressions of literature: The availability bias and the corrective properties of meta-analytic approaches, Personal and Social Psychology Bulletin, 27, 1123, 10.1177/0146167201279005 Carlton, 1996, Evaluating cumulated research I: The inadequacy of traditional methods, Biological Psychiatry, 39, 65, 10.1016/0006-3223(95)00089-5 2000 Center for Substance Abuse Prevention, 2000 Chalmers, 2002, A brief history of research synthesis, Evaluation & The Health Professions, 25, 12, 10.1177/0163278702025001003 Chambless, 1998, Update on empirically validated therapies, II, The Clinical Psychologist, 51, 3 Chorpita, 2002, Toward large-scale implementation of empirically supported treatments for children: A review and observations by the Hawaii empirical basis to services task force, Clinical Psychology: Science and Practice, 9, 165, 10.1111/j.1468-2850.2002.tb00504.x 1994 Corcoran, 2000, Family interventions with child physical abuse and neglect: A critical review, Children and Youth Services Review, 22, 563, 10.1016/S0190-7409(00)00103-1 Corcoran, 2003 Cormack, 2000, Drug abuse, 155 Curtis, 2004, Multisystemic treatment: A meta-analysis of outcome studies, Journal of Family Psychology, 18, 411, 10.1037/0893-3200.18.3.411 Davies, P. (2004). Evidence-based government. Is it possible? Paper presented at the Fourth Annual Campbell Collaboration Colloquium. Washington, DC. February 19, 2004. Dickersin, 2005, Publication bias: Recognizing the problem, understanding its origins and scope, and preventing harm Farrington, 2003, Family-based prevention of offending: A meta-analysis, The Australian and New Zealand Journal of Criminology, 36, 127, 10.1375/acri.36.2.127 Fonagy, 2002, Disturbance of conduct, 106 Fraser, 1997, Effectiveness of family preservation services, Social Work Research, 21, 138, 10.1093/swr/21.3.138 Fugelsang, 2004, Theory and data interactions of the scientific mind: Evidence from the molecular and the cognitive laboratory, Canadian Journal of Experimental Psychology, 58, 132, 10.1037/h0085799 Gambrill, E. (2006). The ethics of transparency: Systematic reviews and their rivals. Paper presented at the Sixth annual Campbell Collaboration Colloquium, Los Angeles, CA, February 24, 2006. Gibbs, 2003 Gilovich, 1993 Henggeler, S.W. (2003). Multisystemic therapy: An overview. Dissemination, data, and direction. PowerPoint presentation. NASMHPD Research Institute Conference, February 2003. Henggeler, 2004, Decreasing effect sizes for effectiveness studies — Implications for the transport of evidence-based treatments: Comment on Curtis, Ronan, and Borduin (2004), Journal of Family Psychology, 18, 420, 10.1037/0893-3200.18.3.420 Henggeler, 1995, Multisystemic treatment of serious juvenile offenders and their families, 113 Henggeler, S.W., Mihalic, S.F., Rone, L., Thomas, C., & Timmons-Mitchell, J. (1998). Blueprints for Violence Prevention, Book Six: Multisystemic Therapy. Boulder, CO: Center for the Study and Prevention of Violence, Institute of Behavioral Science, University of Colorado at Boulder. Henggeler, 1998 Henngeler, 2006, Methodological critique and meta-analysis as Trojan horse, Children and Youth Services Review, 28, 447, 10.1016/j.childyouth.2005.07.001 Henggeler, 2002, Transporting efficious treatments to field settings: The link between supervisory practices and therapist fidelity in MST programs, Journal of Clinical Child and Adolescent Psychology, 31, 155, 10.1207/S15374424JCCP3102_02 Henggeler, 2002 Henggeler, 2003, Conduct disorder and delinquency, Journal of Marital and Family Therapy, 29, 505, 10.1111/j.1752-0606.2003.tb01692.x Higgins, J. P. T., & Green, S. (Eds). (2005). Cochrane Handbook for Systematic Reviews of Interventions, Version 4.2.5. In: The Cochrane Library, Issue 3, 2005. Chichester, UK: John Wiley & Sons, Ltd. Accessed June 12, 2006 at: http://www.cochrane.org/resources/handbook/hbook.htm Hoagwood, 2001, Evidence-based practice in child and adolescent mental health services, Psychiatric Services, 52, 1179, 10.1176/appi.ps.52.9.1179 Hopewell, 2006, Handsearching versus electronic searching to identify reports of randomized trials Hopewell, 2006, Grey literature in meta-analyses of randomized trials of health care interventions Jadad, 2000, Systematic reviews and meta-analyses on treatment of asthma: Critical evaluation, British Medical Journal, 320, 537, 10.1136/bmj.320.7234.537 Jørgensen, 2006, Cochrane reviews compared with industry supported meta-analyses and other meta-analyses of the same drugs: Systematic review, British Medical Journal, 333, 782, 10.1136/bmj.38973.444699.0B Kazdin, 1998, Psychosocial treatments for conduct disorder in children, 65 Kazdin, 2000, Treatments for aggressive and antisocial children, Child and Adolescent Psychiatric Clinics of North America, 9, 841, 10.1016/S1056-4993(18)30095-6 Kazdin, 2002, 7, 53 Kazdin, 1998, Identifying and developing empirically supported child and adolescent treatments, Journal of Consulting and Clinical Psychology, 66, 19, 10.1037/0022-006X.66.1.19 Lehman, 2004 Letourneau, 2002, Multisystemic treatment of antisocial behavior in adolescents, 364 Lipsey, 2001 Littell, 2005, Lessons from a systematic review of effects of Multisystemic Therapy, Children and Youth Services Review, 47, 445, 10.1016/j.childyouth.2004.11.009 Littell, 2006, The case for Multisystemic Therapy: Evidence or orthodoxy?, Children and Youth Services, 28, 458, 10.1016/j.childyouth.2005.07.002 Littell, 2005, Multisystemic Therapy for social, emotional, and behavioral problems in youth aged 10–17 (Cochrane Review) Luborsky, 1999, The researcher's own therapy allegiances: A ‘wild card’ in comparisons of treatment efficacy, Clinical Psychology: Science and Practice, 6, 95, 10.1093/clipsy/6.1.95 Mahoney, 1977, Publication prejudices: An experimental study of confirmatory bias in the peer review system, Cognitive Therapy and Research, 1, 161, 10.1007/BF01173636 Miller, 2000, An addendum to the 1997 outcome research chart, American Journal of Family Therapy, 28, 347, 10.1080/019261800437900 Miller, 1995, What works? A methodological analysis of the alcohol treatment outcome literature, 12 Moher, 1999, Improving the quality of reports of meta-analyses of randomised controlled trials: The QUOROM statement, The Lancet, 354, 1896, 10.1016/S0140-6736(99)04149-5 Moher, 2001, The CONSORT statement: Revised recommendations for improving the quality of reports of parallel-group randomized trials, The Lancet, 357, 1191, 10.1016/S0140-6736(00)04337-3 MST Services, Inc. (2006). Licensed MST programs. Accessed June 11, 2006 at http://www.mstservices.com/text/licensed_agencies.htm National Institute of Mental Health (2001). Youth in a difficult world. NIH Publication No. 01-4587. Accessed June 12, 2006 at http://www.nimh.nih.gov/publicat/youthdif.cfm National Institute of Mental Health Consortium on Child and Adolescent Research (2003). Data trends. http://www.nimh.nih.gov/childhp/datatrends.cfm National Institute on Drug Abuse, 1999 National Institute on Drug Abuse (2003). Effective drug abuse treatment approaches: Multisystemic therapy. NIDA Behavioral Therapies Development Program. http://www.nida.nih.gov/BRDP/Effective/Henggeler.html Nickerson, 1998, Confirmation bias: A ubiquitous phenomenon in many guises, Review of General Psychology, 2, 175, 10.1037/1089-2680.2.2.175 Office of Juvenile Justice and Delinquency Prevention. Model programs guide. Accessed June 11, 2006 at http://www.dsgonline.com/mpg2.5/mpg_index.htm Petrosino, 2005, The impact of program developers as evaluators on criminal recidivism: Results from meta-analyses of experimental and quasi-experimental research, Journal of Experimental Criminology, 1, 435, 10.1007/s11292-005-3540-8 Petticrew, 2006 Pushak, 2002, The dearth of empirically supported mental health services for children: Multisystemic Therapy as a promising alternative, Scientific Review of Mental Health Practice, 1 Randall, 2003, Multisystemic therapy: A treatment for violent substance-abusing and substance-dependent juvenile offenders, Addictive Behaviors, 28, 1731, 10.1016/j.addbeh.2003.08.045 Rosenthal, 1994, The fugitive literature, 85 Rothstein, 2005 Rothstein, H. R., Turner, H. M., & Lavenberg, J. G. (2004). The Campbell Collaboration Information Retrieval Policy Brief. Retrieved June 12, 2006, from http://www.campbellcollaboration.org/MG/IRMGPolicyBriefRevised.pdf Schoenwald, 2000, Inside multisystemic therapy: Therapist, supervisory, and program practices, Journal of Emotional and Behavioral Disorders, 8, 113, 10.1177/106342660000800207 Schoenwald, 2000, Multisystemic therapy: Monitoring treatment fidelity, Family Process, 39, 83, 10.1111/j.1545-5300.2000.39109.x Schoenwald, 2001, Effectiveness, transportability, and dissemination of interventions: What matters when?, Psychiatric Services, 52, 1190, 10.1176/appi.ps.52.9.1190 Schoenwald, 2002, Multisystemic therapy, 91 Schoenwald, 2003, Transportability of multisystemic therapy: Evidence for multilevel influences, Mental Health Services Research, 5, 223, 10.1023/A:1026229102151 Schrag, 1999, First impressions matter: A model of confirmatory bias, The Quarterly Journal of Economics, 114, 37, 10.1162/003355399555945 Shadish, 2002 Shadish, W., & Myers, D. (2004). Campbell Collaboration Research Design Policy Brief. Retrieved June 12, 2006 from http://www.campbellcollaboration.org/MG/ResDesPolicyBrief.pdf Shea, 2002, Comparison of the quality of Cochrane reviews and systematic reviews published in paper-based journals, Evaluation & The Health Professions, 25 Smith, 1997, Delinquency and antisocial behavior: A review of family processes and intervention research, Social Service Review, 71, 382, 10.1086/604263 Substance Abuse and Mental Health Service Administration (2004). Multisystemic Therapy: Proven results. Accessed June 11, 2006 at: http://modelprograms.samhsa.gov/pdfs/FactSheets/Mst.pdf Sudderth, 2000, What works in treatment programs for substance-abusing youth, 337 Swenson, 2003, Multisystemic therapy (MST) for maltreated children and their families, 75 Swenson, 1998, Changing the social ecologies of adolescent sexual offenders: Implications of the success of multisystemic therapy in treating serious anti-social behavior in adolescents, Child Maltreatment, 3, 330, 10.1177/1077559598003004005 Tarolla, 2002, Understanding and treating juvenile offenders: A review of current knowledge and future directions, Aggression and Violent Behavior, 7, 125, 10.1016/S1359-1789(00)00041-0 U.S. Department of Health and Human Services, 1999 U.S. Department of Health and Human Services, 2001 U.S. National Institutes of Health (2004). State-of-the-science Conference Statement: Preventing violence and related health-risking social behaviors in adolescence. Retrieved 18 October 2004 from http://consensus.nih.gov/ta/023/youthviolenceDRAFTstatement101504.pdf Vaughn, 2004, Adolescent substance abuse treatment: A synthesis of controlled evaluations, Research on Social Work Practice, 14, 325, 10.1177/1049731504265834 Watson, 1960, On the failure to eliminate hypotheses in a conceptual task, Quarterly Journal of Experimental Psychology, 12, 129, 10.1080/17470216008416717 Watson, 1968, Reasoning about a rule, Quarterly Journal of Experimental Psychology, 20, 273, 10.1080/14640746808400161 Woolfenden, 2003, Family and parenting interventions in children and adolescents with conduct disorder and delinquency aged 10–17 (Cochrane Review) Wortman, 1994, Judging research quality, 97