The creation of evidence in ‘evidence‐based’ drug prevention: a critique of the Strengthening Families Program Plus Life Skills Training evaluation

Drug and Alcohol Review - Tập 26 Số 6 - Trang 585-593 - 2007
Dennis M. Gorman1,2, Eugenia Conde2,3, J. Charles Huber2,4
1D. M. Gorman, Department of Epidemiology and Biostatistics, Texas A&M Health Science Center School of Rural Public Health, College Station, TX 77845, USA
2Department of Epidemiology and Biostatistics, Texas A&M Health Science Center School of Rural Public Health, College Station, TX, USA
3E. Conde, Department of Epidemiology and Biostatistics, Texas A&M Health Science Center School of Rural Public Health, College Station, TX 77845, USA
4J. C. Huber Jr, Department of Epidemiology and Biostatistics, Texas A&M Health Science Center School of Rural Public Health, College Station, TX 77845, USA.

Tóm tắt

AbstractSchool‐based curricula have become a mainstay of drug prevention policy in the United States and are increasing in popularity in other parts of the world. The promotion and dissemination of these interventions has been driven in large part by the creation of lists of programmes which, it is claimed, are grounded in scientific evidence demonstrating their effectiveness. Recently concerns have been raised about the data analysis and presentation practices used in evaluations of a number of programmes that appear on these lists. Here we examine a series of papers from an evaluation of an intervention that combined the Strengthening Families Program 10–14 and Life Skills Training Program, each of which is among the most widely advocated universal drug prevention programmes. The data analysis and presentation practices employed in the evaluation of this combined programme include one‐tailed significance testing, alpha levels of 0.10, changes in outcome variables across publications and use of the post‐test data as the baseline when assessing change over time. Taken together, these practices severely limit the claims that can be made about the results presented in the evaluation. Specifically, we believe that far from supporting the evaluators' claims concerning the rigour of the findings and their generalisability and public health significance, the results are very fragile, of little practical significance and quite possibly analysis‐dependent.

Từ khóa


Tài liệu tham khảo

10.1177/0002716203251218

Substance Abuse and Mental Health Services Administration (SAMHSA).National registry of evidence‐based programs and practices. Available athttp:nrepp.samhsa.gov(accessed 5 April 2007).

US Department of Education Safe, Disciplined, and Drug‐Free Schools Expert Panel, 2001, Exemplary and promising Safe, Disciplined, and Drug‐free Schools Programs 2001

Mihalic S., 2001, Blueprints for violence prevention (OJJDP Juvenile Justice Bulletin)

Schinke S., 2002, Science‐based prevention programs and principles

National Institute on Drug Abuse, 2003, Preventing drug use among children and adolescents: a research‐based guide for parents, educators, and community leaders

10.1016/S0149-7189(02)00023-X

10.1016/j.ypmed.2004.07.005

10.1177/0193841X06287188

10.1007/s11121-006-0058-x

10.1007/s11292-004-6461-z

Gerstein DR, 1993, Preventing drug abuse: what do we know

10.2190/365C-6F4J-7CX7-7JYH

10.1016/S0197-2456(00)00050-7

Campbell DT., 1988, Methodology and epistemology for social science: selected papers—Donald T. Campbell, 9

10.4135/9781483327679.n11

10.1023/B:JOPP.0000042391.58573.5b

10.1093/her/cyl061

10.1046/j.1360-0443.2003.00355.x

Australian Institute of Family Studies, 2006, Parenting Influences on Adolescent Alcohol Use

European Monitoring Centre for Drugs and Drug Addiction (EMCDDA), 2006, Annual report 2006: The state of the drug problem in Europe

Strengthening Families Program, 2006, The SFP 10–14 in the UK

10.1037/0893-164X.16.2.129

10.1037/0893-164X.19.4.372

10.1001/archpedi.160.9.876

Substance Abuse and Mental Health Services Administration (SAMHSA), SAMHSA model programs: Strengthening Families Program for Parents and Youth 10–14

Substance Abuse and Mental Health Services Administration (SAMHSA), SAMHSA model programs: LifeSkills Training

Molgaard VK, 2000, Competency training: the Strengthening Families Program: For Parents and Youth 10–14 (OJJDP Juvenile Justice Bulletin 182208)

10.1007/s11292-004-6462-y

Blalock HM, 1979, Social statistics

10.1007/978-1-4757-3292-4

10.1016/0306-4603(90)90006-J

10.1136/bmj.319.7211.670

10.1016/S0197-2456(00)00046-5

10.1093/epirev/24.1.4

Gail MH., 1985, Eligibility exclusions, losses to follow‐up, removal of randomized patients, and uncontrolled events in cancer clinical trials, Cancer Treat Rep, 69, 107