Evaluating an employee wellness program
Tóm tắt
What criteria should be used to evaluate the impact of a new employee wellness program when the initial vendor contract expires? Published academic literature focuses on return-on-investment as the gold standard for wellness program evaluation, and a recent meta-analysis concludes that wellness programs can generate net savings after one or two years. In contrast, surveys indicate that fewer than half of these programs report net savings, and actuarial analysts argue that return-on-investment is an unrealistic metric for evaluating new programs. These analysts argue that evaluation of new programs should focus on contract management issues, such as the vendor’s ability to: (i) recruit employees to participate and (ii) induce behavior change. We compute difference-in-difference propensity score matching estimates of the impact of a wellness program implemented by a mid-sized employer. The analysis includes one year of pre-implementation data and three years of post-implementation data. We find that the program successfully recruited a broad spectrum of employees to participate, and it successfully induced short-term behavior change, as manifested by increased preventive screening. However, the effects on health care expenditures are positive (but insignificant). If it is unrealistic to expect new programs to significantly reduce healthcare costs in a few years, then focusing on return-on-investment as the gold standard metric may lead to early termination of potentially useful wellness programs. Focusing short-term analysis of new programs on short-term measures may provide a more realistic evaluation strategy.
Tài liệu tham khảo
Aon/Hewitt. (2011). 2011 Health Care Survey. http://img.en25.com/Web/AON/Aon%20Hewitt%20Health%20Care_Survey_2011_Final%5B1%5D.pdf. Accessed 14 May 2013.
Baicker, K., Cutler, D., & Song, Z. (2010). Workplace WPs can generate savings. Health Affairs, 29(2), 1–8.
Becker, S. O., & Ichino, A. (2002). Estimation of average treatment effects based on propensity scores. The Stata Journal, 2, 358–377.
Buck Surveys. (2010). Working well: A global survey of health promotion and workplace wellness strategies. https://www.bucksurveys.com/bucksurveys/product/tabid/139/p-51-working-well-a-global-survey-of-health-promotion-and-workplace-wellness-strategies.aspx. Accessed 14 May 2013.
Crump, R., Hotz, V. J., Imbens, G., & Mitnik, O. (2008). Dealing with limited overlap in estimation of average treatment effects. Biometrika, 96(1), 187–199.
Disease Management Association of American and National Manufacturers’ Association. (2007). Wellness, disease and care management: Background for developing a business strategy. An employer toolkit (pp. 72).
Edington, D. (2009). Zero trends: Health as a serious economic strategy. Ann Arbor, MI: University of Michigan Press.
Eichner, M. J., McClellan, M. B., & Wise, D. A. (1997). Health expenditure persistence and the feasibility of medical savings accounts. In J. M. Poterba (Ed.), Tax policy and the economy (Vol. 11, pp. 91–128). Cambridge, MA: MIT Press.
Fitch, K. (2008). Wellness lessons learned from the private sector. Insight: Expert thinking from Milliman. www.Milliman.com.
Fitch, K., & Pyenson, B. (2008). Taking stock of wellness. Benefits Quarterly, 24(2), 34–40.
Goetzel, R., Pei, X., Tabrizi, M., Henke, R., Kowlessar, N., Nelson, C., et al. (2012). Ten modifiable health risk factors are linked to more than one-fifth of employer-employee health care spending. Health Affairs, 31(11), 2474–2484.
Gross, P. (2012). Editoral: Process versus outcome measures—the end of the debate. Medical Care, 50, 200–202.
Imbens, G., & Rubin, D. (2007). Causal inference: Statistical methods for estimating causal effects in biomedical, social, and behavioral sciences. Cambridge: Cambridge University Press.
Imbens, G., Rubin, D., & Sacerdote, B. (2001). Estimating the effect of unearned income on labor supply, earnings, savings and consumption: Evidence from a survey of lottery players. American Economic Review, 91, 778–794.
Imbens, G. W., & Wooldridge, J. M. (2010). Recent developments in the econometrics of program development. Journal of Economic Literature, 47(1), 5–86.
Leuven, E., & Sianesi, B. (2003). PSMATCH2: Stata module to perform full Mahalanobis and propensity score matching, common support graphing, and covariate imbalance testing (version 3.0.0). Boston, MA: Department of Economics, Boston University. Retrieved from http://ideas.repec.org/c/boc/bocode/s432001.html. Accessed 14 May 2013.
Loeppke, R., Edington, D., & Beg, S. (2010). Impact of a prevention plan on employee health risk reduction. Population Health Management, 13(5), 275–284.
Loeppke, R., Nicholson, S., Taitel, M., Sweeney, M., Haufle, V., & Kessler, R. (2008). The impact of an integrated population health enhancement and disease management program on employee health risk, health conditions, and productivity. Population Health Management, 11(6), 287–296.
Nicholson, S., Pauly, M., Polsky, D., Baase, C., Billotti, B., Ozminkowski, R., et al. (2005). How to present the business case for healthcare quality to employers. Working paper. http://knowledge.wharton.upenn.edu/papers/1303.pdf. Accessed 14 May 2013.
O’Donnell, M. (2010). Federal grants to small employers for comprehensive wellness programs: Passed as part of health care reform. Editor’s Notes. American Journal of Health Promotion, 25(1), iv–v.
Pfaffenberger, J. H., & Patterson, R. C. (1987). Statistical methods for business and economics. Homewood, IL: Irwin.
Pyenson, B., & Zenner, P. (2005). Cancer screening: payer cost/benefit through employee benefits programs. Commissioned by C-Change and the American Cancer Society. Milliman Consultants and Actuaries.
Rubin, D. (2006). Matched sampling for causal effects. Cambridge: Cambridge University Press.
Sekhon, J. S. (2009). Opiates for the matches: Matching methods for causal inference. Annual Review of Political Science, 12(1), 487–508.
Serxner, S., Gold, D., Meraz, A., & Gray, A. (2009). Do employee health management programs work? American Journal of Health Promotion, 23(4), 1–8.
Serxner, S., Noeldner, S. P., & Gold, D. (2006). Best practices for an integrated population health management (PHM) program. American Journal of Health Promotion, 20(Suppl. 5), 1–10.
Sing, M. (2004). Using encounter data from Medicaid HMOs for research and monitoring. Inquiry, 41(3), 336–346.
Smith, J., & Todd, P. (2005). Does matching overcome LaLonde’s critique of non-experimental estimators? Journal of Econometrics, 125, 305–353.
USPSTF. (2013). United States Preventive Task Force A and B recommendations. Retrieved April 13, 2013 from http://www.uspreventiveservicestaskforce.org/uspstf/uspsabrecs.htm.
Weltz, S. (2009). Is your wellness program cost effective? Benefits Perspectives. Fall, 1–3. http://publications.milliman.com/periodicals/bp/pdfs/BP11-24-09.pdf.