Assessing geographical variations in hospital processes of care using multilevel item response models
Tóm tắt
With health care reform passing in the United States, much effort is directed toward developing and disseminating comparative information on standardized processes of care for health care providers. We propose the use of Bayesian multilevel item response theory models to estimate hospital quality from multiple process measures and to assess geographical variation in hospital quality. Our approach fully incorporates the nesting structure of measures, patients, hospitals, and various levels of geographical units to provide a summary of hospital quality. A national dataset of patients treated for a heart attack, heart failure, or pneumonia illustrates our methods. We find considerable geographical differences in hospital quality for these conditions with variations across census regions and states accounting for slightly more than 10% of the total variation. Some states performed well for all three conditions (e.g., the respective posterior probabilities of having better than the national average performance was close to 1 in Iowa, New Jersey, South Dakota, and Wisconsin). In contrast, quality of other states varied across conditions (e.g., the corresponding posterior probability was close to 1 in Massachusetts for heart attack and heart failure quality, but less than .5 for pneumonia care). Our framework provides a comprehensive approach to assessment of hospital performance at both regional and national levels, and might be informative for policy development.
Tài liệu tham khảo
Aguilar, O., West, M.: Analysis of hospital quality monitors using hierarchical time series models. In: Gatsonis, C., Kass, R.E., Carlin, B., Carriquiry, A., Gelman, A., Verdlinelli, I., West, M. (eds.) Case Studies in Bayesian Analysis, vol. IV, pp. 287–302. New York, Springer (1998)
Baker, F.B., Kim, S.H.: Item Response Theory: Parameter Estimation Techniques. Marcel Dekker, New York (2004)
Daniels, M.J., Gatsonis, C.: Hierarchical generalized linear models in the analysis of variations in health care utilization. J. Am. Stat. Assoc. 94, 29–42 (1999)
Donabedian, A.: Evaluating the quality of medical care. Milbank Mem. Fund Q. 44, 166–203 (1966)
Draper, D., Gittoes, M.: Statistical analysis of performance indicators in UK higher education. J. R. Stat. Soc. Series B Stat. Methodol. 167, 449–474 (2004)
Fox, J.P., Glas, C.A.W.: Bayesian estimation of a multilevel IRT model using Gibbs sampling. Psychometrika 66, 269–286 (2001)
Gelman, A., Rubin, D.B.: Inference from iterative simulation using multiple sequences (with discussion). Stat. Sci. 7, 457–511 (1992)
Gelman, A., Meng, X.L., Stern, H.S.: Posterior predictive assessment of model fitness via realized discrepancies (with discussion). Stat. Sin. 6, 733–807 (1996)
Goldstein, H, Speigelhalter, D.: League tables and their limitation: statistical issues in comparisons of institutional performance (with discussion). J. R. Stat. Soc. Series A Stat. Soc. 159, 385–443 (1996)
Institute of Medicine: Performance Measurement: Accelerating Improvement. The National Academies Press, Washington, DC (2006)
Jencks, S.F., Cuerdon, T., Burwen, D.R., et al.: Quality of medical care delivered to medicare beneficiaries: a profile of state and national levels. J. Am. Med. Assoc. 284, 1670–1676 (2000)
Johnson, V.E., Albert, J.H.: Ordinal Data Modeling. Springer, New York (1999)
Kaul, P., Peterson, E.D.: The cardiovascular world is definitely not flat. Circulation, 115, 158–160 (2007)
Krumholz, H.M., Radford, M.J., Wang, Y., et al.: National use and effectiveness of β-blockers for the treatment of elderly patients after acute myocardial infarction. J. Am. Med. Assoc. 280, 623–629 (1998)
Krumholz, H.M., Chen, J., Rathore, S.S., et al.: Regional variation in the treatment and outcomes of myocardial infarction: investigating New England’s advantage. Am. Heart J. 146, 242–249 (2003)
Laird, N.M., Ware, J.H.: Random-effects models for longitudinal data. Biometrics 38, 963–974 (1982)
Landrum, M.B., Bronskill, S.E., Normand, S.L.T.: Analytic methods for constructing cross-sectional profiles of health care providers. Health Serv. Outcomes Res. Methodol. 1, 23–47 (2000)
Lee, K.J., Thompson, S.G.: Flexible parametric models for random-effects distributions. Stat. Med. 27, 418–434 (2008)
Nolan, T, Berwick, D.M.: All-or-none measurement raises the bar on performance. J. Am. Med. Assoc. 295, 1168–1170 (2006)
Normand, S.L.T., Shahian, D.M.: Statistical and clinical aspects of hospital outcomes profiling. Stat. Sci. 22, 206–226 (2007)
Normand, S.L.T., Glickman, M., Gatsonis, C.A.: Statistical methods for profiling providers of medical care: issues and applications. J. Am. Med. Assoc. 92, 803–814 (1997)
Normand, S.L.T., Wolf, R.E., McNeil, B.J.: Discriminating quality of hospital care in the US. Med. Decis. Mak. 38, 308–322 (2008)
O’Brien, S.M., Shahian, D.M., DeLong, E.R., Normand, S.L.T., Edwardsm, F.H., Ferraris, V.A., Haan, C.K., Rich, J.B., Shewan, C.M., Dokholyan, R.S., Anderson, R.P., Peterson, E.D.: Quality measurement in adult cardiac surgery: part 2- statistical considerations in composite measure scoring and provider rating. Ann. Soc. Thorac. Surg. 83, S13–S26 (2007)
O’Connor, G.T., Quinton, H.B., Traven, N.D., et al.: Geographical variation in the treatment of acute myocardial infarction: The Cooperative Cardiovascular Project. J. Am. Med. Assoc. 281, 627–633 (1999)
Premier, Inc.:“Centers for medicare and medicaid services (cms)/premier hospital quality incentive demonstration project: findings from year 2” accessed from http://www.premierinc.com/quality-safety/tools-services/p4p/hqi/resources/hqi-whitepaper-year2.pdf (2007)
Raudenbush, S.W., Bryk, A.S.: Hierarchical Linear Models: Applications and Data Analysis Methods. Sage Publications Inc., Newbury Park, CA (2002)
Shwartz, M., Ren, J., Pekoz, E.A., Wang, X., Cohen, A.B., Resuccia J.D.: Estimating a composite measure of hospital quality from the hospital compare database differences when using a Bayesian hierarchical latent variable model versus denominator-based weights. Med. Care 46, 778–785 (2008)
Skrondal, A., Rabe-Hesketh, S.: Generalized Latent Variable Modeling. Chapman & Hall/CRC, Boca Raton, FL (2004)
Snijders, T.A.B., Bosker, R.J.: Multilevel Analysis: An Introduction to Basic and Advanced Multilevel Modeling. Sage Publications Inc., Newbury Park, CA (1999)
Spiegelhalter, D.J., Best, N.G., Carlin, B.P., van der Linde, A.: Bayesian measures of model complexity and fit. J. R. Stat. Soc. Series B Stat. Methodol. 64, 583–639 (2002)
Spiegelhalter, D.J., Thomas, A., Best, N., Lunn, D.: WinBUGS Users Manual, Verson 14. Medical Research Council Biostatistics Unit, Cambridge (2003)
Spiegelhalter, D.J., Abrams, K.R., Myles, J.P.: Bayesian Approaches to Clinical Trials and Health Care Evaluations. Wiley, Chichester (2004)
Teixeira-Pinto, A., Normand, SLT.: Statistical methodology for classifying units on the basis of multiple-related measures. Stat. Med. 27:1329–1350 (2008)
van der Linden, W.J., Hambleton, R.K.: Handbook of Modern Item Response Theory. Springer, New York (1997)
Williams, S.C., Schmaltz, S.P., Morton, D.J., Koss, R.G., Loeb, J.M.: Quality of care in U.S. hospitals as reflected by standardized measures, 2002–2004. N. Engl. J. Med. 353, 255–264 (2005)