An in-depth assessment of a diagnosis-based risk adjustment model based on national health insurance claims: the application of the Johns Hopkins Adjusted Clinical Group case-mix system in Taiwan
Tóm tắt
Diagnosis-based risk adjustment is becoming an important issue globally as a result of its implications for payment, high-risk predictive modelling and provider performance assessment. The Taiwanese National Health Insurance (NHI) programme provides universal coverage and maintains a single national computerized claims database, which enables the application of diagnosis-based risk adjustment. However, research regarding risk adjustment is limited. This study aims to examine the performance of the Adjusted Clinical Group (ACG) case-mix system using claims-based diagnosis information from the Taiwanese NHI programme. A random sample of NHI enrollees was selected. Those continuously enrolled in 2002 were included for concurrent analyses (n = 173,234), while those in both 2002 and 2003 were included for prospective analyses (n = 164,562). Health status measures derived from 2002 diagnoses were used to explain the 2002 and 2003 health expenditure. A multivariate linear regression model was adopted after comparing the performance of seven different statistical models. Split-validation was performed in order to avoid overfitting. The performance measures were adjusted R2 and mean absolute prediction error of five types of expenditure at individual level, and predictive ratio of total expenditure at group level. The more comprehensive models performed better when used for explaining resource utilization. Adjusted R2 of total expenditure in concurrent/prospective analyses were 4.2%/4.4% in the demographic model, 15%/10% in the ACGs or ADGs (Aggregated Diagnosis Group) model, and 40%/22% in the models containing EDCs (Expanded Diagnosis Cluster). When predicting expenditure for groups based on expenditure quintiles, all models underpredicted the highest expenditure group and overpredicted the four other groups. For groups based on morbidity burden, the ACGs model had the best performance overall. Given the widespread availability of claims data and the superior explanatory power of claims-based risk adjustment models over demographics-only models, Taiwan's government should consider using claims-based models for policy-relevant applications. The performance of the ACG case-mix system in Taiwan was comparable to that found in other countries. This suggested that the ACG system could be applied to Taiwan's NHI even though it was originally developed in the USA. Many of the findings in this paper are likely to be relevant to other diagnosis-based risk adjustment methodologies.
Tài liệu tham khảo
Liu CF, Sales AE, Sharp ND, Fishman P, Sloan KL, Todd-Stenberg J, Nichol WP, Rosen AK, Loveland S: Case-mix adjusting performance measures in a veteran population: pharmacy- and diagnosis-based approaches. Health Serv Res. 2003, 38 (5): 1319-1337. 10.1111/1475-6773.00179.
Thomas JW, Grazier KL, Ward K: Comparing accuracy of risk-adjustment methodologies used in economic profiling of physicians. Inquiry. 2004, 41 (5): 218-231.
Huang IC, Dominici F, Frangakis C, Diette GB, Damberg CL, Wu AW: Is risk-adjustor selection more important than statistical approach for provider profiling? Asthma as an example. Med Decis Making. 2005, 25 (5): 20-34. 10.1177/0272989X04273138.
Ash AS, Zhao Y, Ellis RP, Schlein Kramer M: Finding future high-cost cases: comparing prior cost versus diagnosis-based methods. Health Serv Res. 2001, 36 (6 Pt 2): 194-206.
Radcliff TA, Cote MJ, Duncan RP: The identification of high-cost patients. Hosp Top. 2005, 83 (5): 17-24. 10.3200/HTPS.83.3.17-24.
Meenan RT, Goodman MJ, Fishman PA, Hornbrook MC, O'Keeffe-Rosetti MC, Bachman DJ: Using risk-adjustment models to identify high-cost risks. Med Care. 2003, 41 (5): 1301-1312. 10.1097/01.MLR.0000094480.13057.75.
FitzHenry F, Shultz EK: Health-risk-assessment tools used to predict costs in defined populations. J Healthc Inf Manag. 2000, 14 (5): 31-57.
A Comparative Analysis of Claims-Based Tools for Health Risk Assessment. [http://www.soa.org/files/pdf/risk-assessmentc.pdf]
Zhao Y, Ash AS, Ellis RP, Ayanian JZ, Pope GC, Bowen B, Weyuker L: Predicting pharmacy costs and other medical costs using diagnoses and drug claims. Med Care. 2005, 43 (5): 34-43.
Fowles JB, Weiner JP, Knutson D, Fowler E, Tucker AM, Ireland M: Taking health status into account when setting capitation rates: a comparison of risk-adjustment methods. JAMA. 1996, 276 (5): 1316-1321. 10.1001/jama.276.16.1316.
Pietz K, Ashton CM, McDonell M, Wray NP: Predicting healthcare costs in a population of veterans affairs beneficiaries using diagnosis-based risk adjustment and self-reported health status. Med Care. 2004, 42 (5): 1027-1035. 10.1097/00005650-200410000-00012.
Parkerson GR, Harrell FE Jr, Hammond WE, Wang XQ: Characteristics of adult primary care patients as predictors of future health services charges. Med Care. 2001, 39 (5): 1170-1181. 10.1097/00005650-200111000-00004.
Newhouse JP, Manning WG, Keeler EB, Sloss EM: Adjusting capitation rates using objective health measures and prior utilization. Health Care Financ Rev. 1989, 10 (5): 41-54.
Sernyak MJ, Rosenheck R: Risk adjustment in studies using administrative data. Schizophr Bull. 2003, 29 (5): 267-271.
van Vliet RC, Ven van de WP: Towards a capitation formula for competing health insurers. An empirical analysis. Soc Sci Med. 1992, 34 (5): 1035-1048. 10.1016/0277-9536(92)90134-C.
Shen Y, Ellis RP: How profitable is risk selection? A comparison of four risk adjustment models. Health Econ. 2002, 11 (5): 165-174. 10.1002/hec.661.
Dudley RA, Medlin CA, Hammann LB, Cisternas MG, Brand R, Rennie DJ, Luft HS: The best of both worlds? Potential of hybrid prospective/concurrent risk adjustment. Med Care. 2003, 41 (5): 56-69. 10.1097/00005650-200301000-00009.
Ash AS, Ellis RP, Pope GC, Ayanian JZ, Bates DW, Burstin H, Iezzoni LI, MacKay E, Yu W: Using diagnoses to describe populations and predict costs. Health Care Financ Rev. 2000, 21 (5): 7-28.
Sales AE, Liu CF, Sloan KL, Malkin J, Fishman PA, Rosen AK, Loveland S, Paul Nichol W, Suzuki NT, Perrin E, et al: Predicting costs of care using a pharmacy-based measure risk adjustment in a veteran population. Med Care. 2003, 41 (5): 753-760. 10.1097/00005650-200306000-00008.
Lamers LM, van Vliet RC: Multiyear diagnostic information from prior hospitalization as a risk-adjuster for capitation payments. Med Care. 1996, 34 (5): 549-561. 10.1097/00005650-199606000-00005.
Kuhlthau K, Ferris TG, Davis RB, Perrin JM, Iezzoni LI: Pharmacy-and diagnosis-based risk adjustment for children with Medicaid. Med Care. 2005, 43 (5): 1155-1159. 10.1097/01.mlr.0000182551.87591.73.
A comparative analysis of claims-based methods of health risk assessment for commercial populations. [http://www.soa.org/files/pdf/_asset_id=2583046.pdf]
Starfield B, Weiner J, Mumford L, Steinwachs D: Ambulatory care groups: a categorization of diagnoses for research and management. Health Serv Res. 1991, 26 (5): 53-74.
Weiner JP, Starfield BH, Steinwachs DM, Mumford LM: Development and application of a population-oriented measure of ambulatory care case-mix. Med Care. 1991, 29 (5): 452-472. 10.1097/00005650-199105000-00006.
Ash A, Porell F, Gruenberg L, Sawitz E, Beiser A: Adjusting Medicare capitation payments using prior hospitalization data. Health Care Financ Rev. 1989, 10 (5): 17-29.
Ellis RP, Ash A: Refinements to the Diagnostic Cost Group (DCG) model. Inquiry. 1995, 32 (5): 418-429.
Pope GC, Ellis RP, Ash AS, Liu CF, Ayanian JZ, Bates DW, Burstin H, Iezzoni LI, Ingber MJ: Principal inpatient diagnostic cost group model for Medicare risk adjustment. Health Care Financ Rev. 2000, 21 (5): 93-118.
Fishman PA, Goodman MJ, Hornbrook MC, Meenan RT, Bachman DJ, O'Keeffe Rosetti MC: Risk adjustment using automated ambulatory pharmacy data: the RxRisk model. Med Care. 2003, 41 (5): 84-99. 10.1097/00005650-200301000-00011.
Sloan KL, Sales AE, Liu CF, Fishman P, Nichol P, Suzuki NT, Sharp ND: Construction and characteristics of the RxRisk-V: a VA-adapted pharmacy-based case-mix instrument. Med Care. 2003, 41 (5): 761-774. 10.1097/00005650-200306000-00009.
The Johns Hopkins ACG Case-Mix System Reference Manual Version 7.0. 2005, Baltimore: Johns Hopkins Bloomberg School of Public Health
Reid RJ, Roos NP, MacWilliam L, Frohlich N, Black C: Assessing population health care need using a claims-based ACG morbidity measure: a validation analysis in the Province of Manitoba. Health Serv Res. 2002, 37 (5): 1345-1364. 10.1111/1475-6773.01029.
Carlsson L, Borjesson U, Edgren L: Patient based 'burden-of-illness' in Swedish primary health care. Applying the Johns Hopkins ACG case-mix system in a retrospective study of electronic patient records. Int J Health Plann Manage. 2002, 17 (5): 269-282. 10.1002/hpm.674.
NHI's Second Generation Planning Committee: Towards A National Health Insurance System Where Rights and Duties Are Met: The Final Report by NHI's Second Generation Planning Committee. 2004, In NHI's Second Generation Planning Committee, Executive Yuan. Taiwan: ROC
Hsieh M: Refining Diagnosis-Based Risk Adjustment Models with Prescription Information. Taipei. 2005, National Taiwan University
Hung S: Using ACG Case-Mix System to Evaluate the Ambulatory Utilization of Liver Disease in Taiwan. Taipei. 2006, National Yang-Ming University
Cousins MS, Shickle LM, Bander JA: An introduction to predictive modeling for disease management risk stratification. Dis Manag. 2002, 5 (5): 157-167. 10.1089/109350702760301448.
Hu G, Root M: Accuracy of prediction models in the context of disease management. Dis Manag. 2005, 8 (5): 42-47. 10.1089/dis.2005.8.42.
Blough DK, Madden CW, Hornbrook MC: Modeling risk using generalized linear models. J Health Econ. 1999, 18 (5): 153-171. 10.1016/S0167-6296(98)00032-0.
Manning WG, Mullahy J: Estimating log models: to transform or not to transform?. J Health Econ. 2001, 20 (5): 461-494. 10.1016/S0167-6296(01)00086-8.
Buntin MB, Zaslavsky AM: Too much ado about two-part models and transformation? Comparing methods of modeling Medicare expenditures. J Health Econ. 2004, 23 (5): 525-542. 10.1016/j.jhealeco.2003.10.005.
Iezzoni LI: Risk adjustment for measuring healthcare outcomes. 1997, Chicago: Health Administration Press, 2
Greenwald LM: Medicare risk-adjusted capitation payments: from research to implementation. Health Care Financ Rev. 2000, 21 (5): 1-5.
Department of Health: Health Statistics in Taiwan, 2006: Part III. Current Situation of Medical Facilities, Medical Personnel, and Medical Services. 2007, Taipei: Department of Health, ROC
Bureau of National Health Insurance: National Health Insurance Annual Statistical Report: 2006. 2007, Taipei: Bureau of National Health Insurance, Department of Health, ROC
Chang RE, Lin W, Hsieh CJ, Chiang TL: Healthcare utilization patterns and risk adjustment under Taiwan's National Health Insurance system. J Formos Med Assoc. 2002, 101 (5): 52-59.
Chang RE, Lai CL: Use of diagnosis-based risk adjustment models to predict individual health care expenditure under the National Health Insurance system in Taiwan. J Formos Med Assoc. 2005, 104 (5): 883-890.
Chang S: Development of Risk-Adjusted Diagnostic Groups Based on All Diagnostic Information and Applications to Risk Adjustment Models. 2006, Taipei: National Taiwan University
Tsai WD, Lo JC: Capitation payment system: risk factors estimation. Acad Econ Pap. 2000, 28 (3): 31-261.
Lee WC, Huang TP: Explanatory ability of the ACG system regarding the utilization and expenditure of the national health insurance population in Taiwan--a 5-year analysis. J Chin Med Assoc. 2008, 71 (5): 191-199. 10.1016/S1726-4901(08)70103-5.
Lee WC: Quantifying morbidities by Adjusted Clinical Group system for a Taiwan population: a nationwide analysis. BMC Health Serv Res. 2008, 8: 153-10.1186/1472-6963-8-153.
Liu F: Ambulatory Risk-Adjusted Model Based on Prescription of Chronic Disease. 2004, Taipei: National Taiwan University
Lin C: Comparing the Ability of Different Diagnosis-Based Risk Adjusters to Predict Individuals' Ambulatory Expenditures under the National Health Insurance. 2006, Taipei: National Taiwan University
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1741-7015/8/7/prepub