A comparison of a Bayesian vs. a frequentist method for profiling hospital performance
Tóm tắt
The objective of this study was to compare the classification of hospitals as outcomes outliers using a commonly implemented frequentist statistical approach vs. an implementation of Bayesian hierarchical statistical models, using 30‐day hospital‐level mortality rates for a cohort of acute myocardial infarction patients as a test case. For the frequentist approach, a logistic regression model was constructed to predict mortality. For each hospital, a risk‐adjusted mortality rate was computed. Those hospitals whose 95% confidence interval, around the risk‐adjusted mortality rate, excludes the mean mortality rate were classified as outliers. With the Bayesian hierarchical models, three factors could vary: the profile of the typical patient (low, medium or high risk), the extent to which the mortality rate for the typical patient departed from average, and the probability that the mortality rate was indeed different by the specified amount. The agreement between the two methods was compared for different patient profiles, threshold differences from the average and probabilities. Only marginal agreement was shown between the Bayesian and frequentist approaches. In only five of the 27 comparisons was the kappa statistic at least 0.40. The remaining 22 comparisons demonstrated only marginal agreement between the two methods. Within the Bayesian framework, hospital classification clearly depended on patient profile, threshold and probability of exceeding the threshold. These inconsistencies raise questions about the validity of current methods for classifying hospital performance, and suggest a need for urgent research into which methods are most meaningful to clinicians, managers and the general public.
Từ khóa
Tài liệu tham khảo
Casella G., 1990, Statistical Inference.
Fleiss J.L., 1981, Statistical Methods for Rates and Proportions
Iezzoni L.I., 1994, Risk Adjustment for Measuring Health Care Outcomes.
Lee P.M., 1997, Bayesian Statistics: an introduction
Luft H.S., 1993, Annual Report of the California Hospital Outcomes Project.
New York State Department of Health, 1992, Coronary Artery Bypass Graft Surgery in New York State 1989–91.
Pennsylvania Health Care Cost Containment Council, 1996, Focus on Heart Attack in Pennsylvania. Research methods and results.
SAS Institute Inc., 1997, SAS/STAT Software: changes and enhancements through release 6.12.
Scottish Office, 1995, Clinical Outcome Indicators, 1994.
Tu J.V., 1999, Cardiovascular Health Services in Ontario: an ICES atlas, 83
Tu J.V., 1999, Temporal changes in the outcomes of acute myocardial infarction in Ontario, 1992–96., Canadian Medical Association Journal, 161, 1257
Wong G., 1985, The hierarchical logistic regression model for multilevel analysis., Journal of the American Statistical Association, 80, 513, 10.1080/01621459.1985.10478148
ZinmanD.(1991)State takes docs' list to heart.NewsdayDecember 18 p.7. New York NY.