Baby-MONITOR: A Composite Indicator of NICU Quality

American Academy of Pediatrics (AAP) - Tập 134 Số 1 - Trang 74-82 - 2014
Jochen Profit1,2, Marc Kowalkowski3, John A. F. Zupancic4,5, Kenneth Pietz6,7, Peter J. Richardson6,7, David Draper8,9, Sylvia J. Hysong4,5, Eric J. Thomas10, Laura A. Petersen4,5, Jeffrey B. Gould1,2
1California Perinatal Quality Care Collaborative; Palo Alto, California;
2California Perinatal Quality Care Collaborative; Palo Alto, California;; Perinatal Epidemiology and Health Outcomes Research Unit, Division of Neonatal and Developmental Medicine, Department of Pediatrics, Stanford University School of Medicine and Lucile Packard Children's Hospital; Palo Alto, California;
3Levine Cancer Institute, Carolinas HealthCare System, Charlotte, North Carolina
4Department of Neonatology, Beth Israel Deaconess Medical Center, Boston, Massachusetts;; Division of Newborn Medicine, Harvard Medical School, Boston, Massachusetts;
5Division of Newborn Medicine, Harvard Medical School, Boston, Massachusetts;
6Houston Veterans Affairs (VA) Health Services Research and Development Center of Excellence, Health Policy and Quality Program, Michael E. DeBakey VA Medical Center; Houston, Texas;
7Houston Veterans Affairs (VA) Health Services Research and Development Center of Excellence, Health Policy and Quality Program, Michael E. DeBakey VA Medical Center; Houston, Texas;; Section of Health Services Research, Department of Medicine, Baylor College of Medicine, Houston, Texas;
8Department of Applied Mathematics and Statistics, Baskin School of Engineering, University of California, Santa Cruz, California;; eBay Research Labs, San Jose, California;
9eBay Research Labs, San Jose, California;
10University of Texas at Houston – Memorial Hermann Center for Healthcare Quality and Safety, University of Texas Medical School, Houston, Texas

Tóm tắt

BACKGROUND AND OBJECTIVES: NICUs vary in the quality of care delivered to very low birth weight (VLBW) infants. NICU performance on 1 measure of quality only modestly predicts performance on others. Composite measurement of quality of care delivery may provide a more comprehensive assessment of quality. The objective of our study was to develop a robust composite indicator of quality of NICU care provided to VLBW infants that accurately discriminates performance among NICUs. METHODS: We developed a composite indicator, Baby-MONITOR, based on 9 measures of quality chosen by a panel of experts. Measures were standardized, equally weighted, and averaged. We used the California Perinatal Quality Care Collaborative database to perform across-sectional analysis of care given to VLBW infants between 2004 and 2010. Performance on the Baby-MONITOR is not an absolute marker of quality but indicates overall performance relative to that of the other NICUs. We used sensitivity analyses to assess the robustness of the composite indicator, by varying assumptions and methods. RESULTS: Our sample included 9023 VLBW infants in 22 California regional NICUs. We found significant variations within and between NICUs on measured components of the Baby-MONITOR. Risk-adjusted composite scores discriminated performance among this sample of NICUs. Sensitivity analysis that included different approaches to normalization, weighting, and aggregation of individual measures showed the Baby-MONITOR to be robust (r = 0.89–0.99). CONCLUSIONS: The Baby-MONITOR may be a useful tool to comprehensively assess the quality of care delivered by NICUs.

Từ khóa


Tài liệu tham khảo

Institute of Medicine., 2006, Rewarding Provider Performance: Aligning Incentives in Medicare

Nardo, 2005, Handbook on Constructing Composite Indicators: Methodology and User Guide

Profit, 2010, Improving benchmarking by using an explicit framework for the development of composite indicators: an example using pediatric quality of care., Implement Sci, 5, 13, 10.1186/1748-5908-5-13

Medicare. Hospital Compare. 2013 [cited March 31, 2013]. Available at: www.medicare.gov/hospitalcompare/

Bradley, 2006, Hospital quality for acute myocardial infarction: correlation among process measures and relationship with short-term mortality., JAMA, 296, 72, 10.1001/jama.296.1.72

Fonarow, 2007, Association between performance measures and clinical outcomes for patients hospitalized with heart failure., JAMA, 297, 61, 10.1001/jama.297.1.61

Jha, 2007, The inverse relationship between mortality rates and performance in the Hospital Quality Alliance measures., Health Aff (Millwood), 26, 1104, 10.1377/hlthaff.26.4.1104

Werner, 2006, Relationship between Medicare’s hospital compare performance measures and mortality rates., JAMA, 296, 2694, 10.1001/jama.296.22.2694

Meehan, 1997, Quality of care, process, and outcomes in elderly patients with pneumonia., JAMA, 278, 2080, 10.1001/jama.1997.03550230056037

Kanwar, 2007, Misdiagnosis of community-acquired pneumonia and inappropriate utilization of antibiotics: side effects of the 4-h antibiotic administration rule., Chest, 131, 1865, 10.1378/chest.07-0164

Houck, 2004, Timing of antibiotic administration and outcomes for Medicare patients hospitalized with community-acquired pneumonia., Arch Intern Med, 164, 637, 10.1001/archinte.164.6.637

Relman, 1988, Assessment and accountability: the third revolution in medical care., N Engl J Med, 319, 1220, 10.1056/NEJM198811033191810

Profit, 2011, Formal selection of measures for a composite index of NICU quality of care: Baby-MONITOR., J Perinatol, 31, 702, 10.1038/jp.2011.12

Profit, 2007, Implementing pay-for-performance in the neonatal intensive care unit., Pediatrics, 119, 975, 10.1542/peds.2006-1565

Kowalkowski, 2012, Do practicing clinicians agree with expert ratings of neonatal intensive care unit quality measures?, J Perinatol, 32, 247, 10.1038/jp.2011.199

Profit, 2013, Correlation of neonatal intensive care unit performance across multiple measures of quality of care., JAMA Pediatr, 167, 47, 10.1001/jamapediatrics.2013.418

Stark, 2004, Levels of neonatal care., Pediatrics, 114, 1341, 10.1542/peds.2004-1697

Patel, 2005, Accuracy of methods for calculating postnatal growth velocity for extremely low birth weight infants., Pediatrics, 116, 1466, 10.1542/peds.2004-1699

Escobar, 2008, Risk-adjusting hospital inpatient mortality using automated inpatient, outpatient, and laboratory databases., Med Care, 46, 232, 10.1097/MLR.0b013e3181589bb6

Draper, 2004, Statistical analysis of performance indicators in UK higher education., J R Stat Soc [Ser A], 167, 449, 10.1111/j.1467-985X.2004.apm12.x

Goldstein, 1996, League tables and their limitations: statistical issues in comparisons of institutional performance., J R Stat Soc [Ser A], 159, 385, 10.2307/2983325

Efron, 1994, Introduction to the Bootstrap, 10.1201/9780429246593

Aberson, 2010, Applied Power Analysis for the Behavioral Sciences

Landis, 1977, The measurement of observer agreement for categorical data., Biometrics, 33, 159, 10.2307/2529310

Kelley ET, Hurst J. Health Care Quality Indicator Project—conceptual framework. 2006; 23. Available at: www.oecd.org/dataoecd/1/36/36262363.pdf

Mattke, 2006, The OECD Health Care Quality Indicators Project: history and background., Int J Qual Health Care, 18, 1, 10.1093/intqhc/mzl019

Brand, 2007, Comparative analysis of alcohol control policies in 30 countries., PLoS Med, 4, e151, 10.1371/journal.pmed.0040151

Williams, 2006, Performance of top-ranked heart care hospitals on evidence-based process measures., Circulation, 114, 558, 10.1161/CIRCULATIONAHA.105.600973

Shahian, 2008, Comparison of “risk-adjusted” hospital outcomes., Circulation, 117, 1955, 10.1161/CIRCULATIONAHA.107.747873

Peterson, 2010, ACCF/AHA 2010 Position Statement on Composite Measures for Healthcare Performance Assessment: a report of the American College of Cardiology Foundation/American Heart Association Task Force on Performance Measures (Writing Committee to develop a position statement on composite measures)., Circulation, 121, 1780, 10.1161/CIR.0b013e3181d2ab98

Bobko, 2007, The usefulness of unit weights in creating composite scores: a literature review, application to content validity, and meta-analysis., Organ Res Methods, 10, 689, 10.1177/1094428106294734