Describing the emotional exhaustion, depersonalization, and low personal accomplishment symptoms associated with Maslach Burnout Inventory subscale scores in US physicians: an item response theory analysis
Tóm tắt
Current US health policy discussions regarding physician burnout have largely been informed by studies employing the Maslach Burnout Inventory (MBI); yet, there is little in the literature focused on interpreting MBI scores. We described the burnout symptoms and precision associated with MBI scores in US physicians. Using item response theory (IRT) analyses of secondary, cross-sectional survey data, we created response profiles describing the probability of burnout symptoms associated with US physicians’ MBI emotional exhaustion (EE), depersonalization (DP), and personal accomplishment (PA) subscale scores. Response profiles were mapped to raw subscale scores and used to predict symptom endorsements at mean scores and commonly used cut-points. The average US physician was likely to endorse feeling he/she is emotionally drained, used up, frustrated, and working too hard and all PA indicators once weekly or more but was unlikely to endorse feeling any DP symptoms once weekly or more. At the commonly used EE and DP cut-points of 27 and 10, respectively, a physician was unlikely to endorse feeling burned out or any DP symptoms once weekly or more. Each subscale assessed the majority of sample score ranges with ≥ 0.70 reliability. We produced a crosswalk mapping raw MBI subscale scores to scaled scores and response profiles calibrated in a US physician sample. Our results can be used to better understand the meaning and precision of MBI scores in US physicians; compare individual/group MBI scores against a reference population of US physicians; and inform the selection of subscale cut-points for defining categorical physician burnout outcomes.
Tài liệu tham khảo
Maslach, C., & Jackson, S. E. (1981). The measurement of experienced burnout. Journal of Occupational Behaviour, 2(2), 99–113.
Maslach, C., Leiter, M. P., & Jackson, S. E. (2017). Maslach Burnout Inventory Manual (4th ed.). Menlo Park: Mind Garden, Inc.
Dzau, V. J., Kirch, D. G., & Nasca, T. J. (2018). To care is human — Collectively confronting the clinician-burnout crisis. The New England Journal of Medicine, 378(4), 312–314. https://doi.org/10.1056/NEJMp1715127.
Shanafelt, T. D., Hasan, O., Dyrbye, L. N., Sinsky, C., Satele, D., Sloan, J., & West, C. P. (2015). Changes in burnout and satisfaction with work-life balance in physicians and the general US working population between 2011 and 2014. Mayo Clinic Proceedings, 90(12), 1600–1613. https://doi.org/10.1016/j.mayocp.2015.08.023.
Shanafelt, T. D., West, C. P., Sinsky, C., Trockel, M., Tutty, M., Satele, D. V., Carlasare, L. E., & Dyrbye, L. N. (2019). Changes in burnout and satisfaction with work-life integration in physicians and the general US working population between 2011 and 2017. Mayo Clinic Proceedings, 94(9), 1681–1694.
Jha, A. K., Ilif, A. R., & Chaoui, A. A. (2019). A crisis in health care: A call to action on physician burnout. http://www.massmed.org/News-and-Publications/MMS-News-Releases/Physician-Burnout-Report-2018/
National Academies of Sciences, Engineering, and Medicine. (2018). Graduate medical education outcomes and metrics: Proceedings of a workshop. Washington, DC: The National Academies Press.
Rotenstein, L. S., Torre, M., Ramos, M. A., Rosales, R. C., Guille, C., Sen, S., & Mata, D. A. (2018). Prevalence of burnout among physicians: A systematic review. Journal of the American Medical Association, 320(11), 1131–1150. https://doi.org/10.1001/jama.2018.12777.
Brady, K. J. S., Kazis, L. E., Sheldrick, R. C., Ni, P., & Trockel, M. T. (2019). Selecting physician well-being measures to assess health system performance and screen for distress: Conceptual and methodological considerations. Current Problems in Pediatric and Adolescent Health Care, 49(12), 100662. https://doi.org/10.1016/j.cppeds.2019.100662.
Reise, S. P., & Haviland, M. G. (2005). Item response theory and the measurement of clinical change. Journal of Personality Assessment, 84(3), 228–238. https://doi.org/10.1207/s15327752jpa8403_02.
Cook, K. F., Victorson, D. E., Cella, D., Schalet, B. D., & Miller, D. (2015). Creating meaningful cut-scores for Neuro-QOL measures of fatigue, physical functioning, and sleep disturbance using standard setting with patients and providers. Quality of Life Research, 24(3), 575–589. https://doi.org/10.1007/s11136-014-0790-9.
HealthMeasures (2013). PROMIS instrument development and scientific standards version 2.0. http://www.healthmeasures.net/images/PROMIS/PROMISStandards_Vers2.0_Final.pdf
Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika monograph supplement.
De Ayala, R. J. (2013). The theory and practice of item response theory. New York: Guilford publications.
West, C. P., Dyrbye, L. N., Satele, D. V., Sloan, J. A., & Shanafelt, T. D. (2012). Concurrent validity of single-item measures of emotional exhaustion and depersonalization in burnout assessment. Journal of General Internal Medicine, 27(11), 1445–1452. https://doi.org/10.1007/s11606-012-2015-7.
Shanafelt, T. D., Sinsky, C., Dyrbye, L. N., Trockel, M., & West, C. P. (2019). Burnout among physicians compared with individuals with a professional or doctoral degree in a field outside of medicine. Mayo Clinic Proceedings, 94(3), 549–551. https://doi.org/10.1016/j.mayocp.2018.11.035.
Thissen, D., Pommerich, M., Billeaud, K., & Williams, V. S. (1995). Item response theory for scores on tests including polytomous items with ordered responses. Applied Psychological Measurement, 19(1), 39–49.
Revelle, W. (2018). psych: Procedures for personality and psychological research. https://CRAN.R-project.org/package=psych
R Core Team. (2018). R: A language and environment for statistical computing. https://www.R-project.org/
Rosseel, Y. (2012). Lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2), 1–36.
Chalmers, P. (2012). Mirt: A multidimensional item response theory package for the R environment. Journal of Statistical Software, 48(6), 1–29. https://doi.org/10.18637/jss.v048.i06.
Maydeu-Olivares, A. (2014). Evaluating the fit of IRT models. In S. P. Reise & D. A. Revicki (Eds.), Handbook of item response theory modeling (pp. 129–145). New York: Routledge.
National Academy of Medicine (2018). Validated instruments to assess work-related dimensions of well-being. https://nam.edu/valid-reliable-survey-instruments-measure-burnout-well-work-related-dimensions/
Schaufeli, W. B., Bakker, A. B., Hoogduin, K., Schaap, C., & Kladler, A. (2001). On the clinical validity of the Maslach burnout inventory and the burnout measure. Psychology & Health, 16(5), 565–582.
Mind Garden, Inc. (2018). The problem with cutoffs for the Maslach Burnout Inventory. https://www.mindgarden.com/documents/MBI-Cutoff-Caveat.pdf
Health Resources & Services Administration. (2017). Advisory Committee on Training in Primary Care Medicine and Dentistry (ACTPCMD) meeting minutes: March 6–7, 2017. https://www.hrsa.gov/sites/default/files/hrsa/advisory-committees/primarycare-dentist/meetings/20170306-minutes.pdf
Sheldrick, R. C., & Garfinkel, D. (2017). Is a positive developmental-behavioral screening score sufficient to justify referral? A review of evidence and theory. Academic Pediatrics, 17(5), 464–470.
Sheldrick, R. C., Benneyan, J. C., Kiss, I. G., Briggs-Gowan, M. J., Copeland, W., & Carter, A. S. (2015). Thresholds and accuracy in screening tools for early detection of psychopathology. Journal of Child Psychology and Psychiatry, 56(9), 936–948.
Eckleberry-Hunt, J., Kirkpatrick, H., & Barbera, T. (2017). The problems with burnout research. Academic Medicine. https://doi.org/10.1097/acm.0000000000001890.