Data missingness in the Michigan NEMSIS (MI-EMSIS) dataset: a mixed-methods study
Tóm tắt
The study was done to evaluate levels of missing and invalid values in the Michigan (MI) National Emergency Medical Services Information System (NEMSIS) (MI-EMSIS) and explore possible causes to inform improvement in data reporting and prehospital care quality. We used a mixed-methods approach to study trends in data reporting. The proportion of missing or invalid values for 18 key reported variables in the MI-EMSIS (2010–2015) dataset was assessed overall, then stratified by EMS agency, software platform, and Medical Control Authorities (MCA)—regional EMS oversight entities in MI. We also conducted 4 focus groups and 10 key-informant interviews with EMS participants to understand the root causes of data missingness in MI-EMSIS. Only five variables of the 18 studied exhibited less than 10% missingness, and there was apparent variation in the rate of missingness across all stratifying variables under study. No consistent trends over time regarding the levels of missing or invalid values from 2010 to 2015 were identified. Qualitative findings indicated possible causes for this missingness including data-mapping issues, unclear variable definitions, and lack of infrastructure or training for data collection. The adoption of electronic data collection in the prehospital setting can only support quality improvement if its entry is complete. The data suggest that there are many EMS agencies and MCAs with very high levels of missingness, and they do not appear to be improving over time, demonstrating a need for investment in efforts in improving data collection and reporting.
Tài liệu tham khảo
citation_title=Strategies to improve cardiac arrest survival: a time to act. Institute of Medicine (IOM) 2015; citation_publication_date=2015; citation_id=CR1; citation_author=RMM Grahm; citation_author=A Schultz; citation_publisher=National Academies Press
citation_journal_title=Prehospital Emergency Care.; citation_title=Emergency medical services information systems and a future EMS national database; citation_author=G Mears, JP Ornato, DE Dawson; citation_volume=6; citation_issue=1; citation_publication_date=2002; citation_pages=12; citation_doi=10.1080/10903120290938931; citation_id=CR2
National Highway Traffic and Safety Administration, United States Department of Transportation. Emergency Medical Services performance measures: recommended attributes and indicators for system and services performance Report No.: DOT HS 811 211.
https://www.ems.gov/pdf/811211.pdf
. Accessed 13 Dec 2017.
citation_journal_title=Prehospital Emerg Care; citation_title=National emergency medical services information system (NEMSIS); citation_author=DE Dawson; citation_volume=10; citation_issue=3; citation_publication_date=2006; citation_pages=314-316; citation_doi=10.1080/10903120600724200; citation_id=CR4
Mann C.,National Emergency Services Information System. Why NEMSIS compliance testing?
https://nemsis.org/media/becoming Compliant/ documents/WhyNEMSISComplianceTesting.pdf
. Accessed 13 Dec 2017.
Michigan Department of Health and Human Services. Michigan Emergency Medical Services Information System (MI-EMSIS).
http://www.michigan.gov/mdhhs/0,5885,7-339-73970_5093_28508-211272%2D%2D,00.html
. Accessed 13 Dec 2017.
Monroe County Medical Control Authority. Patient care record electronic documentation & EMS Information System.
http://www.mercymemorial.org/Resource.ashx?sn=sec5PatientCareRecord
. Accessed 6 Dec 2017.
citation_journal_title=Ann Emerg Med.; citation_title=EMS agenda for the future: where we are… where we want to be; citation_author=TR Delbridge, B Bailey, JL Chew, AK Conn, JJ Krakeel, D Manz; citation_volume=31; citation_issue=2; citation_publication_date=1998; citation_pages=251-263; citation_doi=10.1016/S0196-0644(98)70316-6; citation_id=CR8
Kuehl A, National Association of EMS Physicians. Prehospital systems and medical oversight: Kendall/Hunt Publishing Company; 3rd edition. 2002.
National Emergency Medical Services Information System (NEMSIS). Version 3 compliance.
https://nemsis.org/technical-resources/version-3/v3-compliance/
. 2017. Accessed 6 Dec 2017.
Putnam K. Michigan Department of Health and Human Services. Data collection requirement-MI-EMSIS.
https://www.michigan.gov/documents/mdch/Data_Collection_Requirement_4542997.pdf
. Accessed 6 Dec 2017.
ImageTrend. ImageTrend EMS Service Bridge.
https://www.icemapcr.com/default.cfm?page=about
. Accessed 13 Dec 2017.
Legler J, Rojas Jr J, Jacobson KE, Mann NC. NEMSIS Version 2 to Version 3 translation-user guide.
https://nemsis.org/media/nemsis_v3/master/Translation/v2v3Translation/v2v3Translation/NEMSIS_V2_V3_Translation_User_Guide.pdf
. Accessed 13 Dec 2017.
National Emergency Medical Services Information System. Techincal resources: software developers.
https://nemsis.org/technical-resources/
. Accessed 15 Dec 2017.
Legler J, Rojas Jr J, Mann, NC. NEMSIS V3 StateDataSet: software developer technical guide.
https://nemsis.org/media/nemsis_v3/master/UsageGuides/NEMSIS_V3_StateDataSet_Guide.pdf
. Accessed 13 Dec 2017.
Shivley RM. EMS Information System.
http://www.michigan.gov/documents/mdhhs/June_5_2009_Data_Letter_to_MCA_and_LSAs_281985_7_537178_7.pdf
. Accessed 13 Dec 2017.
Taymour RK, Abir M, Chamberlin M, Dunne RB, Lowell M, Wahl K, et al. Policy, practice, and research agenda for Emergency Medical Services oversight: a systematic review and environmental scan. Prehosp Disaster Med. In Press.
citation_journal_title=Prehosp Emerg Care.; citation_title=Performance measurements in Emergency Medical Services; citation_author=J Dunford, RM Domeier, T Blackwell, G Mears, J Overton, EJ Rivera-Rivera, R Swor; citation_volume=6; citation_issue=1; citation_publication_date=2002; citation_pages=92-98; citation_doi=10.1080/10903120290938896; citation_id=CR18
Schooley B, Horan TA. Emerging digital technologies in Emergency Medical Services: considerations and strategies to strengthen the continuum of care. DOT HS 811 999c.
https://www.ems.gov/pdf/advancing-ems-systems/Reports-and Resources/Emerging Digital TechInEMS.pdf
. Accessed 13 Dec 2017.
Michigan Department of Health and Human Services. Michigan Statewide Trauma System Lansing.
http://www.michigan.gov/mdhhs/0,5885,7-339-71551_69345%2D%2D-,00.html
. Accessed 13 Dec 2017.
citation_journal_title=Prehosp Emerg Care.; citation_title=Description of the 2012 NEMSIS public-release research dataset; citation_author=NC Mann, L Kane, M Dai, K Jacobson; citation_volume=19; citation_issue=2; citation_publication_date=2015; citation_pages=232-240; citation_doi=10.3109/10903127.2014.959219; citation_id=CR21
citation_title=Base SAS® 9.3 Procedures Guide [computer program]; citation_publication_date=2011; citation_id=CR22; citation_author=SI Inc; citation_publisher=SAS Institute Inc
citation_title=Qualitative data analysis: a methods sourcebook; citation_publication_date=2013; citation_id=CR23; citation_author=MB Miles; citation_author=AM Huberman; citation_author=J Saldana; citation_publisher=CA:SAGE Publications
citation_journal_title=Ann Fam Med; citation_title=Integrating quantitative and qualitative results in health science mixed methods research through joint displays; citation_author=TC Guetterman, MD Fetters, JW Creswell; citation_volume=13; citation_issue=6; citation_publication_date=2015; citation_pages=554-561; citation_doi=10.1370/afm.1865; citation_id=CR24
citation_journal_title=Aust N Z J Public Health.; citation_title=How can I deal with missing data in my study?; citation_author=DA Bennett; citation_volume=25; citation_issue=5; citation_publication_date=2001; citation_pages=464-469; citation_doi=10.1111/j.1467-842X.2001.tb00294.x; citation_id=CR25
citation_journal_title=Stat Methods Med Res; citation_title=Multiple imputation: a primer; citation_author=JL Schafer; citation_volume=8; citation_issue=1; citation_publication_date=1999; citation_pages=3-15; citation_doi=10.1177/096228029900800102; citation_id=CR26
citation_journal_title=Am J Epidemiol; citation_title=Biased estimation of the odds ratio in case-control studies due to the use of ad hoc methods of correcting for missing values for confounding variables; citation_author=W Vach, M Blettner; citation_volume=134; citation_issue=8; citation_publication_date=1991; citation_pages=895-907; citation_doi=10.1093/oxfordjournals.aje.a116164; citation_id=CR27
citation_title=Statistical analysis with missing data; citation_publication_date=2002; citation_id=CR28; citation_author=DB Rubin; citation_author=RJ Little; citation_publisher=Wiley
Putnam, K. Michigan MI-EMSIS PCR Elements V1.1: Michigan required and optional PCR data elements. Lansing, MI.: Michigan Department of Health and Human Services. 2009.
https://www.michigan.gov/documents/mdch/Michigan_MI-EMSIS_PCR_Elements_271747_7.pdf
. Accessed 14 Dec 2017.
National EMS Database. NEMSIS Reseatch Data Set V2.2.1 and V3.3.4. 2016 user manual. Available at:
https://nemsis.org/wp-content/uploads/2017/10/NEMSIS-RDS-221-2016-User-Manual.pdf
. Accessed 5 Dec 2020.
citation_journal_title=Disaster Med Public Health Prep; citation_title=Optimizing routine and disaster prehospital care through improved emergency medical services oversight; citation_author=M Abir, J Forman, RK Taymour, C Brent, BK Nallamothu, J Scott, K Wahl; citation_volume=33; citation_issue=1; citation_publication_date=2018; citation_pages=89-97; citation_id=CR31