Respiratory Rate Estimation from the Built-in Cameras of Smartphones and Tablets
Tóm tắt
This paper presents a method for respiratory rate estimation using the camera of a smartphone, an MP3 player or a tablet. The iPhone 4S, iPad 2, iPod 5, and Galaxy S3 were used to estimate respiratory rates from the pulse signal derived from a finger placed on the camera lens of these devices. Prior to estimation of respiratory rates, we systematically investigated the optimal signal quality of these 4 devices by dividing the video camera’s resolution into 12 different pixel regions. We also investigated the optimal signal quality among the red, green and blue color bands for each of these 12 pixel regions for all four devices. It was found that the green color band provided the best signal quality for all 4 devices and that the left half VGA pixel region was found to be the best choice only for iPhone 4S. For the other three devices, smaller 50 × 50 pixel regions were found to provide better or equally good signal quality than the larger pixel regions. Using the green signal and the optimal pixel regions derived from the four devices, we then investigated the suitability of the smartphones, the iPod 5 and the tablet for respiratory rate estimation using three different computational methods: the autoregressive (AR) model, variable-frequency complex demodulation (VFCDM), and continuous wavelet transform (CWT) approaches. Specifically, these time-varying spectral techniques were used to identify the frequency and amplitude modulations as they contain respiratory rate information. To evaluate the performance of the three computational methods and the pixel regions for the optimal signal quality, data were collected from 10 healthy subjects. It was found that the VFCDM method provided good estimates of breathing rates that were in the normal range (12–24 breaths/min). Both CWT and VFCDM methods provided reasonably good estimates for breathing rates that were higher than 26 breaths/min but their accuracy degraded concomitantly with increased respiratory rates. Overall, the VFCDM method provided the best results for accuracy (smaller median error), consistency (smaller interquartile range of the median value), and computational efficiency (less than 0.5 s on 1 min of data using a MATLAB implementation) to extract breathing rates that varied from 12 to 36 breaths/min. The AR method provided the least accurate respiratory rate estimation among the three methods. This work illustrates that both heart rates and normal breathing rates can be accurately derived from a video signal obtained from smartphones, an MP3 player and tablets with or without a flashlight.
Tài liệu tham khảo
citation_journal_title=J. Appl. Physiol.; citation_title=Volumetric dynamics of respiration as measured by electrical impedance plethysmography; citation_author=R Allison, E Holmes, J Nyboer; citation_volume=19; citation_publication_date=1964; citation_pages=166-173; citation_id=CR1
citation_journal_title=Biomed. Eng. IEEE Trans.; citation_title=Estimation of respiratory rate from photoplethysmogram data using time–frequency spectral estimation; citation_author=KH Chon, S Dash, K Ju; citation_volume=56; citation_publication_date=2009; citation_pages=2054-2063; citation_doi=10.1109/TBME.2009.2019766; citation_id=CR2
citation_journal_title=J. Gen. Intern. Med.; citation_title=Respiratory rate predicts cardiopulmonary arrest for internal medicine inpatients; citation_author=JF Fieselmann, MS Hendryx, CM Helms, DS Wakefield; citation_volume=8; citation_publication_date=1993; citation_pages=354-360; citation_doi=10.1007/BF02600071; citation_id=CR3
Grimaldi, D., Y. Kurylyak, F. Lamonaca, and A. Nastro. Photoplethysmography detection by smartphone’s videocamera. In: The 6th IEEE International Conference on Intelligent Data Acquisition and Advance Computing Systems: Technology and Applications, 2011.
citation_journal_title=Scand. J. Prim. Health Care; citation_title=Estimated prevalences of respiratory symptoms, asthma and chronic obstructive pulmonary disease related to detection rate in primary health care; citation_author=M Hasselgren, M Arne, A Lindahl, S Janson, B Lundbäck; citation_volume=19; citation_publication_date=2001; citation_pages=54-57; citation_doi=10.1080/028134301300034701; citation_id=CR5
citation_journal_title=Am. J. Physiol. Heart Circ. Physiol.; citation_title=Respiratory sinus arrhythmia in humans: how breathing pattern modulates heart rate; citation_author=J Hirsch, B Bishop; citation_volume=241; citation_publication_date=1981; citation_pages=H620-H629; citation_id=CR6
citation_journal_title=Ann. Biomed. Eng.; citation_title=Respiratory rate extraction via an autoregressive model using the optimal parameter search criterion; citation_author=J Lee, K Chon; citation_volume=38; citation_publication_date=2010; citation_pages=3218-3225; citation_doi=10.1007/s10439-010-0080-9; citation_id=CR7
citation_journal_title=Biomed. Eng. IEEE Trans.; citation_title=An autoregressive model-based particle filtering algorithms for extraction of respiratory rates as high as 90 breaths per minute from pulse oximeter; citation_author=J Lee, KH Chon; citation_volume=57; citation_publication_date=2010; citation_pages=2158-2167; citation_doi=10.1109/TBME.2010.2051330; citation_id=CR8
citation_journal_title=Biomed. Eng. IEEE Trans.; citation_title=Time-varying autoregressive model-based multiple modes particle filtering algorithm for respiratory rate extraction from pulse oximeter; citation_author=J Lee, KH Chon; citation_volume=58; citation_publication_date=2011; citation_pages=790-794; citation_doi=10.1109/TBME.2010.2085437; citation_id=CR9
citation_journal_title=Physiol. Meas.; citation_title=Respiratory rate extraction from pulse oximeter and electrocardiographic recordings; citation_author=J Lee, JP Florian, KH Chon; citation_volume=32; citation_publication_date=2011; citation_pages=1763; citation_doi=10.1088/0967-3334/32/11/S04; citation_id=CR10
citation_journal_title=Emerg. Med. J.; citation_title=Standard pulse oximeters can be used to monitor respiratory rate; citation_author=P Leonard, T Beattie, P Addison, J Watson; citation_volume=20; citation_publication_date=2003; citation_pages=524-525; citation_doi=10.1136/emj.20.6.524; citation_id=CR11
citation_journal_title=Acta Paediatr.; citation_title=An automated algorithm for determining respiratory rate by photoplethysmogram in children; citation_author=PA Leonard, D Clifton, PS Addison, JN Watson, T Beattie; citation_volume=95; citation_publication_date=2006; citation_pages=1124-1128; citation_doi=10.1080/08035250600612280; citation_id=CR12
citation_journal_title=J. Clin. Monit. Comput.; citation_title=An algorithm for the detection of individual breaths from the pulse oximeter waveform; citation_author=P Leonard, NR Grubb, PS Addison, D Clifton, JN Watson; citation_volume=18; citation_publication_date=2004; citation_pages=309-312; citation_doi=10.1007/s10877-005-2697-z; citation_id=CR13
citation_journal_title=Conf. Proc. IEEE Eng. Med. Biol. Soc.; citation_title=A review of non-contact, low-cost physiological information measurement based on photoplethysmographic imaging; citation_author=H Liu, Y Wang, L Wang; citation_publication_date=2012; citation_id=CR14
citation_journal_title=Biomed. Eng. IEEE Trans.; citation_title=A new algorithm for linear and nonlinear ARMA model parameter estimation using affine geometry; citation_author=S Lu, KH Ju, KH Chon; citation_volume=48; citation_publication_date=2001; citation_pages=1116-1124; citation_doi=10.1109/10.951514; citation_id=CR15
citation_journal_title=J. Clin. Monit. Comput.; citation_title=Accuracy of capnography with a 30 foot nasal cannula for monitoring respiratory rate and end-tidal CO2 in children; citation_author=KP Mason, PE Burrows, MM Dorsey, D Zurakowski, B Krauss; citation_volume=16; citation_publication_date=2000; citation_pages=259-262; citation_doi=10.1023/A:1011436329848; citation_id=CR16
citation_journal_title=Heart Rhythm; citation_title=A novel application for the detection of an irregular pulse using an iPhone 4S in patients with atrial fibrillation; citation_author=DD McManus, J Lee, O Maitas, N Esa, R Pidikiti, A Carlucci, J Harrington, E Mick, KH Chon; citation_volume=10; citation_publication_date=2013; citation_pages=315-319; citation_doi=10.1016/j.hrthm.2012.12.001; citation_id=CR17
citation_journal_title=Early Hum. Dev.; citation_title=Increased amplitude modulation of continuous respiration precedes sudden infant death syndrome:–Detection by spectral estimation of respirogram; citation_author=T Rantonen, J Jalonen, J Grönlund, K Antila, D Southall, I Välimäki; citation_volume=53; citation_publication_date=1998; citation_pages=53-63; citation_doi=10.1016/S0378-3782(98)00039-5; citation_id=CR18
citation_journal_title=Biomed. Eng. IEEE Trans.; citation_title=Physiological parameter monitoring from optical recordings with a mobile phone; citation_author=CG Scully, J Lee, J Meyer, AM Gorbach, D Granquist-Fraser, Y Mendelson, KH Chon; citation_volume=59; citation_publication_date=2012; citation_pages=303-306; citation_doi=10.1109/TBME.2011.2163157; citation_id=CR19
citation_journal_title=J. Clin. Monit.; citation_title=Measurement of respiratory rate and timing using a nasal thermocouple; citation_author=M South; citation_volume=11; citation_publication_date=1995; citation_pages=159-164; citation_doi=10.1007/BF01617716; citation_id=CR20
citation_journal_title=Anaesthesia; citation_title=Effect of introducing the Modified Early Warning score on clinical outcomes, cardio-pulmonary arrests and intensive care utilisation in acute medical admissions*; citation_author=C Subbe, R Davies, E Williams, P Rutherford, L Gemmell; citation_volume=58; citation_publication_date=2003; citation_pages=797-802; citation_doi=10.1046/j.1365-2044.2003.03258.x; citation_id=CR21
citation_journal_title=Bull. Am. Meteorol. Soc.; citation_title=A practical guide to wavelet analysis; citation_author=C Torrence, GP Compo; citation_volume=79; citation_publication_date=1998; citation_pages=61-78; citation_doi=10.1175/1520-0477(1998)079<0061:APGTWA>2.0.CO;2; citation_id=CR22
citation_journal_title=Ann. Biomed. Eng.; citation_title=A high resolution approach to estimating time-frequency spectra and their amplitudes; citation_author=H Wang, K Siu, K Ju, KH Chon; citation_volume=34; citation_publication_date=2006; citation_pages=326-338; citation_doi=10.1007/s10439-005-9035-y; citation_id=CR23
citation_journal_title=J. Appl. Physiol.; citation_title=Role of respiratory control mechanisms in the pathogenesis of obstructive sleep disorders; citation_author=M Younes; citation_volume=105; citation_publication_date=2008; citation_pages=1389-1405; citation_doi=10.1152/japplphysiol.90408.2008; citation_id=CR24