Non-contact, synchronous dynamic measurement of respiratory rate and heart rate based on dual sensitive regions
Tóm tắt
Currently, many imaging photoplethysmography (IPPG) researches have reported non-contact measurements of physiological parameters, such as heart rate (HR), respiratory rate (RR), etc. However, it is accepted that only HR measurement has been mature for applications, and other estimations are relatively incapable for reliable applications. Thus, it is worth keeping on persistent studies. Besides, there are some issues commonly involved in these approaches need to be explored further. For example, motion artifact attenuation, an intractable problem, which is being attempted to be resolved by sophisticated video tracking and detection algorithms. This paper proposed a blind source separation-based method that could synchronously measure RR and HR in non-contact way. A dual region of interest on facial video image was selected to yield 6-channels Red/Green/Blue signals. By applying Second-Order Blind Identification algorithm to those signals generated above, we obtained 6-channels outputs that contain blood volume pulse (BVP) and respiratory motion artifact. We defined this motion artifact as respiratory signal (RS). For the automatic selections of the RS and BVP among these outputs, we devised a kurtosis-based identification strategy, which guarantees the dynamic RR and HR monitoring available. The experimental results indicated that, the estimation by the proposed method has an impressive performance compared with the measurement of the commercial medical sensors. The proposed method achieved dynamic measurement of RR and HR, and the extension and revision of it may have the potentials for more physiological signs detection, such as heart rate variability, eye blinking, nose wrinkling, yawn, as well as other muscular movements. Thus, it might provide a promising approach for IPPG-based applications such as emotion computation and fatigue detection, etc.
Tài liệu tham khảo
Wu T, et al. Photoplethysmography imaging: a new noninvasive and non-contact method for mapping of the dermal perfusion changes. Proc SPIE. 2000;4163:62–70.
Lee J, et al. Comparison between red, green and blue light reflection photoplethysmography for heart rate monitoring during motion. In: Proceedings Conference of the IEEE engineering in medicine and biology society; 2013. p. 1724–7.
Sun Y, et al. Use of ambient light in remote photoplethysmographic systems: comparison between a high-performance camera and a lowcost webcam. J Biomed Opt. 2012;17(3):37005-1–-10.
Hu SJ, et al. Feasibility of imaging photoplethysmography. In: Proceedings of international conference on biomedical engineering; 2008. p. 72–5.
Hu S, et al. Development of effective photoplethysmographic measurement techniques: from contact to non-contact and from point to imaging. In: Proceedings conference of the IEEE engineering in medicine and biology society, vol 2009; 2009. p. 6550–3.
Takano C, Ohta Y. Heart rate measurement based on a time-lapse image. Med Eng Phys. 2007;29(8):853–7.
Verkruysse W, et al. Remote plethysmographic imaging using ambient light. Opt Exp. 2008;16(26):21434–45.
Scully CG, et al. Physiological parameter monitoring from optical recordings with a mobile phone. IEEE Trans Biomed Eng. 2012;59(2):303–6.
Jonathan E, Leahy MJ. Cellular phone-based photoplethysmographic imaging. J. Biophoton. 2011;4(5):293–6.
Jonathan E, Leahy M. Investigating a smartphone imaging unit for photoplethysmography. Physiol Meas. 2010;31(11):N79–83.
Matsumura K, et al. iPhone 4s photoplethysmography: which light color yields the most accurate heart rate and normalized pulse volume using the iphysiometer application in the presence of motion artifact. PLoS ONE. 2014;9(3):e91205-1–-12.
Hayes MJ, Smith PR. Artifact reduction in photoplethysmography. Appl Opt. 1998;37(31):7437–46.
Poh MZ, et al. Advancements in noncontact, multiparameter physiological measurements using a webcam. IEEE Trans Biomed Eng. 2011;58(1):7–11.
Poh MZ, et al. Non-contact, automated cardiac pulse measurements using video imaging and blind source separation. Opt Exp. 2010;18(10):10762–74.
Lewandowska M, Nowak J. Measuring pulse rate with a webcam. J Med Imag Health Inform. 2012;2(1):87–92.
Sun Y, et al. Motion-compensated noncontact imaging photoplethysmography to monitor cardiorespiratory status during exercise. J Biomed Opt. 2011;16(7):1–9.
Lewandowska M, et al. Measuring pulse rate with a webcam: a non-contact method for evaluating cardiac activity. In: Proceedings of the FedCSIS, Szczecin, Poland; 2011. p. 405–10.
Tsouri G, Kyal S, Dianat S, Mestha L. Constrained independent component analysis approach to nonobtrusive pulse rate measurements. J Biomed Opt. 2012;17(7):077011.
McDuff D, Gontarek S, Picard R. Remote detection of photoplethysmographic systolic and diastolic peaks using a digital camera. IEEE Trans Biomed Eng. 2014;61(12):2948–54.
Wu HY, et al. Eulerian video magnification for revealing subtle changes in the world. ACM Trans Graph. 2012;31(4):1–8.
Hertzman AB, Spealman C. Observations on the finger volume pulse recorded photoelectrically. Amer J Physiol. 1937;119:334–5.
Sayers B. Analysis of heart rate variability. Ergonomics. 1973;16(1):17.
Sun Y, Thakor N. Photoplethysmography revisited: from contact to noncontact from point to imaging. IEEE Trans Biomed Eng. 2016;63:463–77.
Wang W, et al. Exploiting spatial redundancy of image sensor for motion robust rPPG. IEEE Trans Biomed Eng. 2015;62(2):415–25.
Henriques JF, et al. Exploiting the circulant structure of tracking by-detection with kernels. In: Proceedings of European conference on computer vision, vol 7575; 2012. p. 702–15.
Feng L, et al. Motion-resistant remote imaging photoplethysmography based on the optical properties of skin. IEEE Trans Circuits Syst Video Technol. 2015;25(5):879–91.
Emrah Tasli H, Gudi A, Uyl M. Remote PPG based vital sign measurement using adaptive facial regions. IEEE International Conference on Image Processing; 2014.
Kumar M, et al. Distance PPG: robust non-contact vital signs monitoring using a camera. Biomed Opt Exp. 2015;6(5):1565–88.
Blackford EB, Estepp JR. Effects of frame rate and image resolution on pulse rate measured using multiple camera imaging photoplethysmography. Proc SPIE. 2015;9417:94172D-1–-14.
Estepp JR, et al. Recovering pulse rate during motion artifact with a multi-imager array for non-contact imaging photoplethysmography. In: Proceedings IEEE international conference on systems, man and cybernetics; 2014, p. 1462–9.
Holton B, et al. Signal recovery in imaging photoplethysmography. Physiol Meas. 2013;34(11):1499–511.
Kwon S, et al. Validation of heart rate extraction using video imaging on a built-in camera system of a smartphone. In: Proceedings of 34th IEEE EMBS, San Diego; 2012. p. 2174–7.
de Haan G, Jeanne V. Robust pulse-rate from chrominance-based rPPG. IEEE Trans Biomed Eng. 2013;60(10):2878–86.
Shen L, et al. Human detection based on the excess kurtosis in the non-stationary clutter environment using UWB impulse radar. International Asia-Pacific conference on Synthetic Aperture Radar (APSAR), Seoul; 2011. p. 1–4.