Remote photoplethysmography with constrained ICA using periodicity and chrominance constraints
Tóm tắt
Remote photoplethysmography (rPPG) has been in the forefront recently for measuring cardiac pulse rates from live or recorded videos. It finds advantages in scenarios requiring remote monitoring, such as medicine and fitness, where contact based monitoring is limiting and cumbersome. The blood volume pulse, defined as the pulsative flow of arterial blood, gives rise to periodic changes in the skin color which are then quantified to estimate a temporal signal. This temporal signal can be analysed using various methods to extract the representative cardiac signal. We present a novel method for measuring rPPG signals using constrained independent component analysis (cICA). We incorporate a priori information into the cICA algorithm to aid in the extraction of the most prominent rPPG signal. This a priori information is implemented using two constraints: first, based on periodicity using autocorrelation, and second, a chrominance-based constraint exploiting the physical characteristics of the skin. Our method showed improved performances over traditional blind source separation methods like ICA and chrominance based methods with mean absolute errors of 0.62 beats per minute (BPM) and 3.14 BPM for the two datasets in our inhouse video database UBFC-RPPG, and 4.69 BPM for the public MMSE-HR dataset. Its performance was also better in comparison to other state of the art methods in terms of accuracy and robustness. Our UBFC-RPPG database is also made publicly available and is specifically aimed towards testing rPPG measurements.
Tài liệu tham khảo
Hertzman AB. Photoelectric plethysmography of the fingers and toes in man. Exp Biol Med. 1937;37(3):529–34. https://doi.org/10.3181/00379727-37-9630.
Verkruysse W, Svaasand LO, Nelson JS. Remote plethysmographic imaging using ambient light. Opt Express. 2008;16(26):21434–45. https://doi.org/10.1364/OE.16.021434. NIHMS150003.
Aarts LAM, Jeanne V, Cleary JP, Lieber C, Nelson JS, Bambang Oetomo S, Verkruysse W. Non-contact heart rate monitoring utilizing camera photoplethysmography in the neonatal intensive care unit—a pilot study. Early Hum Dev. 2013;89(12):943–8. https://doi.org/10.1016/j.earlhumdev.2013.09.016. NIHMS150003.
De Haan G, Jeanne V. Robust pulse rate from chrominance-based rPPG. IEEE Trans Biomed Eng. 2013;60(10):2878–86. https://doi.org/10.1109/TBME.2013.2266196.
McDuff D, Gontarek S, Picard RW. Improvements in remote cardiopulmonary measurement using a five band digital camera. IEEE Trans Biomed Eng. 2014;61(10):2593–601. https://doi.org/10.1109/TBME.2014.2323695.
Poh M-Z, McDuff DJ, Picard RW. Non-contact, automated cardiac pulse measurements using video imaging and blind source separation. Opt Express. 2010;18(10):10762–74. https://doi.org/10.1364/OE.18.010762.
Poh MZ, McDuff DJ, Picard RW. Advancements in noncontact, multiparameter physiological measurements using a webcam. IEEE Trans Biomed Eng. 2011;58(1):7–11. https://doi.org/10.1109/TBME.2010.2086456.
Hyvärinen A, Oja E. Independent component analysis: algorithms and applications. Neural Netw. 2000;13(4–5):411–30. https://doi.org/10.1016/S0893-6080(00)00026-5.
Lu W, Rajapakse JC. Constrained independent component analysis. In: Advances in neural information processing systems 13 (NIPS2000), vol. 10. 2000. p. 570–76. http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.19.9949.
Comon P. Independent component analysis, a new concept? Signal Process. 1994;36(3):287–314. https://doi.org/10.1016/0165-1684(94)90029-9.
Djuwari D, Kant Kumar D, Palaniswami M. Limitations of ICA for artefact removal. IEEE Med Biol Soc. 2005;5:4685–8. https://doi.org/10.1109/IEMBS.2005.1615516.
Holton BD, Mannapperuma K, Lesniewski PJ, Thomas JC. Signal recovery in imaging photoplethysmography. Physiol Meas. 2013;34(11):1499–511. https://doi.org/10.1088/0967-3334/34/11/1499.
Wang W, Stuijk S, De Haan G. Exploiting spatial redundancy of image sensor for motion robust rPPG. IEEE Trans Biomed Eng. 2015;62(2):415–25. https://doi.org/10.1109/TBME.2014.2356291.
de Haan G, van Leest A. Improved motion robustness of remote-PPG by using the blood volume pulse signature. Physiol Meas. 2014;35(9):1913–26.
Wang W, Den Brinker A, Stuijk S, De Haan G. Algorithmic principles of remote-PPG. IEEE Trans Biomed Eng. 2016;1:99. https://doi.org/10.1109/TBME.2016.2609282.
Feng L, Po LM, Xu X, Li Y, Cheung CH, Cheung KW, Yuan F. Dynamic ROI based on K-means for remote photoplethysmography. In: ICASSP, IEEE international conference on acoustics, speech and signal processing—proceedings 2015-August. 2015. p. 1310–14. https://doi.org/10.1109/ICASSP.2015.7178182.
Bobbia S, Benezeth Y, Dubois J. Remote photoplethysmography based on implicit living skin tissue segmentation. 2016.
Brennan DG. Linear diversity combining techniques. Proc IRE. 1959;47(6):1075–102. https://doi.org/10.1109/JRPROC.1959.287136.
Kumar M, Veeraraghavan A, Sabharwal A. DistancePPG: robust non-contact vital signs monitoring using a camera. Biomed Opt Express. 2015;6(5):1565. https://doi.org/10.1364/BOE.6.001565. 1502.08040.
Li X, Chen J, Zhao G, Pietikäinen M. Remote heart rate measurement from face videos under realistic situations. In: Proceedings of the IEEE computer society conference on computer vision and pattern recognition. 2014. p. 4264–71. https://doi.org/10.1109/CVPR.2014.543.
Butler MJ, Crowe JA, Hayes-Gill BR, Rodmell PI. Motion limitations of non-contact photoplethysmography due to the optical and topological properties of skin. Physiol Meas. 2016;37(5):27–37. https://doi.org/10.1088/0967-3334/37/5/N27.
Edwards GJ, Taylor CJ, Cootes TF. Interpreting face images using active appearance models. In: Proceedings of the third IEEE international conference on automatic face and gesture recognition. 1998. p. 300–5. https://doi.org/10.1109/AFGR.1998.670965.
Tasli HE, Gudi A, Den Uyl M. Remote PPG based vital sign measurement using adaptive facial regions. In: 2014 IEEE international conference on image processing, ICIP 2014. 2014. p. 1410–14. https://doi.org/10.1109/ICIP.2014.7025282
Sun Y, Thakor N. Photoplethysmography revisited: from contact to noncontact, from point to imaging. IEEE Trans Biomed Eng. 2016;63(3):463–77. https://doi.org/10.1109/TBME.2015.2476337.
Mcduff DJ, Estepp JR, Piasecki AM, Blackford EB. A survey of remote optical photoplethysmographic imaging methods. 2015. p. 6398–404.
Tarassenko L, Villarroel M, Guazzi A, Jorge J, Clifton DA, Pugh C. Non-contact video-based vital sign monitoring using ambient light and auto-regressive models. Physiol Meas. 2014;35(5):807–31. https://doi.org/10.1088/0967-3334/35/5/807.
Tsouri GR, Kyal S, Dianat S, Mestha LK. Constrained independent component analysis approach to nonobtrusive pulse rate measurements. J Biomed Opt. 2012;17(7):0770111. https://doi.org/10.1117/1.JBO.17.7.077011.
Hyvarinen A. Fast and robust fixed-point algorithm for independent component analysis. IEEE Trans Neural Netw Learn Syst. 1999;10(3):626–34. https://doi.org/10.1109/72.761722.
Bertsekas D. Constrained optimization and Lagrange multiplier methods. New York: Academic Press; 1985. https://doi.org/10.1002/net.3230150112. http://doi.wiley.com/10.1002/net.3230150112.
Byrd RH, Gilbert JC, Nocedal J. A trust region method based on interior point techniques for nonlinear programming. Math Program Ser B. 2000;89(1):149–85. https://doi.org/10.1007/s101070000189.
Conaire CÓ, O’Connor NE, Smeaton AF. Detector adaptation by maximising agreement between independent data sources. CVPR; 2007. https://doi.org/10.1109/CVPR.2007.383448.
Tarvainen MP, Ranta-aho PO, Karjalainen PA. An advanced detrending method with application to HRV analysis. IEEE Trans Biomed Eng. 2002;49(2):172–5. https://doi.org/10.1109/10.979357.
Lewandowska M, Ruminski J, Kocejko T, Nowak J. Measuring pulse rate with a webcam; a non-contact method for evaluating cardiac activity. In: 2011 federated conference on computer science and information systems (FedCSIS). 2011. p. 405–10.
Hülsbusch M. Ein bildgestütztes, funktionelles Verfahren zur optoelektronischen Erfassung der Hautperfusion. Anesth Analg. 2008;145. https://doi.org/10.1117/12.463573.