Inertial Sensor-Based Gait Recognition: A Review

Sensors - Tập 15 Số 9 - Trang 22089-22127
Sebastijan Šprager1, Matjaž B. Jurič2
1Faculty of Computer and Information Science, University of Ljubljana Vecna pot 113, SI-1000 Ljubljana, Slovenia
2Faculty of Computer and Information Science, University of Ljubljana, Vecna pot 113, SI-1000 Ljubljana, Slovenia. [email protected].

Tóm tắt

With the recent development of microelectromechanical systems (MEMS), inertial sensors have become widely used in the research of wearable gait analysis due to several factors, such as being easy-to-use and low-cost. Considering the fact that each individual has a unique way of walking, inertial sensors can be applied to the problem of gait recognition where assessed gait can be interpreted as a biometric trait. Thus, inertial sensor-based gait recognition has a great potential to play an important role in many security-related applications. Since inertial sensors are included in smart devices that are nowadays present at every step, inertial sensor-based gait recognition has become very attractive and emerging field of research that has provided many interesting discoveries recently. This paper provides a thorough and systematic review of current state-of-the-art in this field of research. Review procedure has revealed that the latest advanced inertial sensor-based gait recognition approaches are able to sufficiently recognise the users when relying on inertial data obtained during gait by single commercially available smart device in controlled circumstances, including fixed placement and small variations in gait. Furthermore, these approaches have also revealed considerable breakthrough by realistic use in uncontrolled circumstances, showing great potential for their further development and wide applicability.

Từ khóa


Tài liệu tham khảo

Fong, 2010, The Use of Wearable Inertial Motion Sensors in Human Lower Limb Biomechanics Studies: A Systematic Review, Sensors, 10, 11556, 10.3390/s101211556

Tao, 2012, Gait Analysis Using Wearable Sensors, Sensors, 12, 2255, 10.3390/s120202255

Whittle, M.W. (2008). Gait Analysis: An Introduction, Butterworth-Heinemann, Elsevier. [4th ed.].

Favre, 2009, Functional calibration procedure for 3D knee joint angle description using inertial sensors, J. Biomech., 42, 2330, 10.1016/j.jbiomech.2009.06.025

Liu, 2009, Development of a wearable sensor system for quantitative gait analysis, Measurement, 42, 978, 10.1016/j.measurement.2009.02.002

Klucken, J., Barth, J., Kugler, P., Schlachetzki, J., Henze, T., Marxreiter, F., Kohl, Z., Steidl, R., Hornegger, J., and Eskofier, B. (2013). Unbiased and Mobile Gait Analysis Detects Motor Impairment in Parkinson’s Disease. PLoS ONE, 8.

2014, Gait Analysis Methods: An Overview of Wearable and Non-Wearable Systems, Highlighting Clinical Applications, Sensors, 14, 3362, 10.3390/s140203362

Roberts, M., and Zahay, D. (2012). Internet Marketing: Integrating Online and Offline Strategies, Cengage Learning.

Yang, 2012, Inertial Sensor-Based Methods in Walking Speed Estimation: A Systematic Review, Sensors, 12, 6102, 10.3390/s120506102

Yamada, 2012, Objective assessment of abnormal gait in patients with rheumatoid arthritis using a smartphone, Rheumatol. Int., 32, 3869, 10.1007/s00296-011-2283-2

Sposaro, F., and Tyson, G. (2009, January 3–6). iFall: An Android application for fall monitoring and response. Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Minneapolis, MN, USA.

Atzori, 2010, The Internet of Things: A Survey, Comput. Netw., 54, 2787, 10.1016/j.comnet.2010.05.010

Gubbi, 2013, Internet of Things (IoT): A vision, architectural elements, and future directions, Future Gener. Comput. Syst., 29, 1645, 10.1016/j.future.2013.01.010

Downs, 1998, The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions, J. Epidemiol. Community Health, 52, 377, 10.1136/jech.52.6.377

Sabatini, 2005, Assessment of Walking Features from Foot Inertial Sensing, IEEE Trans. Biomed. Eng., 52, 486, 10.1109/TBME.2004.840727

Seel, 2014, IMU-Based Joint Angle Measurement for Gait Analysis, Sensors, 14, 6891, 10.3390/s140406891

Ngo, 2015, Similar gait action recognition using an inertial sensor, Pattern Recognit., 48, 1289, 10.1016/j.patcog.2014.10.012

Karsznia, 1993, Basic gait parameters: Reference data for normal subjects, 10–79 years of age, J. Rehabil. Res. Dev., 30, 210

Cutting, 1977, Recognizing friends by their walk: Gait perception without familiarity cues, Bull. Psychon. Soc., 9, 353, 10.3758/BF03337021

Wang, 2003, Silhouette analysis-based gait recognition for human identification, IEEE Trans. Pattern Anal. Mach. Intell., 25, 1505, 10.1109/TPAMI.2003.1251144

Mason, 2013, Comparative Analysis and Fusion of Spatiotemporal Information for Footstep Recognition, IEEE Trans. Pattern Anal. Mach. Intell., 35, 823, 10.1109/TPAMI.2012.164

Gafurov, D. (2007, January 19–21). A survey of biometric gait recognition: Approaches, security and challenges. Proceedings of the Annual Norwegian Computer Science Conference, Oslo, Norway.

Ailisto, 2005, Identifying people from gait pattern with accelerometers, Proc. SPIE, 5779, 7, 10.1117/12.603331

Mantyjarvi, J., Lindholm, M., Vildjiounaite, E., Makela, S.M., and Ailisto, H.A. (2005, January 18–23). Identifying users of portable devices from gait pattern with accelerometers. Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, Philadelphia, PA, USA.

Gafurov, 2006, Biometric gait authentication using accelerometer sensor, J. Comput., 1, 51, 10.4304/jcp.1.7.51-59

Jain, A.K., Ross, A.A., and Nandakumar, K. (2011). Introduction to Biometrics, Springer US.

Ngo, 2014, The largest inertial sensor-based gait database and performance evaluation of gait-based personal authentication, Pattern Recognit., 47, 228, 10.1016/j.patcog.2013.06.028

Ngo, 2014, Orientation-compensative signal registration for owner authentication using an accelerometer, IEICE Trans. Inf. Syst., 97, 541, 10.1587/transinf.E97.D.541

Zhang, Y., Pan, G., Jia, K., Lu, M., Wang, Y., and Wu, Z. (2014). Accelerometer-Based Gait Recognition by Sparse Representation of Signature Points With Clusters. IEEE Trans. Cybern.

Yang, G.Z., and Yacoub, M. (2006). Body Sensor Networks, Springer-Verlag.

Sprager, 2009, A cumulant-based method for gait identification using accelerometer data with principal component analysis and support vector machine, WSEAS Trans. Signal Proc., 5, 369

Derawi, M.O., Nickel, C., Bours, P., and Busch, C. (2010, January 15–17). Unobtrusive User-Authentication on Mobile Phones Using Biometric Gait Recognition. Proceedings of the Sixth International Conference on Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP), Darmstadt, Germany.

Frank, J., Mannor, S., and Precup, D. (2010, January 11–15). Activity and Gait Recognition with Time-Delay Embeddings. Proceedings of the AAAI, Atlanta, GA, USA.

Kwapisz, J.R., Weiss, G.M., and Moore, S.A. (2010, January 27–29). Cell phone-based biometric identification. Proceedings of the Fourth IEEE International Conference on Biometrics: Theory Applications and Systems (BTAS), Washington, DC, USA.

Nickel, C., Busch, C., Rangarajan, S., and Mobius, M. (2011, January 4–6). Using hidden markov models for accelerometer-based biometric gait recognition. Proceedings of the IEEE 7th International Colloquium on Signal Processing and its Applications (CSPA), Penang, Malaysia.

Hoang, 2013, Adaptive Cross-Device Gait Recognition Using a Mobile Accelerometer, J. Inf. Proc. Syst., 9, 333, 10.3745/JIPS.2013.9.2.333

Lu, H., Huang, J., Saha, T., and Nachman, L. (2014, January 13–17). Unobtrusive gait verification for mobile phones. Proceedings of the 2014 ACM International Symposium on Wearable Computers, Seattle, WA, USA.

Muaaz, M., and Nickel, C. (2012, January 3–4). Influence of different walking speeds and surfaces on accelerometer-based biometric gait recognition. Proceedings of the 35th International Conference on Telecommunications and Signal Processing (TSP), Prague, Czech Republic.

Thang, H.M., Viet, V.Q., Thuc, N.D., and Choi, D. (2012, January 26–29). Gait identification using accelerometer on mobile phone. Proceedings of the International Conference on Control, Automation and Information Sciences (ICCAIS), Saigon, Vietnam.

Rong, L., Zhiguo, D., Jianzhong, Z., and Ming, L. (2007, January 6–8). Identification of individual walking patterns using gait acceleration. Proceedings of the 1st International Conference on Bioinformatics and Biomedical Engineering (ICBBE), Wuhan, China.

Rong, L., Jianzhong, Z., Ming, L., and Xiangfeng, H. (2007, January 23–25). A wearable acceleration sensor system for gait recognition. Proceedings of the 2nd IEEE Conference on Industrial Electronics and Applications (ICIEA), Harbin, China.

Trung, N.T., Makihara, Y., Nagahara, H., Sagawa, R., Mukaigawa, Y., and Yagi, Y. (2011, January 11–13). Phase registration in a gallery improving gait authentication. Proceedings of the IEEE International Joint Conference on Biometrics (IJCB), Washington, DC, USA.

Sun, 2012, Curve aligning approach for gait authentication based on a wearable accelerometer, Physiol. Meas., 33, 1111, 10.1088/0967-3334/33/6/1111

Frank, 2013, Time Series Analysis Using Geometric Template Matching, IEEE Trans. Pattern Anal. Mach. Intell., 35, 740, 10.1109/TPAMI.2012.121

Zhong, Y., and Deng, Y. (October, January 29). Sensor orientation invariant mobile gait biometrics. Proceedings of the IEEE International Joint Conference on Biometrics (IJCB), Clearwater, FL, USA.

Sprager, S., and Juric, M.B. (2015). An efficient HOS-based gait authentication of accelerometer data. IEEE Trans. Inf. Forensics Secur., 10.

Subramanian, R., Sarkar, S., Labrador, M., Contino, K., Eggert, C., Javed, O., Zhu, J., and Cheng, H. (2015, January 23–25). Orientation invariant gait matching algorithm based on the Kabsch alignment. Proceedings of the IEEE International Conference on Identity, Security and Behavior Analysis (ISBA), Hong Kong, China.

Trivino, 2010, Application of the computational theory of perceptions to human gait pattern recognition, Pattern Recognit., 43, 2572, 10.1016/j.patcog.2010.01.017

Derawi, 2013, Gait and activity recognition using commercial phones, Comput. Secur., 39, 137, 10.1016/j.cose.2013.07.004

Nickel, 2013, Classifying accelerometer data via hidden markov models to authenticate people by the way they walk, IEEE Aeros. Electron. Syst. Mag., 28, 29, 10.1109/MAES.2013.6642829

Ruiz, 2013, Gait identification by means of box approximation geometry of reconstructed attractors in latent space, Neurocomputing, 121, 79, 10.1016/j.neucom.2012.12.050

Ren, Y., Chen, Y., Chuah, M.C., and Yang, J. (2014). User Verification Leveraging Gait Recognition for Smartphone Enabled Mobile Healthcare Systems. IEEE Trans. Mob. Comput.

Sun, 2014, Gait Characteristic Analysis and Identification Based on the iPhone’s Accelerometer and Gyrometer, Sensors, 14, 17037, 10.3390/s140917037

Hoang, T., Choi, D., and Nguyen, T. (2015). Gait authentication on mobile phone using biometric cryptosystem and fuzzy commitment scheme. Int. J. Inf. Secur., 1–12.

Primo, A., Phoha, V.V., Kumar, R., and Serwadda, A. (2014, January 23–28). Context-Aware Active Authentication Using Smartphone Accelerometer Measurements. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Columbus, OH, USA.

Hoang, 2014, Secure and Privacy Enhanced Gait Authentication on Smart Phone, Sci. World J., 2014, 1

Muaaz, M., and Mayrhofer, R. (2014, January 8–10). Orientation Independent Cell Phone Based Gait Authentication. Proceedings of the 12th International Conference on Advances in Mobile Computing and Multimedia, Kaohsiung, Taiwan.

Muaaz, M., and Mayrhofer, R. (2013, January 2–4). An analysis of different approaches to gait recognition using cell phone based accelerometers. Proceedings of the International Conference on Advances in Mobile Computing & Multimedia, Vienna, Austria.

Banos, 2014, Window Size Impact in Human Activity Recognition, Sensors, 14, 6474, 10.3390/s140406474

Gafurov, D., Snekkenes, E., and Buvarp, T.E. (2006). On the Move to Meaningful Internet Systems 2006: OTM 2006 Workshops, Springer.

Gafurov, 2007, Spoof Attacks on Gait Authentication System, IEEE Trans. Inf. Forensics Secur., 2, 491, 10.1109/TIFS.2007.902030

Derawi, M.O., Bours, P., and Holien, K. (2010, January 15–17). Improved Cycle Detection for Accelerometer Based Gait Authentication. Proceedings of the Sixth International Conference on Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP), Darmstadt, Germany.

Gafurov, D., Snekkenes, E., and Bours, P. (2010, January 20–23). Improved Gait Recognition Performance Using Cycle Matching. Proceedings of the IEEE 24th International Conference on Advanced Information Networking and Applications Workshops (WAINA), Perth, Australia.

Gafurov, 2011, User authentication based on foot motion, Signal Image Video Proc., 5, 457, 10.1007/s11760-011-0249-1

Li, 2011, Gait authentication based on acceleration signals of ankle, Chin. J. Electron., 20, 447

Sprager, S., and Zazula, D. (2011, January 19–21). Impact of different walking surfaces on gait identification based on higher-order statistics of accelerometer data. Proceedings of the IEEE International Conference on Signal and Image Processing Applications (ICSIPA), Kuala Lumpur, Malaysia.

Juefei-Xu, F., Bhagavatula, C., Jaech, A., Prasad, U., and Savvides, M. (2012, January 23–27). Gait-ID on the move: Pace independent human identification using cell phone accelerometer dynamics. Proceedings of the IEEE Fifth International Conference on Biometrics: Theory, Applications and Systems (BTAS), Arlington, VA, USA.

Ren, Y., Chen, Y., Chuah, M.C., and Yang, J. (2013, January 24–27). Smartphone based user verification leveraging gait recognition for mobile healthcare systems. Proceedings of the 10th Annual IEEE Communications Society Conference on Sensor, Mesh and Ad Hoc Communications and Networks (SECON), New Orleans, LA, USA.

Nickel, C., Derawi, M.O., Bours, P., and Busch, C. (2011, January 18–20). Scenario test of accelerometer-based biometric gait recognition. Proceedings of the Third International Workshop on Security and Communication Networks (IWSCN), Gjovik, Norway.

Nickel, C., and Busch, C. (2012, January 2–5). Does a cycle-based segmentation improve accelerometer-based biometric gait recognition?. Proceedings of the 11th International Conference on Information Science, Signal Processing and their Applications (ISSPA), Montreal, QC, Canada.

Youn, I.H., Choi, S., Le May, R., Bertelsen, D., and Youn, J.H. (2014, January 10–13). New gait metrics for biometric authentication using a 3-axis acceleration. Proceedings of the IEEE 11th Consumer Communications and Networking Conference (CCNC), Las Vegas, NV, USA.

Bächlin, M., Schumm, J., Roggen, D., and Töster, G. (2009). Advances in Biometrics, Springer.

Nickel, C., Wirtl, T., and Busch, C. (2012, January 18–20). Authentication of smartphone users based on the way they walk using k-NN algorithm. Proceedings of the Eighth International Conference on Intelligent Information Hiding and Multimedia Signal Processing (IIH-MSP), Piraeus, Greece.

Watanabe, Y. (2014, January 10–12). Influence of Holding Smart Phone for Acceleration-Based Gait Authentication. Proceedings of the 2014 Fifth International Conference on Emerging Security Technologies (EST), Alcala de Henares, Spain.

Pan, 2009, Accelerometer-based gait recognition via voting by signature points, Electron. Lett., 45, 1116, 10.1049/el.2009.2301

Gafurov, D., and Snekkenes, E. (2009). Gait recognition using wearable motion recording sensors. EURASIP J. Adv. Signal Proc., 7.

Del Pozo, G.B., Sánchez-Ávila, C., De-Santos-Sierra, A., and Guerra-Casanova, J. (2012). Speed-independent gait identification for mobile devices. Int. J. Pattern Recognit. Artif. Intell., 26.

Hoang, T., Choi, D., Vo, V., Nguyen, A., and Nguyen, T. (2013). Security and Privacy Protection in Information Processing Systems, Springer.

Choi, S., Youn, I.H., LeMay, R., Burns, S., and Youn, J.H. (2014, January 3–6). Biometric gait recognition based on wireless acceleration sensor using k-nearest neighbor classification. Proceedings of the International Conference on Computing, Networking and Communications (ICNC), Honolulu, HI, USA.

Bours, P., and Shrestha, R. (2010, January 26–28). Eigensteps: A giant leap for gait recognition. Proceedings of the 2nd International Workshop on Security and Communication Networks (IWSCN), Karlstad, Sweden.

Sun, 2012, Accelerometer-based gait authentication via neural network, Chin. J. Electron., 21, 481

Moeslund, 2006, A survey of advances in vision-based human motion capture and analysis, Comput. Vis. Image Underst., 104, 90, 10.1016/j.cviu.2006.08.002

Trung, N.T., Makihara, Y., Nagahara, H., Mukaigawa, Y., and Yagi, Y. (April, January 29). Performance evaluation of gait recognition using the largest inertial sensor-based gait database. Proceedings of the 5th IAPR International Conference on Biometrics (ICB), New Delhi, India.

Wagner, 2012, Toward a Practical Face Recognition System: Robust Alignment and Illumination by Sparse Representation, IEEE Trans. Pattern Anal. Mach. Intell., 34, 372, 10.1109/TPAMI.2011.112

Maria, D.M. (2014). Face Recognition in Adverse Conditions, IGI Global.

Mjaaland, B., Bours, P., and Gligoroski, D. (2009, January 24–25). Gait Mimicking—Attack Resistance Testing of Gait Authentication Systems. Proceedings of the Norwegian Information Security Conference (NISK), Trondheim, Norway.