Data fusion and multiple classifier systems for human activity detection and health monitoring: Review and open research directions

Cao, 2017, GCHAR: an efficient Group-based Context–aware human activity recognition on smartphone, J. Parallel Distrib. Comput., 118, 67 Gravina, 2017, Cloud-based Activity-Service cyber–physical framework for human activity monitoring in mobility, Fut. Gen. Comput. Syst., 75, 158, 10.1016/j.future.2016.09.006 Cornacchia, 2017, A survey on activity detection and classification using wearable sensors, IEEE Sens. J., 17, 386, 10.1109/JSEN.2016.2628346 Shoaib, 2016, Complex human activity recognition using smartphone and wrist-worn motion sensors, Sens. (Basel, Switzerland), 16, 426, 10.3390/s16040426 Mendes, 2017, Data driven multi-agent m-health system to characterize the daily activities of elderly people, 1 Ponti, 2017, Better than counting seconds: identifying fallers among healthy elderly using fusion of accelerometer features and dual-task Timed Up and Go, PLoS One, 12, 10.1371/journal.pone.0175559 Yu, 2012, A posture recognition-based fall detection system for monitoring an elderly person in a smart home environment, IEEE Trans. Inf. Technol. Biomed., 16, 1274, 10.1109/TITB.2012.2214786 J. Wang, Y. Chen, S. Hao, X. Peng, L. Hu, Deep learning for sensor-based activity recognition: a survey, arXiv:1707.03502, (2017). Ijjina, 2016, Human action recognition using genetic algorithms and convolutional neural networks, Pattern Recognit., 59, 199, 10.1016/j.patcog.2016.01.012 R.M. Cichy, A. Khosla, D. Pantazis, A. Torralba, A. Oliva, Deep neural networks predict hierarchical spatio-temporal cortical dynamics of human visual object recognition, arXiv:1601.02970, (2016). Hossain, 2017, Cloud-supported cyber–physical localization framework for patients monitoring, IEEE Syst. J., 11, 118, 10.1109/JSYST.2015.2470644 Shoaib, 2015, A survey of online activity recognition using mobile phones, Sensors, 15, 2059, 10.3390/s150102059 Tao, 2016, Multicolumn bidirectional long short-term memory for mobile devices-based human activity recognition, IEEE Internet Things J., 3, 1124, 10.1109/JIOT.2016.2561962 Qiu, 2018, Inertial/magnetic sensors based pedestrian dead reckoning by means of multi-sensor fusion, Inf. Fusion, 39, 108, 10.1016/j.inffus.2017.04.006 Sun, 2017, Indoor corner recognition from crowdsourced trajectories using smartphone sensors, Expert Syst. Appl., 82, 266, 10.1016/j.eswa.2017.04.024 Jia, 2016, Fusing social networks with deep learning for volunteerism tendency prediction Savazzi, 2016, Device-free human sensing and localization in collaborative human–robot workspaces: a case study, IEEE Sens. J., 16, 1253, 10.1109/JSEN.2015.2500121 Chen, 2017, A survey of depth and inertial sensor fusion for human action recognition, Multimed. Tools Appl., 76, 4405, 10.1007/s11042-015-3177-1 Banos, 2013, Activity Recognition based on a multi-sensor meta-classifier, 208 Yang, 2015, Deep convolutional neural networks on multichannel time series for human activity recognition, 3995 Hur, 2017, Smartphone Location-independent physical activity recognition based on transportation natural vibration analysis, Sensors, 17, 931, 10.3390/s17040931 Morales, 2017, Physical activity recognition by smartphones, a survey, Biocybernet. Biomed. Eng., 37, 388, 10.1016/j.bbe.2017.04.004 Bulling, 2014, A tutorial on human activity recognition using body-worn inertial sensors, ACM Computing Surveys (CSUR), 46, 33, 10.1145/2499621 Pires, 2016, From data acquisition to data fusion: a comprehensive review and a roadmap for the identification of activities of daily living using mobile devices, Sensors, 16, 10.3390/s16020184 Zhang, 2017, Coal-rock recognition in top coal caving using bimodal deep learning and hilbert-huang transform, Shock Vib., 2017 S.-M. Lee, S.M. Yoon, H. Cho, Human activity recognition from accelerometer data using Convolutional Neural Network, in, Proceedings of the IEEE, pp. 131–134. Ravì, 2017, A deep learning approach to on-node sensor data analytics for mobile or wearable devices, IEEE J. Biomed. Health Inform., 21, 56, 10.1109/JBHI.2016.2633287 Banos, 2014, Window size impact in human activity recognition, Sensors, 14, 6474, 10.3390/s140406474 Xu, 2016, Wearable sensor-based human activity recognition method with multi-features extracted from hilbert-huang transform, Sensors, 16, 10.3390/s16122048 LeCun, 2015, Deep learning, Nature, 521, 436, 10.1038/nature14539 Ordonez, 2016, Deep convolutional and LSTM recurrent neural networks for multimodal wearable activity recognition, Sensors (Basel, Switzerland), 16, 10.3390/s16010115 Atallah, 2011, Sensor Positioning for activity recognition using wearable accelerometers, IEEE Trans. Biomed. Circuits Syst., 5, 320, 10.1109/TBCAS.2011.2160540 Machado, 2015, Human activity data discovery from triaxial accelerometer sensor: non-supervised learning sensitivity to feature extraction parametrization, Inf. Process. Manag., 51, 204, 10.1016/j.ipm.2014.07.008 Gao, 2011, A system for activity recognition using multi-sensor fusion, 2011, 7869 Maurer, 2006, Activity recognition and monitoring using multiple sensors on different body positions, 4 Chen, 2017, Robust human activity recognition using smartphone sensors via CT-PCA and online SVM, IEEE Trans. Ind. Inf., 13, 3070, 10.1109/TII.2017.2712746 Ronao, 2017, Recognizing human activities from smartphone sensors using hierarchical continuous hidden Markov models, Int. J. Distrib. Sens. Netw., 13, 10.1177/1550147716683687 Banos, 2012, On the use of sensor fusion to reduce the impact of rotational and additive noise in human activity recognition, Sensors, 12, 8039, 10.3390/s120608039 Abdelgawad, 2012, Data Fusion in WSN, 17 Wang, 2016, A Triaxial Accelerometer-based human activity recognition via EEMD-based features and game-theory-based feature selection, IEEE Sens. J., 16, 3198, 10.1109/JSEN.2016.2519679 Kuncheva, 2004 Jurek, 2014, Clustering-based ensemble learning for activity recognition in smart homes, Sensors (Basel, Switzerland), 14, 12285, 10.3390/s140712285 Kuncheva, 2003, Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy, Mach. Learn., 51, 181, 10.1023/A:1022859003006 Hwang, 2016, Ensemble of deep neural networks using acoustic environment classification for statistical model-based voice activity detection, Comput. Speech Lang., 38, 1, 10.1016/j.csl.2015.11.003 Ijjina, 2016, Hybrid deep neural network model for human action recognition, Appl. Soft. Comput., 46, 936, 10.1016/j.asoc.2015.08.025 Attal, 2015, Physical human activity recognition using wearable sensors, Sensors, 15, 31314, 10.3390/s151229858 Onofri, 2016, A survey on using domain and contextual knowledge for human activity recognition in video streams, Expert Syst. Appl., 63, 97, 10.1016/j.eswa.2016.06.011 Turaga, 2008, Machine recognition of human activities: a survey, IEEE Trans. Circuits Syst. Video Technol., 18, 1473, 10.1109/TCSVT.2008.2005594 Gravina, 2017, Multi-sensor fusion in body sensor networks: State-of-the-art and research challenges, Inf. Fus., 35, 68, 10.1016/j.inffus.2016.09.005 King, 2017, Application of data fusion techniques and technologies for wearable health monitoring, Med. Eng. Phys., 42, 1, 10.1016/j.medengphy.2016.12.011 Sebestyen, 2016, Human activity recognition and monitoring for elderly people, 341 Luo, 2011, Multisensor Fusion and integration: theories, applications, and its perspectives, IEEE Sens. J., 11, 3122, 10.1109/JSEN.2011.2166383 Yao, 2017, DeepSense: a unified deep learning framework for time-series mobile sensing data processing, 351 Luo, 1990, A tutorial on multisensor integration and fusion, 707 Lee, 2008, 3 Song-Mi, 2017, Human activity recognition from accelerometer data using Convolutional Neural Network, 131 Kalman, 1960, A new approach to linear filtering and prediction problems, J. Basic Eng., 82, 35, 10.1115/1.3662552 Tunca, 2017, Inertial sensor-based robust gait analysis in non-hospital settings for neurological disorders, Sensors, 17, 825, 10.3390/s17040825 Roetenberg, 2007, Ambulatory position and orientation tracking fusing magnetic and inertial sensing, IEEE Trans. Biomed. Eng., 54, 883, 10.1109/TBME.2006.889184 Zhu, 2004, A real-time articulated human motion tracking using tri-axis inertial/magnetic sensors package, IEEE Trans. Neural Syst. Rehabil. Eng., 12, 295, 10.1109/TNSRE.2004.827825 Al-Jawad, 2013, The use of an orientation Kalman filter for the static postural sway analysis, APCBEE Proc., 7, 93, 10.1016/j.apcbee.2013.08.018 Chen, 2011, An algorithm of mobile sensors data fusion tracking for wireless sensor networks, Wirel. Person. Commun., 58, 197, 10.1007/s11277-009-9888-8 Fox, 2003, Bayesian filtering for location estimation, IEEE Perv. Comput, 2, 24, 10.1109/MPRV.2003.1228524 Huadong, 2002, Sensor fusion using Dempster–Shafer theory [for context-aware HCI], 11, 7 Altun, 2010, Human Activity recognition using inertial/magnetic sensor units, 38 Zhu, 2010, Human activity recognition via motion and vision data fusion, 332 Crispim-Junior, 2015, Combining multiple sensors for event detection of older people, 179 Sebbak, 2017, Majority-consensus fusion approach for elderly IoT-based healthcare applications, Ann. Telecommun., 72, 157, 10.1007/s12243-016-0550-7 Tsai, 2014, A framework for fusion of human sensor and physical sensor data, IEEE Trans. Syst. Man. Cybernet., 44, 1248, 10.1109/TSMC.2014.2309090 Zhao, 2015, COUPON: a cooperative framework for building sensing maps in mobile opportunistic networks, IEEE Trans. Parallel Distrib. Syst., 26, 392, 10.1109/TPDS.2014.2308178 Phan, 2014, Sensor fusion of physical and social data using Web SocialSense on smartphone mobile browsers, 98 Chetty, 2016, Body sensor networks for human activity recognition, 660 Wang, 2016, A comparative study on human activity recognition using inertial sensors in a smartphone, IEEE Sens. J., 16, 4566, 10.1109/JSEN.2016.2545708 Zainudin, 2015, Activity recognition based on accelerometer sensor using combinational classifiers, 68 Tamura, 2006, Wearable accelerometer in clinical use, 7165 Ermes, 2008, Detection of daily activities and sports with wearable sensors in controlled and uncontrolled conditions, IEEE Trans. Inf. Technol. Biomed., 12, 20, 10.1109/TITB.2007.899496 Banos, 2014, Dealing with the effects of sensor displacement in wearable activity recognition, Sensors, 14, 9995, 10.3390/s140609995 Cao, 2012, E-FallD: a fall detection system using android-based smartphone, 1509 Mantyjarvi, 2001, Recognizing human motion with multiple acceleration sensors, 742, 747 Karantonis, 2006, Implementation of a real-time human movement classifier using a triaxial accelerometer for ambulatory monitoring, IEEE Trans. Inf. Technol. Biomed., 10, 156, 10.1109/TITB.2005.856864 Surana, 2013, Adaptive learning based human activity and fall detection using fuzzy frequent pattern mining, 744 Yi, 2014, Wearable sensor data fusion for remote health assessment and fall detection, 303 Taylor, 2011, Activity classification with smart phones for sports activities, Proc. Eng., 13, 428, 10.1016/j.proeng.2011.05.109 Koshmak, 2013, Evaluation of the android-based fall detection system with physiological data monitoring, 1164 You, 2017, A smartphone-based wearable sensors for monitoring real-time physiological data, Comput. Electr. Eng., 65, 376 Lan, 2014, An intelligent driver location system for smart parking, Expert Syst. Appl., 41, 2443, 10.1016/j.eswa.2013.09.044 Chen, 2016, IEEE, an improved algorithm for human activity recognition using wearable sensors, 248 Bayat, 2014, A study on human activity recognition using accelerometer data from smartphones, 450 Banos, 2015, Multi-sensor fusion based on asymmetric decision weighting for robust activity recognition, Neural Process. Lett., 42, 5, 10.1007/s11063-014-9395-0 Janidarmian, 2017, A Comprehensive analysis on wearable acceleration sensors in human activity recognition, Sensors, 17, 26, 10.3390/s17030529 Ugulino, 2012, Wearable computing: accelerometers’ data classification of body postures and movements, Adv. Artif. Intell. SBIA, 2012, 52 Bruno, 2013, Analysis of human behavior recognition algorithms based on acceleration data, 1602 Casale, 2012, Personalization and user verification in wearable systems using biometric walking patterns, Pers. Ubiquit. Comput., 16, 563, 10.1007/s00779-011-0415-z Atallah, 2009, Real-time activity classification using ambient and wearable sensors, IEEE T. Inf. Technol. Biomed., 13, 1031, 10.1109/TITB.2009.2028575 Ustev, 2013, User, device and orientation independent human activity recognition on mobile phones: challenges and a proposal, 1427 I. Mishkhal, Human activity recognition based on accelerometer and gyroscope sensors, Master’s theses submitted to the Graduate School by Ball State University master’s degree candidates in partial fulfillment of degree requirements, 2017, Page 52. Ghassemzadeh, 2009, A motion sequence fusion technique based on PCA for activity analysis in body sensor networks, 3146 Kwon, 2014, Unsupervised learning for human activity recognition using smartphone sensors, Expert Syst. Appl., 41, 6067, 10.1016/j.eswa.2014.04.037 Dernbach, 2012, Simple and complex activity recognition through smart phones, 214 Chiang, 2014, Pattern analysis in daily physical activity data for personal health management, Pervas. Mob. Comput., 13, 13, 10.1016/j.pmcj.2013.12.003 Zhu, 2009, Multi-sensor fusion for human daily activity recognition in robot-assisted living, 303 Spinsante, 2016, a mobile application for easy design and testing of algorithms to monitor physical activity in the workplace, Mob. Inf. Syst., 2016, 1 Chen, 2017, A hierarchical method for human concurrent activity recognition using miniature inertial sensors, Sens. Rev., 37, 101, 10.1108/SR-05-2016-0085 Almaslukh, 2017, An effective deep autoencoder approach for online smartphone-based human activity recognition, Int. J. Comput. Sci. Netw. Secur. (IJCSNS), 17, 160 Jiang, 2015, Human activity recognition using wearable sensors by deep convolutional neural networks, 1307 Brüser, 2015, Improvement of force-sensor-based heart rate estimation using multichannel data fusion, IEEE J. Biomed. Health Inf., 19, 227, 10.1109/JBHI.2014.2311582 Davis, 2016, Activity recognition based on inertial sensors for ambient assisted living, 371 Ghose, 2015, Human activity recognition from smart-phone sensor data using a multi-class ensemble learning in home monitoring, Stud. Health Technol. Inform., 214, 62 Bahrepour, 2011, Sensor fusion-based activity recognition for Parkinson patients, InTech Berenguer, 2017, Evolution of activities of daily living using inertia measurements: the lunch and dinner activities, J. Int. Soc. Telemed. eHealth, 5, 10 Schwickert, 2016, Inertial sensor based analysis of lie-to-stand transfers in younger and older adults, Sensors, 16, 1277, 10.3390/s16081277 Lee, 2015, Inertial sensing-based pre-impact detection of falls involving near-fall scenarios, IEEE Trans. Neural Syst. Rehabil. Eng., 23, 258, 10.1109/TNSRE.2014.2357806 He, 2013, Physical activity recognition utilizing the built-in kinematic sensors of a smartphone, Int. J. Distrib. Sens. Netw., 9, 10.1155/2013/481580 Salah, 2013, Anfis-based sensor fusion system of sit-to-stand for elderly people assistive device protocols, Int. J. Autom. Comput., 10, 405, 10.1007/s11633-013-0737-6 Chetty, 2014, IEEE, multimodal activity recognition based on automatic feature discovery, 632 Saeedi, 2015, Activity recognition using fusion of low-cost sensors on a smartphone for mobile navigation application, Micromachines, 6, 1100, 10.3390/mi6081100 Saeedi, 2014, Context-aware personal navigation using embedded sensor fusion in smartphones, Sensors, 14, 5742, 10.3390/s140405742 Shoaib, 2015, Towards detection of bad habits by fusing smartphone and smartwatch sensors, 591 Zhu, 2017, Feature extraction for robust physical activity recognition, Hum. Centric Comput. Inf. Sci., 7, 16, 10.1186/s13673-017-0097-2 Parkka, 2006, Activity classification using realistic data from wearable sensors, IEEE T. Inf. Technol. Biomed., 10, 119, 10.1109/TITB.2005.856863 Li, 2010, Multimodal physical activity recognition by fusing temporal and cepstral information, IEEE Trans. Neural Syst. Rehabil. Eng., 18, 369, 10.1109/TNSRE.2010.2053217 Tapia, 2007, Real-time recognition of physical activities and their intensities using wireless accelerometers and a heart rate monitor, 37 Roy, 2009, A combined sEMG and accelerometer system for monitoring functional activity in stroke, IEEE Trans. Neural Syst. and Rehabil. Eng. Publ. IEEE Eng. Med. Biol. Soc., 17, 585, 10.1109/TNSRE.2009.2036615 Lin, 2012, A wearable sensor module with a neural-network-based activity classification algorithm for daily energy expenditure estimation, IEEE T. Inf. Technol. Biomed., 16, 991, 10.1109/TITB.2012.2206602 Fujimoto, 2013, Wearable human activity recognition by electrocardiograph and accelerometer, 12 Zdravevski, 2017, Improving activity recognition accuracy in ambient-assisted living systems by automated feature engineering, IEEE Access, 5, 5262, 10.1109/ACCESS.2017.2684913 Jia, 2013, Human daily activity recognition by fusing accelerometer and multi-lead ECG data, 1 Min, 2011, Activity recognition based on wearable sensors using selection/fusion hybrid ensemble, 1319 Lara, 2012, Centinela: a human activity recognition system based on acceleration and vital sign data, Pervas. Mob. Comput., 8, 717, 10.1016/j.pmcj.2011.06.004 Martín, 2011, Enhancing activity recognition by fusing inertial and biometric information, 1 Nam, 2013, Child activity recognition based on cooperative fusion model of a triaxial accelerometer and a barometric pressure sensor, IEEE J. Biomed. Health Inf., 17, 420, 10.1109/JBHI.2012.2235075 Iglesias, 2011, A ubiquitous activity-monitor to prevent sedentariness, 319 Riboni, 2011, COSAR: hybrid reasoning for context-aware activity recognition, Pers. Ubiquit. Comput., 15, 271, 10.1007/s00779-010-0331-7 Xiao, 2017, Identifying Different transportation modes from trajectory data using tree-based ensemble classifiers, ISPRS Int. J. Geo Inf., 6 Chernbumroong, 2014, A practical multi-sensor activity recognition system for home-based care, Decis. Support Syst., 66, 61, 10.1016/j.dss.2014.06.005 Fleury, 2010, SVM-based multimodal classification of activities of daily living in health smart homes: sensors, algorithms, and first experimental results, IEEE Trans. Inf. Technol. Biomed., 14, 274, 10.1109/TITB.2009.2037317 Tunca, 2014, Multimodal wireless sensor network-based ambient assisted living in real homes with multiple residents, Sensors, 14, 9692, 10.3390/s140609692 De, 2015, Multimodal wearable sensing for fine-grained activity recognition in healthcare, IEEE Internet Comput., 19, 26, 10.1109/MIC.2015.72 Chernbumroong, 2013, Elderly activities recognition and classification for applications in assisted living, Expert Syst. Appl., 40, 1662, 10.1016/j.eswa.2012.09.004 Bellos, 2011, Heterogeneous data fusion and intelligent techniques embedded in a mobile application for real-time chronic disease management, 8303 Gong, 2012, MPD-Model: a distributed multipreference-driven data fusion model and its application in a WSNs-based healthcare monitoring system, Int. J. Distrib. Sens. Netw., 8, 10.1155/2012/602358 van de Ven, 2009, Integration of a suite of sensors in a wireless health sensor platform, 1678 Khattak, 2011, Intelligent Healthcare service provisioning using ontology with low-level sensory data, KSII Trans. Internet Inf. Syst., 5, 2016 Yuan, 2012, Fuzzy CARA – a fuzzy-based context reasoning system for pervasive healthcare, Proc. Comput. Sci., 10, 357, 10.1016/j.procs.2012.06.047 Khan, 2014, Activity recognition on smartphones via sensor-fusion and KDA-based SVMs, Int. J. Distrib. Sens. Netw., 14 Chen, 2014, A locomotion intent prediction system based on multi-sensor fusion, Sensors, 14, 12349, 10.3390/s140712349 Ozcan, 2016, Wearable camera- and accelerometer-based fall detection on portable devices, IEEE Embedded Syst. Lett., 8, 6, 10.1109/LES.2015.2487241 Zhan, 2015, Multi-scale conditional random fields for first-person activity recognition on elders and disabled patients, Pervas. Mob. Comput., 16, 251, 10.1016/j.pmcj.2014.11.004 Wu, 2011, Change-of-state determination to recognize mobility activities using a BlackBerry smartphone, 5252 Doherty, 2013, Using wearable cameras to categorise type and context of accelerometer-identified episodes of physical activity, Int. J. Behav. Nutr. Phys. Act., 10, 22, 10.1186/1479-5868-10-22 Delachaux, 2013, Indoor activity recognition by combining one-vs.-all neural network classifiers exploiting wearable and depth sensors, 216 Wichit, 2014, Multisensor data fusion model for activity detection, 54 Banos, 2016, Human behavior analysis by means of multimodal context mining, Sensors, 16 Chen, 2015, Improving Human Action recognition using fusion of depth camera and inertial sensors, IEEE Trans. Hum. Mach. Syst., 45, 51, 10.1109/THMS.2014.2362520 Li, 2013, Daily life event segmentation for lifestyle evaluation based on multi-sensor data recorded by a wearable device, 2858 Spriggs, 2009, Temporal segmentation and activity classification from first-person sensing, 17 Zhang, 2017, Automatic sleep stage classification of single-channel EEG by using complex-valued convolutional neural network, Biomed. Eng. Biomed. Tech. Alberdi, 2016, Towards an automatic early stress recognition system for office environments based on multimodal measurements: a review, J. Biomed. Inf., 59, 49, 10.1016/j.jbi.2015.11.007 Zhang, 2015, Improving activity recognition with context information, 1241 Jia, 2014, A novel semi-supervised deep learning framework for affective state recognition on eeg signals, 30 Xu, 2016, EEG-based affect states classification using Deep Belief Networks, 148 Wu, 2016, A novel method for classification of ecg arrhythmias using deep belief networks, Int. J. Comput. Intell. Appl., 15 Längkvist, 2012, Sleep stage classification using unsupervised feature learning, Adv. Artif. Neural Syst., 2012, 5 Cinaz, 2013, Monitoring of mental workload levels during an everyday life office-work scenario, Pers. Ubiquit. Comput., 17, 229, 10.1007/s00779-011-0466-1 Rajesh, 2018, Classification of imbalanced ECG beats using re-sampling techniques and AdaBoost ensemble classifier, Biomed. Signal Process. Control, 41, 242, 10.1016/j.bspc.2017.12.004 Lu, 2018, Feature fusion for imbalanced ECG data analysis, Biomed. Signal Process. Control, 41, 152, 10.1016/j.bspc.2017.11.010 Li, 2016, Ecg classification using wavelet packet entropy and random forests, Entropy, 18, 285, 10.3390/e18080285 Verma, 2014, Multimodal fusion framework: a multiresolution approach for emotion classification and recognition from physiological signals, Neuroimage, 102, 162, 10.1016/j.neuroimage.2013.11.007 Shoaib, 2016, Complex human activity recognition using smartphone and wrist-worn motion sensors, Sensors, 16, 426, 10.3390/s16040426 Xu, 2016, An Activity recognition algorithm based on multi-feature fuzzy cluster, 2, 363 Ayachi, 2016, The use of empirical mode decomposition-based algorithm and inertial measurement units to auto-detect daily living activities of healthy adults, IEEE Trans. Neural Syst. Rehabil. Eng., 24, 1060, 10.1109/TNSRE.2016.2519413 Banos, 2015, Multiwindow fusion for wearable activity recognition, 290 Aly, 2015, ubiMonitor: intelligent fusion of body-worn sensors for real-time human activity recognition, I and II, 563 Gu, 2016, PAWS: passive human activity recognition based on wifi ambient signals, IEEE Internet Things J., 3, 796, 10.1109/JIOT.2015.2511805 Dobbins, 2017, Detecting physical activity within lifelogs towards preventing obesity and aiding ambient assisted living, Neurocomputing, 230, 110, 10.1016/j.neucom.2016.02.088 Chandrashekar, 2014, A survey on feature selection methods, Comput. Electr. Eng., 40, 16, 10.1016/j.compeleceng.2013.11.024 Fong, 2017, Training classifiers with shadow features for sensor-based human activity recognition, Sensors, 17 Abidine, 2016, The joint use of sequence features combination and modified weighted SVM for improving daily activity recognition, Pattern Anal. Appl., 21, 119, 10.1007/s10044-016-0570-y Plötz, 2011, Feature learning for activity recognition in ubiquitous computing, 1729 Guyon, 2003, An introduction to variable and feature selection, J. Mach. Learn. Res., 3, 1157 Wang, 2017, Wrapper-based gene selection with Markov blanket, Comput. Biol. Med., 81, 11, 10.1016/j.compbiomed.2016.12.002 Liu, 2011, SVM-based multi-sensor fusion for free-living physical activity assessment, 2011, 3188 Capela, 2015, Feature selection for wearable smartphone-based human activity recognition with able bodied, elderly, and stroke patients, PLoS ONE, 10, 10.1371/journal.pone.0124414 Ghasemzadeh, 2015, Power-aware computing in wearable sensor networks: an optimal feature selection, IEEE Trans. Mob. Comput., 14, 800, 10.1109/TMC.2014.2331969 Wei, 2017, A novel hierarchical selective ensemble classifier with bioinformatics application, Artif. Intell. Med., 83, 82, 10.1016/j.artmed.2017.02.005 Li, 2017, Elitist binary wolf search algorithm for heuristic feature selection in high-dimensional bioinformatics datasets, Sci. Rep., 7, 4354, 10.1038/s41598-017-04037-5 Althloothi, 2014, Human activity recognition using multi-features and multiple kernel learning, Pattern Recognit., 47, 1800, 10.1016/j.patcog.2013.11.032 Shen, 2016, On motion-sensor behavior analysis for human-activity recognition via smartphones, 1 Nam, 2013, Physical activity recognition using multiple sensors embedded in a wearable device, ACM Trans. Embed. Comput. Syst. (TECS), 12, 26 Azhar, 2017, Hierarchical relaxed partitioning system for activity recognition, IEEE Trans. Cybernet., 47, 784, 10.1109/TCYB.2016.2526970 Uddin, 2015, A guided random forest based feature selection approach for activity recognition, 1 Najjar, 2015, Better-than-the-best fusion algorithm with application in human activity recognition, 949805 Li, 2017, Passive wireless sensing for unsupervised human activity recognition in healthcare, 1528 Grunerbl, 2015, Smartphone-based recognition of states and state changes in bipolar disorder patients, IEEE J. Biomed. Health Inf., 19, 140, 10.1109/JBHI.2014.2343154 Ward, 2006, Activity recognition of assembly tasks using body-worn microphones and accelerometers, IEEE Trans. Pattern Anal. Mach. Intell., 28, 1553, 10.1109/TPAMI.2006.197 Wang, 2017, Kernel fusion based extreme learning machine for cross-location activity recognition, Inf. Fusion, 37, 1, 10.1016/j.inffus.2017.01.004 Sikder, 2017, Log-sum distance measures and its application to human-activity monitoring and recognition using data from motion sensors, IEEE Sens. J., 17, 4520, 10.1109/JSEN.2017.2707921 Peng, 2016, Hierarchical complex activity representation and recognition using topic model and classifier level fusion, IEEE Trans. Biomed. Eng. Abeyruwan, 2016, Semi-automatic extraction of training examples from sensor readings for fall detection and posture monitoring, IEEE Sens. J., 16, 5406, 10.1109/JSEN.2016.2559804 Guo, 2016, Deep learning for visual understanding: a review, Neurocomputing, 187, 27, 10.1016/j.neucom.2015.09.116 Ravi, 2016, A deep learning approach to on-node sensor data analytics for mobile or wearable devices, IEEE J. Biomed. Health Inf. Ronao, 2016, Human activity recognition with smartphone sensors using deep learning neural networks, Expert Syst. Appl., 59, 235, 10.1016/j.eswa.2016.04.032 Hinton, 2006, A fast learning algorithm for deep belief nets, Neural Comput., 18, 1527, 10.1162/neco.2006.18.7.1527 Deng, 2014, A tutorial survey of architectures, algorithms, and applications for deep learning, APSIPA Trans. Signal Inf. Process., 3, e2, 10.1017/atsip.2013.9 Hinton, 1986, Learning and releaming in Boltzmann machines, Parallel Distril. Process., 1 Fischer, 2014, Training restricted Boltzmann machines: An introduction, Pattern Recognit., 47, 25, 10.1016/j.patcog.2013.05.025 Cho, 2011, Enhanced gradient and adaptive learning rate for training restricted Boltzmann machines, 105 Nair, 2010, Rectified linear units improve restricted Boltzmann machines, 807 Li, 2016, Temperature based restricted Boltzmann machines, Sci. Rep., 6, 1 Salakhutdinov, 2010, Efficient learning of deep Boltzmann machines, 693 Younes, 1999, On the convergence of Markovian stochastic algorithms with rapidly decreasing ergodicity rates, Stochast. Int. J. Prob. Stochast. Process., 65, 177 M.A. Alsheikh, A. Selim, D. Niyato, L. Doyle, S. Lin, H.-P. Tan, Deep Activity Recognition Models with Triaxial Accelerometers, arXiv:1511.04664, (2015). Bhattacharya, 2016, From smart to deep: Robust activity recognition on smartwatches using deep learning, 1 Lane, 2016, Accelerating embedded deep learning using DeepX: demonstration abstract, 61 Wang, 2016, Recognition of human activities using continuous autoencoders with wearable sensors, Sensors, 16, 189, 10.3390/s16020189 Zhang, 2014, Coarse-to-fine auto-encoder networks (CFAN) for real-time face alignment, 1 Vincent, 2008, Extracting and composing robust features with denoising autoencoders, 1096 Marc'Aurelio Ranzato, 2007, Efficient learning of sparse representations with an energy-based model Rifai, 2011, Contractive auto-encoders: Explicit invariance during feature extraction, 833 Song, 2017, An evolutionary deep neural network for predicting morbidity of gastrointestinal infections by food contamination, Neurocomputing, 226, 16, 10.1016/j.neucom.2016.11.018 Zhou, 2015, Motion recognition by using a stacked autoencoder-based deep learning algorithm with smart phones, 778 Olshausen, 1997, Sparse coding with an overcomplete basis set: a strategy employed by V1?, Vis. Res., 37, 3311, 10.1016/S0042-6989(97)00169-7 Ding, 2016, Sparse codes fusion for context enhancement of night video surveillance, Multimed. Tools Appl., 75, 11221, 10.1007/s11042-015-2844-6 Bhattacharya, 2014, Using unlabeled data in a sparse-coding framework for human activity recognition, Pervas. Mob. Comput., 15, 242, 10.1016/j.pmcj.2014.05.006 Guo, 2014, Structural health monitoring by using a sparse coding-based deep learning algorithm with wireless sensor networks, Pers. Ubiquit. Comput., 18, 1977, 10.1007/s00779-014-0800-5 LeCun, 2004, Learning methods for generic object recognition with invariance to pose and lighting, II Wang, 2017, Three-stream CNNs for action recognition, Pattern Recognit. Lett., 92, 33, 10.1016/j.patrec.2017.04.004 Erfani, 2016, High-dimensional and large-scale anomaly detection using a linear one-class SVM with deep learning, Pattern Recognit., 58, 121, 10.1016/j.patcog.2016.03.028 Ravì, 2017, A deep learning approach to on-node sensor data analytics for mobile or wearable devices, IEEE J. Biomed. Health Inf., 21, 56, 10.1109/JBHI.2016.2633287 A. Sathyanarayana, S. Joty, L. Fernandez-Luque, F. Ofli, J. Srivastava, A. Elmagarmid, S. Taheri, T. Arora, Impact of physical activity on sleep: a deep learning based exploration, arXiv:1607.07034, (2016). N.Y. Hammerla, S. Halloran, T. Ploetz, Deep, convolutional, and recurrent models for human activity recognition using wearables, arXiv:1604.08880, (2016). Ravi, 2016, Deep learning for human activity recognition: a resource efficient implementation on low-power devices, 71 Hochreiter, 1997, Long short-term memory, Neural Comput., 9, 1735, 10.1162/neco.1997.9.8.1735 Graves, 2013, Generating sequences with recurrent neural networks, 16, 115 K. Cho, B. Van Merriënboer, C. Gulcehre, D. Bahdanau, F. Bougares, H. Schwenk, Y. Bengio, Learning phrase representations using RNN encoder-decoder for statistical machine translation, arXiv:1406.1078, (2014). S. Valipour, M. Siam, M. Jagersand, N. Ray, Recurrent fully convolutional networks for video segmentation, arXiv:1606.00487, (2016). J. Chung, C. Gulcehre, K. Cho, Y. Bengio, Empirical evaluation of gated recurrent neural networks on sequence modeling, arXiv:1412.3555, (2014). Chen, 2017, LSTM networks for mobile human activity recognition, 1, 152 Edel, 2016, Binarized-BLSTM-RNN based human activity recognition, 1 M. Inoue, S. Inoue, T. Nishida, Deep recurrent neural network for mobile human activity recognition with high throughput, arXiv:1611.03607, (2016). Y. Guan, T. Ploetz, Ensembles of Deep LSTM learners for activity recognition using wearables, arXiv:1703.09370, (2017). X. Li, Y. Zhang, J. Zhang, S. Chen, I. Marsic, R.A. Farneth, R.S. Burd, Concurrent activity recognition with multimodal CNN-LSTM structure, arXiv:1702.01638, (2017). Ordóñez, 2016, Deep convolutional and lstm recurrent neural networks for multimodal wearable activity recognition, Sensors, 16, 115, 10.3390/s16010115 Zhao, 2017, Learning to monitor machine health with convolutional bi-directional LSTM networks, Sensors, 17, 273, 10.3390/s17020273 Vincent, 2010, Stacked denoising autoencoders: learning useful representations in a deep network with a local denoising criterion, J. Mach. Learn. Res., 11, 3371 M. Chen, Z. Xu, K. Weinberger, F. Sha, Marginalized denoising autoencoders for domain adaptation, arXiv:1206.4683, (2012). Ng, 2011, Sparse autoencoder, 72, 1 Schulz, 2015, Two-layer contractive encodings for learning stable nonlinear features, Neural Netw., 64, 4, 10.1016/j.neunet.2014.09.008 Harandi, 2012, Sparse coding and dictionary learning for symmetric positive definite matrices: a kernel approach, 216 He, 2014, Unsupervised feature learning by deep sparse coding, 902 C.-Y. Ma, M.-H. Chen, Z. Kira, G. AlRegib, TS-LSTM and temporal-inception: exploiting spatiotemporal dynamics for activity recognition, arXiv:1703.10667, (2017). Ijjina, 2016, Hybrid deep neural network model for human action recognition, Appl. Soft Comput., 46, 936, 10.1016/j.asoc.2015.08.025 S.S. Khan, B. Taati, Detecting unseen falls from wearable devices using channel-wise ensemble of autoencoders, arXiv:1610.03761, (2016). Khan, 2017, Detecting unseen falls from wearable devices using channel-wise ensemble of autoencoders, Expert Syst. Appl., 87, 280, 10.1016/j.eswa.2017.06.011 Gao, 2016, A novel feature extraction method for scene recognition based on Centered Convolutional Restricted Boltzmann Machines, Neurocomputing, 214, 708, 10.1016/j.neucom.2016.06.055 Sarkar, 2016, Wearable EEG-based activity recognition in PHM-related service environment via deep learning, Int. J. Prognost. Health Manag., 7, 10 Zhang, 2016, Automatic sleep stage classification based on sparse deep belief net and combination of multiple classifiers, Trans. Inst. Meas. Control, 38, 435, 10.1177/0142331215587568 Neverova, 2016, Learning human identity from motion patterns, IEEE Access, 4, 1810, 10.1109/ACCESS.2016.2557846 Song, 2016, Multimodal multi-stream deep learning for egocentric activity recognition, 24 Morales, 2017, Physical activity recognition by smartphones, a survey, Biocybernet. Biomed. Eng., 37, 388, 10.1016/j.bbe.2017.04.004 S. Yao, S. Hu, Y. Zhao, A. Zhang, T. Abdelzaher, DeepSense: a unified deep learning framework for time-series mobile sensing data processing, arXiv:1611.01942, (2016). Sathyanarayana, 2016, Sleep quality prediction from wearable data using deep learning, JMIR mHealth uHealth, 4, 1 M. Alzantot, S. Chakraborty, M.B. Srivastava, SenseGen: a deep learning architecture for synthetic sensor data generation, arXiv:1701.08886, (2017). Alzantot, 2017, SenseGen: a deep learning architecture for synthetic sensor data generation, 188 Dietterich, 2000, Ensemble methods in machine learning, 1 Woźniak, 2014, A survey of multiple classifier systems as hybrid systems, Inf. Fusion, 16, 3, 10.1016/j.inffus.2013.04.006 Tumer, 1996, Analysis of decision boundaries in linearly combined neural classifiers, Pattern Recognit, 29, 341, 10.1016/0031-3203(95)00085-2 Freund, 1997, A decision-theoretic generalization of on-line learning and an application to boosting, J. Comput. System Sci., 55, 119, 10.1006/jcss.1997.1504 Sagha, 2013, On-line anomaly detection and resilience in classifier ensembles, Pattern Recognit. Lett., 34, 1916, 10.1016/j.patrec.2013.02.014 Fatima, 2013, A genetic algorithm-based classifier ensemble optimization for activity recognition in smart homes, TIIS, 7, 2853, 10.3837/tiis.2013.11.018 Tripathi, 2015, Acoustic sensor based activity recognition using ensemble of one-class classifiers, 7 Kumar, 2015, Multi-label learning for activity recognition, 2015, 152 Stork, 2012, Audio-based human activity recognition using non-Markovian ensemble voting, 509 Quinlan, 1986, Induction of decision trees, Mach. Learn., 1, 81, 10.1007/BF00116251 Friedl, 1997, Decision tree classification of land cover from remotely sensed data, Remote Sens. Environ., 61, 399, 10.1016/S0034-4257(97)00049-7 Rodriguez, 2016, Ensemble of One-Class Classifiers for personal risk detection based on wearable sensor data, Sensors (Basel, Switzerland), 16, 10.3390/s16101619 Farooq, 2016, Detection of chewing from piezoelectric film sensor signals using ensemble classifiers, 4929 Diep, 2016, Motion primitive forests for human activity recognition using wearable sensors, 340 Feng, 2015, A random forest-based ensemble method for activity recognition, 5074 Cortes, 1995, Support-vector networks, Mach. Learn., 20, 273, 10.1007/BF00994018 Mo, 2012, Multi-sensor ensemble classifier for activity recognition, J. Softw. Eng. Appl., 5, 113, 10.4236/jsea.2012.512B022 Mohammadi, 2016, Human activity recognition using an ensemble of support vector machines, 549 Kim, 2015, Hidden Markov model ensemble for activity recognition using tri-axis accelerometer, 3036 Fatima, 2013, Classifier ensemble optimization for human activity recognition in smart homes, 83 Ortiz, 2016, Ensembles of deep learning architectures for the early diagnosis of the Alzheimer's disease, Int. J. Neural Syst., 26 Arora, 2016, Random projections of Fischer Linear Discriminant classifier for multi-class classification, 165 AlZubi, 2014, Human activity classification using a single accelerometer, 273 Melville, 2005, Creating diversity in ensembles using artificial data, Inf. Fusion, 6, 99, 10.1016/j.inffus.2004.04.001 Chetty, 2015, Smart phone based data mining for human activity recognition, 1181 Mazaar, 2016, ACM, Ensemble based-feature selection on human activity recognition, 81 Rong, 2010, IEEE, recognizing human activities based on multi- sensors fusion Liu, 2016, Mining intricate temporal rules for recognizing complex activities of daily living under uncertainty, Pattern Recognit, 60, 1015, 10.1016/j.patcog.2016.07.024 Bulling, 2014, A tutorial on human activity recognition using body-worn inertial sensors, ACM Comput. Surv., 46, 1, 10.1145/2499621 Breiman, 1996, Bagging predictors, Mach. Learn., 24, 123, 10.1007/BF00058655 Freund, 1999, A short introduction to boosting, J. Jpn. Soc. Artif. Intell., 14, 1612 Breiman, 2001, Random forests, Mach. Learn., 45, 5, 10.1023/A:1010933404324 Chen, 2017, Performance analysis of smartphone-sensor behavior for human activity recognition, IEEE Access, 5, 3095, 10.1109/ACCESS.2017.2676168 Sheng, 2015, Robot semantic mapping through human activity recognition: a wearable sensing and computing approach, Robot, Auton. Syst., 68, 47, 10.1016/j.robot.2015.02.002 Zappi, 2007, Activity recognition from on-body sensors by classifier fusion: sensor scalability and robustness, 281 Jurek, 2013, 88 Banos, 2013, Human activity recognition based on a sensor weighting hierarchical classifier, Soft Comput, 17, 333, 10.1007/s00500-012-0896-3 Chowdhury, 2017, Physical activity recognition using posterior-adapted class-based fusion of multi-accelerometers data, IEEE J. Biomed. Health Inf., 1 Chowdhury, 2017, Ensemble methods for classification of physical activities from wrist accelerometry, Med. Sci. Sports Exerc., 49, 1965, 10.1249/MSS.0000000000001291 H. Inoue, H. Narihisa, Optimizing a multiple classifier system, Pacific Rim International Conference on Artificial Intelligence PRICAI 2002: PRICAI 2002: Trends in Artificial Intelligence pp. 285–294. Shoaib, 2016, Complex human activity recognition using smartphone and wrist-worn motion sensors, Sensors, 16 Alvear-Sandoval, 2018, On building ensembles of stacked denoising auto-encoding classifiers and their further improvement, Inf. Fusion, 39, 41, 10.1016/j.inffus.2017.03.008 Humayed, 2017, Cyber-physical systems security—A survey, IEEE Internet Things J., 4, 1802, 10.1109/JIOT.2017.2703172 Gao, 2017, A fused deep learning architecture for viewpoint classification of echocardiography, Inf. Fusion, 36, 103, 10.1016/j.inffus.2016.11.007 Xia, 2017, A boosted decision tree approach using Bayesian hyper-parameter optimization for credit scoring, Expert Syst. Appl., 78, 225, 10.1016/j.eswa.2017.02.017