An analysis of English classroom behavior by intelligent image recognition in IoT

Springer Science and Business Media LLC - 2021
Jiaxin Lin1, Jiamin Li1, Jie Chen1
1School of Foreign Languagues, Guangdong University of Finance and Economics, Guangzhou, China

Tóm tắt

In order to strengthen the management of English classroom discipline and improve the efficiency of students’ English classroom learning, students’ English classroom behavior based on intelligent image recognition is analyzed in IoT (Internet of things). The working scenes and practical significance of deep learning and IoT are analyzed and then the effects of four models on students' behavior analysis in English classroom are discussed. The results show that the classroom behavior analysis model proposed is feasible. The recognition system judges whether the students are listening seriously from three aspects, namely students' side face, head up and down, and their eyelid opening. The comparison of the four models of VGG16, ResNet18, ResNet50 and AlexNet shows that the accurate recognition rate of VGG16 for students' behavior in English classroom reaches 94.15%. Experiments show that the method provides a more objective evaluation of students’ classroom behavior. As a whole, students’ classroom behavior analysis based on IIRT (intelligent image recognition technology) in IOT is practicable for improving English classroom efficiency.

Từ khóa


Tài liệu tham khảo

Cao Z, Simon T, Wei SE et al (2017) Realtime multi-person 2D pose estimation using part affinity fields. IEEE Comput Soc 1(2):7291–7299

Chen W, Shirzadi A, Shahabi H (2017) A novel hybrid artificial intelligence approach based on the rotation forest ensemble and nave Bayes tree classifiers for a landslide susceptibility assessment in Langao County, China. Geomat Nat Hazards Risk 1(1):1–23

Dawar S, Sharma V, Goyal V (2017) Mining top-k high-utility itemsets from a data stream under sliding window model. Appl Intell 47(12):1240–1255

Ferrag MA, Derdour M, Mukherjee M (2018) Blockchain technologies for the internet of things: research issues and challenges. IEEE Internet Things J 1(1):99–100

Fu R, Wu T, Luo Z (2019) Learning behavior analysis in classroom based on deep learning. 2019 Tenth international conference on intelligent control and information processing 1(1), pp.79–92

Gong B, Jing F (2020) Research on the data analysis of college classroom teaching behavior by using deep learning. Int Conf Educ Econ Inf Manag 6(2):111–134

Hernández-Orallo J (2016) Evaluation in artificial intelligence: from task-oriented to ability-oriented measurement. Artif Intell Rev 5(2):112–119

Hu ZP, Qiu Y, Zhai FJ (2021) A multi-scale time-series video fusion behavior recognition model with attention mechanism. Core J Peking Univ 2(4):125–129

Jayaram V, Alamgir M, Altun Y (2016) Transfer Learning in Brain-Computer Interfaces Abstract The performance of brain-computer interfaces (BCIs) improves with the amount of avail. Comput Intell Mag 11(1):20–31

Jiménez Luna J, Skalic M, Martinez-Rosell G (2018) KDEEP: Protein-ligand absolute binding affinity prediction via 3D-convolutional neural networks. J Chem Inf Model 15(2):63–86

Kahng M, Andrews PY, Kalro A (2018) ActiVis: visual exploration of industry-scale deep neural network models. Trans Visualization Comput Gr 1(1):99–101

Kim Y, Soyata T, Behnagh RF (2018) Towards emotionally aware AI smart classroom: current issues and directions for engineering and education. IEEE Access 1(1):5308–5331

Krizhevsky A, Sutskever I, Hinton GE (2017) ImageNet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 1(25):1097–1105

Kubilius J, Bracci S, Beeck HOD (2016) Deep neural networks as a computational model for human shape sensitivity. PLoS Comput Biol 12(4):759

Liu B, Zhang X, Gao Zl (2018) Weld defect images classification with VGG16-based neural network. Digital TV and Wirel Multimed Commun 1(1):1125–1147

Liu D, Zhang P, Liu X (2019) Design and research of an embedded vehicle intelligent alarm control system based on image recognition technology. IOP Conf Ser Earth Environ Sci 295(3):122–135

Liu K, Zhang M, Hassan MK (2020) Intelligent image recognition system for detecting abnormal features of scenic spots based on deep learning. J Intell Fuzzy Syst 1(6):1–11

Peng P, Xiang T, Wang Yl (2016) Unsupervised cross-dataset transfer learning for person re-identification. Comput Vis Pattern Recognit 2(3):1–12

Shen T, Gao C, Xu D (2020) The analysis of intelligent real-time image recognition technology based on mobile edge computing and deep learning. J Real-Time Image Proc 1(2):21–35

Wei PA, Jing B, Tv A et al (2021) Rethinking the ST-GCNs for 3D skeleton-based human action recognition. Neurocomputing 1(454):45–53

Wu S (2020) Simulation of classroom student behavior recognition based on PSO-kNN algorithm and emotional image processing. J Intell Fuzzy Syst 40(4):1–11

Yang, Tiantian, Asanjan et al (2017) Developing reservoir monthly inflow forecasts using artificial intelligence and climate phenomenon information. Water Resour Res 1(1):52–71

Yang B, Yao Z, Lu H (2020) In-classroom learning analytics based on student behavior, topic and teaching characteristic mining – ScienceDirect. Pattern Recognit Lett 129(1):224–231

Yu N, Qiu, Hu X (2017) Accelerating convolutional neural networks by group-wise 2D-filter pruning. International joint conference on neural networks 2017, 3(1), pp 63–74

Thông tin
Thông tin xuất bản

Springer Science and Business Media LLC

Thông tin tác giả