A convolutional neural network based online teaching method using edge-cloud computing platform
Tóm tắt
Teaching has become a complex essential tool for students’ abilities, due to their different levels of learning and understanding. In the traditional offline teaching methods, dance teachers lack a target for students ‘classroom teaching. Furthermore, teachers have limited time, so they cannot take full care of each student’s learning needs according to their understanding and learning ability, which leads to the polarization of the learning effect. Because of this, this paper proposes an online teaching method based on Artificial Intelligence and edge calculation. In the first phase, standard teaching and student-recorded dance learning videos are conducted through the key frames extraction through a deep convolutional neural network. In the second phase, the extracted key frame images were then extracted for human key points using grid coding, and the fully convolutional neural network was used to predict the human posture. The guidance vector is used to correct the dance movements to achieve the purpose of online learning. The CNN model is distributed into two parts so that the training occurs at the cloud and prediction happens at the edge server. Moreover, the questionnaire was used to obtain the students’ learning status, understand their difficulties in dance learning, and record the corresponding dance teaching videos to make up for their weak links. Finally, the edge-cloud computing platform is used to help the training model learn quickly form vast amount of collected data. Our experiments show that the cloud-edge platform helps to support new teaching forms, enhance the platform’s overall application performance and intelligence level, and improve the online learning experience. The application of this paper can help dance students to achieve efficient learning.
Tài liệu tham khảo
Zhao H (2020) Blended College English Teaching Based on Online Live Classes During the COVID-19 Epidemic Period. J Contemp Educ Res 4(7):143–147
Papp-Danka A, Lanszki A (2020) Distance Learning at the Hungarian Dance Academy during the COVID-19 pandemic. Tánc és Nevelés 1(1):59–79
Guo B, Li H (2020) Guidance Strategies for Online Teaching during the COVID-19 Epidemic: A Case Study of the Teaching Practice of Xinhui Shangya School in Guangdong, China. Soc Sci Electron Publ 5(2):547–551
Li J (2012) Video shot segmentation and key frame extraction based on SIFT feature. 2012 International Conference on Image Analysis and Signal Processing, Huangzhou, China. pp. 1-8. https://doi.org/10.1109/IASP.2012.6425031.
Barbieri T, Goularte R (2019) KS-SIFT: A key frame Extraction Method Based on Local Features. IEEE Int Symp Multimed 52(1):13–17
Kuanar SK, Panda R, Chowdhury AS (2013) Video key frame extraction through dynamic Delaunay clustering with a structural constraint. J Vis Commun Image Rep 24(7):1212–1227
Wu Z, Xu p (2012) Research on the Technology of Video Key Frame Extraction Based on Clustering. 2012 Fourth International Conference on Multimedia Information Networking and Security, Nanjing, China. pp. 290-293. https://doi.org/10.1109/MINES.2012.190.
Halit C, Çapin TK (2015) Multiscale motion saliency for key frame extraction from motion capture sequences. Comput Animat Virtual Worlds 22(1):3–14
Wang J, Zeng C, Wang Z et al (2022) An improved smart key frame extraction algorithm for vehicle target recognition. Comput Electr Eng 97:107540
Ranjan RK, Agrawal A (2016) Video summary based on F-sift, Tamura textural and middle level semantic feature. Procedia Computer Science 89:870–876
Bouyahi M, Ayed YB (2020) Video scenes segmentation based on multimodal genre prediction. Procedia Comput Sci 176:10–21
Chen L, Wang Y (2017) Automatic key frame extraction in continuous videos from construction monitoring by using color, texture, and gradient features. Autom Constr 81:355–368
He K, Zhang X, Ren S et al (2014) Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition. IEEE Trans Pattern Anal Mach Intell 37(9):1904–1916
Varghese B, Wang N, Barbhuiya S, Kilpatrick P, Nikolopoulos DS (2016) Challenges and Opportunities in Edge Computing. 2016 IEEE International Conference on Smart Cloud (SmartCloud), New York, NY, USA. pp. 20-26. https://doi.org/10.1109/SmartCloud.2016.18.
Cao K, Liu Y, Meng G et al (2020) An overview on edge computing research. IEEE Access 8:85714–85728
Shi W, Cao J, Zhang Q et al (2016) Edge computing: Vision and challenges. IEEE Internet Things J 3(5):637–646
Satyanarayanan M (2017) The emergence of edge computing. Computer 50(1):30–39
Shi W, Dustdar S (2016) The promise of edge computing. Computer 49(5):78–81
Abbas N, Zhang Y, Taherkordi A et al (2017) Mobile edge computing: A survey. IEEE Internet Things J 5(1):450–465
Li He, Ota K, Dong M (2018) Learning IoT in edge: Deep learning for the Internet of Things with edge computing. IEEE Network 32(1):96–101
Zhou H et al (2021) Bbnet: a novel convolutional neural network structure in edge-cloud collaborative inference. Sensors 21(13):4494
Wang W, Lin H, Wang J (2020) CNN based lane detection with instance segmentation in edge-cloud computing. J Cloud Comput 9:1–10
Di Martino B et al (2022) Analysis of techniques for mapping convolutional neural networks onto cloud edge architectures using SplitFed learning method. Advanced Information Networking and Applications: Proceedings of the 36th International Conference on Advanced Information Networking and Applications (AINA-2022), vol 3. Springer International Publishing, Cham
Zhou L, Samavatian MH, Bacha A, Majumdar S, Teodorescu R (2019) Adaptive parallel execution of deep neural networks on heterogeneous edge devices. In Proceedings of the 4th ACM/IEEE Symposium on Edge Computing. pp 195–208
Wang Y et al (2020) A smart surface inspection system using faster R-CNN in cloud-edge computing environment. Adv Eng Inform 43:101037