An overview of self-adaptive technologies within virtual reality training

Merchant, 2014, Effectiveness of virtual reality-based instruction on students’ learning outcomes in K-12 and higher education: A meta-analysis, Comput. Educ., 70, 29, 10.1016/j.compedu.2013.07.033 Ko, 2015, Array haptic actuator for flight simulator Khan, 2013, Fuzzy controller design for assisted omni-directional treadmill therapy, Int. J. Soft Comput. Softw. Eng. (JSCSE), 3, 30 Novak-Marcincin, 2014, Application of virtual and augmented reality technology in education of manufacturing engineers, 439 Salehie, 2009, Self-adaptive software: Landscape and research challenges, ACM Trans. Auton. Adapt. Syst. (TAAS), 4, 14 Boulton, 2009, Testing the limits of data-driven learning: language proficiency and training, ReCALL, 21, 37, 10.1017/S0958344009000068 Stenudd, 2010, 751 R. Laddaga, Active software, in: Proc. of Int. Workshop on Self-Adaptive Software, 2000, pp. 11–26. Weyns, 2012, A survey of formal methods in self-adaptive systems, 67 Kephart, 2003, The vision of autonomic computing, Computer, 36, 41, 10.1109/MC.2003.1160055 Byrne, 1996, Psychophysiology and adaptive automation, Biol. Psychol., 42, 249, 10.1016/0301-0511(95)05161-9 Picard, 1995 Johns, 1986, Micro-concord: A language learner’s research tool, System, 14, 151, 10.1016/0346-251X(86)90004-7 Johns, 1991, 1 Bouras, 2002, A framework for intelligent virtual training environment: The steps from specification to design, Educ. Technol. Soc., 5, 11 Tavangarian, 2004, Is e-learning the solution for individual learning, Electron. J. E-Learn., 2, 273 A. Ahmad, O. Basir, K. Hassanein, Adaptive user interfaces for intelligent e-Learning: issues and trends, in: The Fourth International Conference on Electronic Business, ICEB2004, Beijing, 2004. dos Santos, 2004, An intelligent and adaptive virtual environment and its application in distance learning, 362 D. Charles, A. Kerr, M. McNeill, M. McAlister, M. Black, J. Kcklich, K. Stringer, Player-centred game design: Player modelling and adaptive digital games, in: Proceedings of the Digital Games Research Conference, Vol. 285, 2005, p. 100. Rossol, 2011, A framework for adaptive training and games in virtual reality rehabilitation environments, 343 Del Blanco, 2011, Enhancing adaptive learning and assessment in virtual learning environments with educational games, IJDET-Intell. Learn. Syst. Advancements Comput.-Aided Instr.: Emerg. Stud., 144 Ewais, 2014, Authoring adaptive 3D virtual learning environments, Int. J. Virtual Pers. Learn. Environ. (IJVPLE), 5, 1, 10.4018/ijvple.2014010101 Chen, 2014, Stereo vision calibration based on Elman neural network, Comput. Intell. Comput. Educ. Technol., 19, 10.1201/b16698-6 S.K. Rushton, K.L. Coles, J.P. Wann, Virtual reality technology in the assessment and rehabilitation of unilateral visual neglect, in: Sharkey, P. (Ed.), Proceedings of the 1st International Conference on Disability, Virtual Reality & Associated Technologies. Reading, UK, 1996, pp. 227–231. Myers, 2000, Virtual reality and left hemineglect: a technology for assessment and therapy, CyberPsychol. Behav., 3, 465, 10.1089/10949310050078922 Fichtinger, 2005, Image overlay guidance for needle insertion in CT scanner, IEEE Trans. Biomed. Eng., 52, 1415, 10.1109/TBME.2005.851493 Erat, 2013, How a surgeon becomes superman by visualization of intelligently fused multi-modalities Forbes. 2014. http://www.forbes.com/sites/ellenhuet/2014/10/21/google-leads-monster-542-million-funding-for-magic-leap-a-mysterious-cinematic-reality-company/. MSDN, 2012. http://blogs.msdn.com/b/kinectforwindows/archive/2012/08/22/nissan-pathfinder-virtual-showroom-is-latest-auto-industry-tool-powered-by-kinect-for-windows.aspx?Redirected=true (Accessed October 2015). IEEE. 2014. Microsoft Kinect Hack. http://sites.ieee.org/vancouver-cs/archives/290  (Accessed October 2015). Rolland, 1995, Quantification of adaptation to virtual-eye location in see-thru head-mounted displays, 55 DiZio, 1992, Spatial orientation, adaptation, and motion sickness in real and virtual environments, Presence: Teleoper. Vir. Environ., 1, 323, 10.1162/pres.1992.1.3.319 Smart, 2014, Influence of complexity and coupling of optic flow on visually induced motion sickness, Ecol. Psychol., 26, 301, 10.1080/10407413.2014.958029 Tinwell, 2014, The Uncanny Valley and nonverbal communication in virtual characters, 325 Coles, 2011, The role of haptics in medical training simulators: a survey of the state of the art, IEEE Trans. Haptic., 4, 51, 10.1109/TOH.2010.19 Deng, 2014, Multimodality with eye tracking and haptics: A new horizon for serious games?, Int. J. Serious Games, 1, 10.17083/ijsg.v1i4.24 Luzanin, 2014, Hand gesture recognition using low-budget data glove and cluster-trained probabilistic neural network, Assem. Autom., 34, 94, 10.1108/AA-03-2013-020 Yamashita, 2014, Assistive driving simulator with haptic manipulator using model predictive control and admittance control, Procedia Comput. Sci., 39, 107, 10.1016/j.procs.2014.11.016 Offer, 2015, Automated vehicles and electrification of transport, Energy Environ. Sci., 8, 26, 10.1039/C4EE02229G F. Olivari, F.M. Nieuwenhuizen, H.H. Bülthoff, L. Pollini, An experimental comparison of haptic and automated pilot support systems, in: AIAA Modeling and Simulation Technologies Conference, 2014, pp. 1–11. Chauhan, 2014, Control of an omnidirectional walking simulator, 811 Gunn, 2005, Using collaborative haptics in remote surgical training, 481 Yu, 2011, Uses, costs and comparative effectiveness of robotic assisted, laparoscopic and open urological surgery, J. Urol., 187, 1392, 10.1016/j.juro.2011.11.089 Okamura, 2009, Haptic feedback in robot-assisted minimally invasive surgery, Curr. Opin. Urol., 19, 102, 10.1097/MOU.0b013e32831a478c Stark, 2012, The future of telesurgery: a universal system with haptic sensation, J. Turkish German Gynecol. Assoc., 13, 74, 10.5152/jtgga.2012.05 F. Despinoy, J. Leon Torres, M.A. Vitrani, B. Herman, Toward remote teleoperation with eye and hand: A first experimental study, in: 3rd Joint Workshop on New Technologies for Computer/Robot Assisted Surgery, CRAS2013, 2013. Van der Meijden, 2009, The value of haptic feedback in conventional and robot-assisted minimal invasive surgery and virtual reality training: a current review, Surgical Endoscopy, 23, 1180, 10.1007/s00464-008-0298-x Cao, 2007, Can surgeons think and operate with haptics at the same time?, J. Gastrointest. Surg., 11, 1564, 10.1007/s11605-007-0279-8 B. Bayart, A. Pocheville, A. Kheddar, An adaptive haptic guidance software module for i-touch: example through a handwriting teaching simulation and a 3D maze, in: IEEE International Workshop on Haptic Audio Visual Environments and their Applications, 2005, 2005, p. 6. Wyatt, 1991, Field trials of medical decision-aids: potential problems and solutions, 3 Worthington, 1995, Learner-specific continuing education and the myers-briggs type inventory, J. Contin. Educ. Health Profess., 15, 95, 10.1002/chp.4750150206 Chu, 1995, Using the operator function model and OFMspert as the basis for an intelligent tutoring system: Towards a tutor/aid paradigm for operators of supervisory control systems, IEEE Trans. Syst. Man Cybern., 25, 1054, 10.1109/21.391287 Rickel, 1999, Animated agents for procedural training in virtual reality: Perception, cognition, and motor control, Appl. Artif. Intell., 13, 343, 10.1080/088395199117315 N. Vaughan, V.N. Dubey, T.W. Wainwright, R.G. Middleton, Can virtual-reality simulators assess experience and skill level of orthopaedic surgeons?, in: Science and Information Conference, 2015, p. 113. N. Vaughan, V.N. Dubey, T.W. Wainwright, R.G. Middleton, Does virtual-reality training on orthopaedic simulators improve performance in the operating room?, in: Science and Information Conference, 2015, p. 112. Wanzel, 2002, Teaching the surgical craft: from selection to certification, Curr. Probl. Surg., 39, 583, 10.1067/mog.2002.123481 Van Dongen, 2007, Construct validity of the LapSim: can the LapSim virtual reality simulator distinguish between novices and experts?, Surgical endoscopy, 21, 1413, 10.1007/s00464-006-9188-2 Madan, 2014, Role of simulation in arthroscopy training, Simul. Healthc.: J. Soc. Simul. Healthc., 9, 127, 10.1097/SIH.0b013e3182a86165 Dawe, 2014, A systematic review of surgical skills transfer after simulation-based training: laparoscopic cholecystectomy and endoscopy, Ann. Surg., 259, 236, 10.1097/SLA.0000000000000245 Castano, 2015, VIRTUAL-ME: A library for smart autonomous agents in multiple virtual environments, 34 Richards, 2015, A dancing virtual agent to evoke human emotions, 1701 M. Uejo, H.H. Huang, Y. Seki, J.H. Lee, K. Kawagoe, Measuring user performance in the interaction with a virtual ballroom dance instructor, in: Proc. of the 10th Asia Pacific Conference on Computer Human Interaction, APCHI 2012, 2012. Dörner, 2015, Content creation and authoring challenges for virtual environments: From user interfaces to autonomous virtual characters, 187 Gupta, 2012, An evolving multi-agent scenario generation framework for simulations in preventive medicine education, 237 Schönbrodt, 2015, The challenge of constructing psychologically believable agents, J. Media Psychol. B. Sniezynski, Agent-based adaptation system for service-oriented architectures using supervised learning, in: ICCS 2014, 2014, pp. 1057–1067. J. Yang, K. Abdel-Malek, K. Farrel, K. Nebel, The IOWA interactive digital-human virtual environment, in: ASME International Engineering Congress, The 3rd Symposium on Virtual Manufacturing and Application, Nov. 13–19, 2004, Anaheim, California, USA. Sharma, 2014, Immersive virtual reality environment of a subway evacuation on a cloud for disaster preparedness and response training, 1 Hocevar, 2012, From their environment to their behavior: a procedural approach to model groups of virtual agents, 370 M. Chollet, G. Sratou, A. Shapiro, L.P. Morency, S. Scherer, An interactive virtual audience platform for public speaking training, in: Proceedings of the 2014 International Conference on Autonomous Agents and Multi-Agent Systems, 2014, pp. 1657–1658. M. Chollet, T. Wörtwein, L.P. Morency, A. Shapiro, S. Scherer, Exploring feedback strategies to improve public speaking: an interactive virtual audience framework, in: Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing, 2015, pp. 1143–1154. G. Cabri, M. Puviani, F. Zambonelli, Towards a taxonomy of adaptive agent-based collaboration patterns for autonomic service ensembles, in: 2011 IEEE International Conference on Collaboration Technologies and Systems, CTS, 2011, pp. 508–515. Collins, 2006, Magnet: A multi-agent system using auctions with temporal and precedence constraints, 273 Li, 2015, Social robots and virtual agents as lecturers for video instruction, Comput. Hum. Behav. Lopez, 2014, Collaborative virtual training with physical and communicative autonomous agents, Comput. Anim. Virtual Worlds, 25, 485, 10.1002/cav.1583 Buche, 2010, PEGASE: A generic and adaptable intelligent system for virtual reality learning environments, Int. J. Virtual Real., 9, 73, 10.20870/IJVR.2010.9.2.2772 Clark, 2011 Krämer, 2010, Personalizing e-learning. The social effects of pedagogical agents, Educ. Psychol. Rev., 22, 71, 10.1007/s10648-010-9123-x Dede, 2009, Immersive interfaces for engagement and learning, Science, 323, 66, 10.1126/science.1167311 Standen, 2005, Virtual reality in the rehabilitation of people with intellectual disabilities: review, CyberPsychol. Behav., 8, 272, 10.1089/cpb.2005.8.272 C. Bouras, A. Philopoulos, T. Tsiatsos, A networked intelligent distributed virtual training environment: a first approach, in: Proceedings of Fifth Joint Conference on Information Sciences-JCIS, 2000, pp. 604–607. W.-B. Horng, C.-Y. Chen, Y. Chang, C.H. Fan, Driver fatigue detection based on eye tracking and dynamk, template matching, in: Proceedings of the IEEE International Conference on Networking, Sensing and Control, Taiwan, 2004, pp. 7–12. De Freitas, 2006 C.J. Sutherland, An augmented reality haptic training simulator for spinal needle procedures, 2011. Kangas, 2014, Gaze gestures and haptic feedback in mobile devices, 435 Gallagher, 2005, Virtual reality simulation for the operating room: proficiency-based training as a paradigm shift in surgical skills training, Ann. Surg., 241, 364, 10.1097/01.sla.0000151982.85062.80 McGaghie, 2010, A critical review of simulation-based medical education research: 2003–2009, Med. Educ., 44, 50, 10.1111/j.1365-2923.2009.03547.x Kapoor, 2014, Haptics–Touchfeedback technology widening the horizon of medicine, J. Clin. Diagn. Res.: JCDR, 8, 294 M.O. Alhalabi, V. Daniulaitis, H. Kawasaki, T. Hori, Medical training simulation for palpation of subsurface tumor using hiro, in: Eurohaptics 2005, 2005, pp. 623–624. Ghanbarzadeh, 2014, A decade of research on the use of three-dimensional virtual worlds in health care: a systematic literature review, J. Med. Internet Res., 16, 10.2196/jmir.3097 Cook, 2011, Technology-enhanced simulation for health professions education: a systematic review and meta-analysis, Jama, 306, 978, 10.1001/jama.2011.1234 Ahlberg, 2007, Proficiency-based virtual reality training significantly reduces the error rate for residents during their first 10 laparoscopic cholecystectomies, Am. J. Surg., 193, 797, 10.1016/j.amjsurg.2006.06.050 Baek, 2003, Motion retargeting and evaluation for VR-based training of free motions, Vis. Comput., 19, 222, 10.1007/s00371-003-0194-2 Merién, 2010, Multidisciplinary team training in a simulation setting for acute obstetric emergencies: a systematic review, Obstet. Gynecol., 115, 1021, 10.1097/AOG.0b013e3181d9f4cd Cant, 2010, Simulation−based learning in nurse education: systematic review, J. Adv. Nurs., 66, 3, 10.1111/j.1365-2648.2009.05240.x Myura Nagendran, Kurinchi Selvan Gurusamy, Rajesh Aggarwal, Marilena Loizidou, Brian R. Davidson, Virtual reality training for surgical trainees in laparoscopic surgery, The Cochrane Library, 2013. Issenberg, 1999, Simulation technology for health care professional skills training and assessment, JAMA, 282, 861, 10.1001/jama.282.9.861 Bridges, 1999, The financial impact of teaching surgical residents in the operating room, Am. J. Surg., 177, 28, 10.1016/S0002-9610(98)00289-X Gallagher, 2002, Virtual reality as a metric for the assessment of laparoscopic psychomotor skills, Surg. Endoscopy Other Intervent. Tech., 16, 1746, 10.1007/s00464-001-8215-6 W. Ahn, S. Dargar, T. Halic, J. Lee, B. Li, J. Pan, S. De, Development of a Virtual Reality Simulator for Natural Orifice Translumenal Endoscopic Surgery (NOTES) Cholecystectomy Procedure. Medicine Meets Virtual Reality 21: NextMed/MMVR21, Vol. 196, 2014, p. 1. Brough, 2007, Towards the development of a virtual environment-based training system for mechanical assembly operations, Virtual Real., 11, 189, 10.1007/s10055-007-0076-4 Jayaram, 2007, Industry case studies in the use of immersive virtual assembly, Virtual Real., 11, 217, 10.1007/s10055-007-0070-x Chittaro, 2000, Adding adaptive features to virtual reality interfaces for e-commerce, 86 Popovic, 2009, Stress inoculation training supported by physiology-driven adaptive virtual reality stimulation, Stud. Health Technol. Inform., 144, 50 Furht, 2011 S. Gerbaud, I. De Rennes, N. Mollet, F. Ganier, B. Arnaldi, I. De Rennes, J. Tisseau, GVT: a platform to create virtual environments for procedural training, in: IEEE Virtual Reality Conference, 2008. J. Lucas, W. Thabet, P. Worlikar, Using virtual reality (VR) to improve conveyor belt safety in surface mining, in: 24th W78 Conference Maribor 2007 & 5th ITCEDU Workshop & 14th EG-ICE Workshop: Bringing ITC, 2007. Jordan, 2014, Initial trends in enrolment and completion of massive open online courses, Int. Rev. Res. Open Distance Learn., 15, 10.19173/irrodl.v15i1.1651 Hollands, 2014 Lewin, 2013, Students rush to web classes, but profits may be much later, New York Times, 6 Salas, 2008, Does team training improve team performance? A meta-analysis, Hum. Factors: J. Hum. Factors Ergonomics Soc., 50, 903, 10.1518/001872008X375009 Marks, 2010, The science of team effectiveness, Psychol. Sci. Public Interest, 7, i, 10.1111/j.1529-1006.2006.00029.x Teki, 2013. http://www.osakidetza.euskadi.net  (Accessed October 2015). Balakrishnan, 2013 R. Kizilcec, C. Piech, E. Schneider, Deconstructing disengagement: Analyzing learner subpopulations in massive open online courses, in: Proc. 3rd Int’l Conference on Learning Analytics and Knowledge, LAK’13, Belgium, 2013. Dondlinger, 2007, Educational video game design: A review of the literature, J. Appl. Educ. Technol., 4, 21 Pirovano, 2012, Self-adaptive games for rehabilitation at home, 179 Borghese, 2013, Computational intelligence and game design for effective at-home stroke rehabilitation, Games Health: Res. Dev. Clin. Appl., 2, 81, 10.1089/g4h.2012.0073 M.I. Chowdhury, M. Katchabaw, A software design pattern based approach to adaptive video games, in: ADAPTIVE 2013, The Fifth International Conference on Adaptive and Self-Adaptive Systems and Applications, 2013, pp. 40–47. Raybourn, 2007, Applying simulation experience design methods to creating serious game-based adaptive training systems, Interact. Comput., 19, 206, 10.1016/j.intcom.2006.08.001 Lara-Cabrera, 2014, An analysis of the structure and evolution of the scientific collaboration network of computer intelligence in games, Physica A, 395, 523, 10.1016/j.physa.2013.10.036 Rizzo, 2005, A SWOT analysis of the field of virtual reality rehabilitation and therapy, Presence, 14, 119, 10.1162/1054746053967094 Kallmann, 2015, 147 W. Ijsselsteijn, H.H. Nap, Y. de Kort, K. Poels, Digital game design for elderly users, in: Proc. 2007 conf. on Future Play, ser. Future Play ’07, 2007, pp. 17–22. Davoodi, 2012, Real-time animation software for customized training to use motor prosthetic systems, IEEE Trans. Neural Syst. Rehabil. Eng., 20, 134, 10.1109/TNSRE.2011.2178864 Ma, 2007, Adaptive virtual reality games for rehabilitation of motor disorders, Lecture Notes in Comput. Sci., 4555, 681, 10.1007/978-3-540-73281-5_74 Oliver, 2014, Wireless multisensory interaction in an intelligent rehabilitation environment, 193 Chang, 2011, A Kinect-based system for physical rehabilitation: A pilot study for young adults with motor disabilities, Res. Dev. Disabil., 32, 2566, 10.1016/j.ridd.2011.07.002 B. Lange, C. Chang, E. Suma, B. Newman, A. Rizzo, M. Bolas, Development and evaluation of low cost game-based balance rehabilitation tool using the Microsoft Kinect sensor, in: Proceedings of the 33rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 2011, pp. 1831–1834. D. Freitas, A. Da Gama, L. Figueiredo, T. Chaves, D. Marques-Oliveira, V. Teichrieb, C. Araújo, Development and evaluation of a Kinect based motor rehabilitation game, in: Proceedings of Simposio Brasileiro de Jogos e Entretenimento Digital, 2012, pp. 144–153. C. Chang, B. Lange, M. Zhang, S. Koenig, P. Requejo, N. Somboon, A. Sawchuk, A. Rizzo, Towards pervasive physical rehabilitation using Microsoft Kinect, in: Proceedings of the 6th International Conference on Pervasive Computing Technologies for Healthcare, 2012, pp. 1–4. Pirovano, 2013, IGER: A game engine specifically tailored to rehabilitation, 85 Fuentes, 2013, Towards usability evaluation of multimodal assistive technologies using RGB-D sensors, 210 Toyra, 2013. http://www.toyra.org  (Accessed October 2015). E. Davaasambuu, C. Chiang, J. Chiang, Y. Chen, S. Bilgee, A Microsoft Kinect based virtual rehabilitation system, in: Proceedings of the 5th International Conference on Frontiers of Information Technology, Applications and Tools, 2012, pp. 44–50. Mainetti, 2013, Duckneglect: video-games based neglect rehabilitation, Technol. Health Care, 10.3233/THC-120712 N.A. Borghese, M. Renato, P. Michele, P.L. Lanzi, An integrated low-cost system for at home rehabilitation, in; VSSMM2012 conference, 2012. Jack, 2011, Virtual reality-enhanced stroke rehabilitation, IEEE Trans. Neural. Syst. Rehabil. Eng., 9, 308, 10.1109/7333.948460 Cameirao, 2010, Neurorehabilitation using the virtual reality based rehabilitation gaming system: Methodology, design, psychometrics, usability and validation, J. Neuroeng. Rehabil., 7, 48, 10.1186/1743-0003-7-48 J.W. Burke, M. McNeill, D. Charles, P. Morrow, J. Crosbie, S. McDonough, Serious games for upper limb rehabilitation following stroke, in: Conf. in Games and Virtual Worlds for Serious Applications, 2009, pp. 103–110. Burke, 2009, Optimising engagement for stroke rehabilitation using serious games, Vis. Comput., 25, 1085, 10.1007/s00371-009-0387-4 VirtualRehab, 2013. http://virtualrehab.info. Rose, 2005, Virtual reality in brain damage rehabilitation: review, CyberPsychol. Behav., 8, 241, 10.1089/cpb.2005.8.241 Langhorne, 2009, Motor recovery after stroke: a systematic review, Lancet Neurol., 8, 741, 10.1016/S1474-4422(09)70150-4 Parsons, 2002, The potential of virtual reality in social skills training for people with autistic spectrum disorders, J. Intellectual Disabil. Res., 46, 430, 10.1046/j.1365-2788.2002.00425.x EU Rewire Project. www.rewire-project.eu  (Accessed October 2015). EU Cogwatch Project. www.cogwatch.eu  (Accessed October 2015). EU Script Project. www.scriptproject.eu  (Accessed October 2015). EU iStoppFalls Project. www.istoppfalls.eu  (Accessed October 2015). Carbonell, 2007, Mobile agents using data mining for diagnosis support in ubiquitous healthcare, Agent Multi-Agent Syst.: Technol. Appl., 2007, 795 Larsson, 1998, An intelligent autonomous agent for medical monitoring and diagnosis, IEEE Intell. Syst. Appl., 13, 58, 10.1109/5254.653225 Buditjahjanto, 2011, Fuzzy clustering based on multi-objective optimization problem for design an intelligent agent in serious game, J. Theor. Appl. Inf. Technol., 28, 54 He, 2003, On agent-mediated electronic commerce, IEEE Trans. Knowl. Data Eng., 15, 985, 10.1109/TKDE.2003.1209014 Kizony, 2003, Adapting an immersive virtual reality system for rehabilitation, J. Vis. Comput. Animat., 14, 261, 10.1002/vis.323 Vaughan, 2014, Parametric model of human body shape and ligaments for patient-specific epidural simulation, Artif. Intell. Med. (AIIM), 10.1016/j.artmed.2014.08.005