Using a virtual reality interview simulator to explore factors influencing people’s behavior

Xinyi Luo1,2, Yuyang Wang1, Lik-Hang Lee3, Zihan Xing4, Shan Jin1, Boya Dong1, Yuanyi Hu5, Zeming Chen1, Jing Yan1, Pan Hui1
1The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China
2University of Electronic Science and Technology of China, Chengdu, China
3The Hong Kong Polytechnic University, Hung Hom, China
4BNU-HKBU United International College, Zhuhai, China
5Guangdong Medical University, Dongguan, China

Tóm tắt

Virtual reality interview simulator (VRIS) is an effective and valid tool that uses virtual reality technology to train people’s interview skills. Typically, it offers candidates prone to being very nervous during interviews the opportunity to practice interviews in a safe and manageable virtual environment and realistic settings, providing real-time feedback from a virtual interviewer on their performance. It helps interviewees improve their skills, reduce their fears, gain confidence, and minimize the cost and time associated with traditional interview preparation. Yet, the major anxiety-inducing elements remain unknown. During an interview, the anxiety levels, overall experience, and performance of interviewees might be affected by various circumstances. By analyzing electrodermal activity and questionnaire, we investigated the influence of five variables: (I) Realism; (II) Question type; (III) Interviewer attitude; (IV) Timing; and (V) Preparation. As such, an orthogonal design $$L_8(4^1 \times 2^4)$$ with eight experiments ( $$O A_8$$ matrix) was implemented, in which 19 college students took part in the experiments. Considering the anxiety, overall experience, and performance of the interviewees, we found that Question type plays a major role; secondly, Realism, Preparation, and Interviewer attitude all have middle influence; lastly, Timing has little to no impact. Specifically, professional interview questions elicited a greater degree of anxiety than personal ones among the categories of interview questions. This work contributes to our understanding of anxiety-stimulating factors during job interviews in virtual reality and provides cues for designing future VRIS.

Từ khóa


Tài liệu tham khảo

Hartholt A, Mozgai S, Rizzo AS (2019) Virtual job interviewing practice for high-anxiety populations. In: Proceedings of the 19th ACM international conference on intelligent virtual agents, pp. 238–240 Adiani D, Itzkovitz A, Bian D, Katz H, Breen M, Hunt S, Swanson A, Vogus TJ, Wade J, Sarkar N (2022) Career interview readiness in virtual reality (cirvr): a platform for simulated interview training for autistic individuals and their employers. ACM Trans Accessible Comput (TACCESS) 15(1):1–28 Jin X, Bian Y, Geng W, Chen Y, Chu K, Hu H, Liu J, Shi Y, Yang C (2019) Developing an agent-based virtual interview training system for college students with high shyness level. In: 2019 IEEE conference on virtual reality and 3D user interfaces (VR), pp. 998–999. IEEE Gebhard P, Baur T, Damian I, Mehlmann G, Wagner J, André E (2014) Exploring interaction strategies for virtual characters to induce stress in simulated job interviews Kwon JH, Powell J, Chalmers A (2013) How level of realism influences anxiety in virtual reality environments for a job interview. Int J Hum Comput Stud 71(10):978–987 Hartwell CJ, Johnson CD, Posthuma RA (2019) Are we asking the right questions? predictive validity comparison of four structured interview question types. J Bus Res 100:122–129 Kwon JH, Alan C, Czanner S, Czanner G, Powell J (2009) A study of visual perception: Social anxiety and virtual realism. In: Proceedings of the 25th spring conference on computer graphics, pp. 167–172 Schwartz SM, Evans C, Agur AM (2015) Comparison of physical therapy anatomy performance and anxiety scores in timed and untimed practical tests. Anat Sci Educ 8(6):518–524 Gantt LT (2013) The effect of preparation on anxiety and performance in summative simulations. Clin Simul Nurs 9(1):25–33 Wang Y, Chardonnet J-R, Merienne F (2021) Enhanced cognitive workload evaluation in 3D immersive environments with topsis model. Int J Human-Comput Stud 147:102572 Wang Y, Chardonnet J-R, Merienne F (2021) Development of a speed protector to optimize user experience in 3D virtual environments. Int J Human-Comput Stud 147:102578 Mok KH, Xiong W, Ye H (2021) Covid-19 crisis and challenges for graduate employment in Taiwan, mainland china and east Asia: a critical review of skills preparing students for uncertain futures. J Educ Work 34(3):247–261 Levine SP, Feldman RS (2002) Women and men’s nonverbal behavior and self-monitoring in a job interview setting. Appl HRM Res 7(1):1–14 Feiler AR, Powell DM (2016) Behavioral expression of job interview anxiety. J Bus Psychol 31(1):155–171 McCarthy J, Goffin R (2004) Measuring job interview anxiety: beyond weak knees and sweaty palms. Pers Psychol 57(3):607–637 Powell DM, Stanley DJ, Brown KN (2018) Meta-analysis of the relation between interview anxiety and interview performance. Can J Behav Sci 50(4):195 Zielinska AP, Mawhinney JA, Grundmann N, Bratsos S, Ho JSY, Khajuria A (2021) Virtual interview, real anxiety: prospective evaluation of a focused teaching programme on confidence levels among medical students applying for academic clinical posts. Adv Med Educ Pract 12:675 Hart SG (1986) Nasa task load index (tlx) Hill SG, Iavecchia HP, Byers JC, Bittner AC Jr, Zaklade AL, Christ RE (1992) Comparison of four subjective workload rating scales. Hum Factors 34(4):429–439 Greco A, Valenza G, Scilingo EP (2016) Advances in electrodermal activity processing with applications for mental health. Springer, Cham Roos A-L, Goetz T, Voracek M, Krannich M, Bieg M, Jarrell A, Pekrun R (2021) Test anxiety and physiological arousal: a systematic review and meta-analysis. Educ Psychol Rev 33:579–618 North MM, North SM, Coble JR (1998) Virtual reality therapy: an effective treatment for the fear of public speaking. Int J Virtual Reality 3(3):1–6 Kampmann IL, Emmelkamp PM, Morina N (2016) Meta-analysis of technology-assisted interventions for social anxiety disorder. J Anxiety Disord 42:71–84 Emmelkamp PM, Meyerbröker K, Morina N (2020) Virtual reality therapy in social anxiety disorder. Curr Psychiatry Rep 22(7):1–9 Kerous B, Barteček R, Roman R, Sojka P, Bečev O, Liarokapis F (2020) Examination of electrodermal and cardio-vascular reactivity in virtual reality through a combined stress induction protocol. J Ambient Intell Humaniz Comput 11:6033–6042 Huang W, Wang J, Liu L (2021) Application of virtual reality technology in the treatment of anxiety disorder. In: Proceedings of the 2021 5th international conference on electronic information technology and computer engineering, pp. 845–849 Parsons TD, Rizzo AA (2008) Affective outcomes of virtual reality exposure therapy for anxiety and specific phobias: a meta-analysis. J Behav Ther Exp Psychiatry 39(3):250–261 Garcia-Palacios A, Hoffman H, Carlin A, Furness TA III, Botella C (2002) Virtual reality in the treatment of spider phobia: a controlled study. Behav Res Ther 40(9):983–993 Baños RM, Botella C, Perpiñá C, Alcañiz M, Lozano JA, Osma J, Gallardo M (2002) Virtual reality treatment of flying phobia. IEEE Trans Inf Technol Biomed 6(3):206–212 Botella C, García-Palacios A, Villa H, Baños R, Quero S, Alcañiz M, Riva G (2007) Virtual reality exposure in the treatment of panic disorder and agoraphobia: a controlled study. Clinic Psychol Psychother Int J Theor Pract 14(3):164–175 Coelho CM, Santos JA, Silvério J, Silva CF (2006) Virtual reality and acrophobia: one-year follow-up and case study. CyberPsychol Behav 9(3):336–341 Albright G, Khalid N, Shockley K, Robinson K, Hughes K, Pace-Danley B et al (2021) Innovative virtual role play simulations for managing substance use conversations: Pilot study results and relevance during and after covid-19. JMIR Formative Res 5(4):27164 Didehbani N, Allen T, Kandalaft M, Krawczyk D, Chapman S (2016) Virtual reality social cognition training for children with high functioning autism. Comput Hum Behav 62:703–711 Clus D, Larsen ME, Lemey C, Berrouiguet S et al (2018) The use of virtual reality in patients with eating disorders: systematic review. J Med Internet Res 20(4):7898 Burke SL, Bresnahan T, Li T, Epnere K, Rizzo A, Partin M, Ahlness RM, Trimmer M (2018) Using virtual interactive training agents (vita) with adults with autism and other developmental disabilities. J Autism Dev Disord 48(3):905–912 Souchet AD, Philippe S, Lévêque A, Ober F, Leroy L (2022) Short-and long-term learning of job interview with a serious game in virtual reality: influence of eyestrain, stereoscopy, and apparatus. Virtual Real 26(2):583–600 Helminen EC, Morton ML, Wang Q, Felver JC (2019) A meta-analysis of cortisol reactivity to the trier social stress test in virtual environments. Psychoneuroendocrinology 110:104437 Kothgassner OD, Goreis A, Glenk LM, Kafka JX, Pfeffer B, Beutl L, Kryspin-Exner I, Hlavacs H, Palme R, Felnhofer A (2021) Habituation of salivary cortisol and cardiovascular reactivity to a repeated real-life and virtual reality trier social stress test. Physiol Behav 242:113618 Smith MJ, Smith JD, Fleming MF, Jordan N, Brown CH, Humm L, Olsen D, Bell MD (2017) Mechanism of action for obtaining job offers with virtual reality job interview training. Psychiatr Serv 68(7):747–750 Barreda-Ángeles M, Aleix-Guillaume S, Pereda-Baños A (2020) Users’ psychophysiological, vocal, and self-reported responses to the apparent attitude of a virtual audience in stereoscopic 360-video. Virtual Reality 24(2):289–302 Aysina RM, Efremova GI, Maksimenko ZA, Nikiforov MV (2017) Using a computer simulation to improve psychological readiness for job interviewing in unemployed individuals of pre-retirement age. Eur J Psychol 13(2):251 Smith MJ, Ginger EJ, Wright K, Wright MA, Taylor JL, Humm LB, Olsen DE, Bell MD, Fleming MF (2014) Virtual reality job interview training in adults with autism spectrum disorder. J Autism Dev Disord 44(10):2450–2463 Addelman S (1962) Orthogonal main-effect plans for asymmetrical factorial experiments. Technometrics 4(1):21–46 Huffcutt AI, Van Iddekinge CH, Roth PL (2011) Understanding applicant behavior in employment interviews: A theoretical model of interviewee performance. Hum Resour Manag Rev 21(4):353–367 Morris LW, Liebert RM (1969) Effects of anxiety on timed and untimed intelligence tests: another look. J Consult Clin Psychol 33(2):240 Zeng G, Fung S-f, Li J, Hussain N, Yu P (2020) Evaluating the psychometric properties and factor structure of the general self-efficacy scale in china. Curr Psychol 1–11 Johnston M, Wright S, Weinman J (1995) Measures in health psychology: a user’s portfolio Zhang JX, Schwarzer R (1995) Measuring optimistic self-beliefs: a Chinese adaptation of the general self-efficacy scale. Psychol Int J Psychol Orient Howell AN, Zibulsky DA, Srivastav A, Weeks JW (2016) Relations among social anxiety, eye contact avoidance, state anxiety, and perception of interaction performance during a live conversation. Cogn Behav Ther 45(2):111–122 Feiler AR (2010) Interviewee and interviewer ratings of job interview anxiety: an investigation of the discrepancy using the Brunswik lens model. PhD thesis, University of Guelph Braithwaite JJ, Watson DG, Jones R, Rowe M (2013) A guide for analysing electrodermal activity (EDA) & skin conductance responses (SCRS) for psychological experiments. Psychophysiology 49(1):1017–1034 Kritikos J, Tzannetos G, Zoitaki C, Poulopoulou S, Koutsouris D (2019) Anxiety detection from electrodermal activity sensor with movement & interaction during virtual reality simulation. In: 2019 9th International IEEE/EMBS conference on neural engineering (NER), pp. 571–576 . IEEE Makowski D, Pham T, Lau ZJ, Brammer JC, Lespinasse F, Pham H, Schölzel C, Chen SA (2021) Neurokit2: a python toolbox for neurophysiological signal processing. Behav Res Methods 1–8 Bates D, Mächler M, Bolker B, Walker S (2014) Fitting linear mixed-effects models using lme4. arXiv preprint arXiv:1406.5823 Gee S, Gregory M, Pipe M-E (1999) what colour is your pet dinosaur? the impact of pre-interview training and question type on children’s answers. Legal Criminol Psychol 4(1):111–128 Ellis AP, West BJ, Ryan AM, DeShon RP (2002) The use of impression management tactics in structured interviews: a function of question type? J Appl Psychol 87(6):1200 Bradley ME, Thom LR, Hayes J, Hay C (2008) Ask and you will receive: how question type influences quantity and quality of online discussions. Br J Edu Technol 39(5):888–900 Hansen K, Hansen RS (2006) Employment interview preparation: assessing the writing-to-learn approach. In: Developments in business simulation and experiential learning: proceedings of the annual ABSEL conference, vol. 33 Wallergård M, Jönsson P, Johansson G, Karlson B (2011) A virtual reality version of the trier social stress test: a pilot study. Presence 20(4):325–336 Zimmer P, Wu CC, Domes G (2019) Same same but different? replicating the real surroundings in a virtual trier social stress test (tsst-vr) does not enhance presence or the psychophysiological stress response. Physiol Behav 212:112690 Fallon M, Riem MM, Kunst LE, Kop WJ, Kupper N (2021) Multi-modal responses to the virtual reality trier social stress test: A comparison with standard interpersonal and control conditions. Int J Psychophysiol 161:27–34 Lugrin J-L, Wiedemann M, Bieberstein D, Latoschik ME (2015) Influence of avatar realism on stressful situation in vr. In: 2015 IEEE virtual reality (VR), pp. 227–228 . IEEE Romano DM, Brna P (2001) Presence and reflection in training: support for learning to improve quality decision-making skills under time limitations. CyberPsychol Behav 4(2):265–277 Gonzalez-Franco M, Steed A, Hoogendyk S, Ofek E (2020) Using facial animation to increase the enfacement illusion and avatar self-identification. IEEE Trans Vis Comput Graph 26(5):2023–2029