Improving the user experience of a gambling support and education website using a chatbot
Universal Access in the Information Society - Trang 1-13 - 2022
Tóm tắt
Gambling help websites are an important source of information for gamblers and affected others, but they contain large amounts of information, making it difficult to navigate and access required resources. Usability of such websites can be improved through the implementation of chatbots, which are programmed to respond to user requests in natural language. This study aimed to evaluate the impact of a text-based chatbot on the usability, user satisfaction, and experience of the Australian New South Wales GambleAware website; and explore the usability, user satisfaction, and experience of the chatbot itself. A convenience sample of Australian residents were allocated into website with chatbot access (n = 32) or website only (n = 28). Compared with the website-only group, the website with chatbot access group reported significantly greater ratings of the website’s usability and aspects of user satisfaction, but not user experience, and resulted in higher ease of task completion. Compared with available norms, the chatbot was highly rated on usability, usefulness, information quality, and credibility, with the layout, readability of responses, and look and feel identified as areas for improvement. The usability of the NSW GambleAware website could be enhanced by the integration of a text-based chatbot, with potential applications for similar websites.
Tài liệu tham khảo
Neal, P., Delfabbro, P., O’Neil, M.: Problem gambling and harm: toward a national definition. Office of Gaming and Racing, Melbourne (2005)
Dowling, N.A., et al.: National estimates of Australian gambling prevalence: findings from a dual-frame omnibus survey. Addiction 111(3), 420–435 (2016)
Gainsbury, S.M., et al.: The prevalence and determinants of problem gambling in Australia: assessing the impact of interactive gambling and new technologies. Psychol. Addict. Behav. 28(3), 769 (2014)
Langham, E., et al.: Understanding gambling related harm: a proposed definition, conceptual framework, and taxonomy of harms. BMC Public Health 16, 80 (2016)
Browne, M., et al.: A population-level metric for gambling-related harm. Int. Gambl. Stud. 17(2), 163–175 (2017)
Cowlishaw, S., et al.: Psychological therapies for pathological and problem gambling. Cochrane Database Syst. Rev. 11 (2012)
Gooding, P., Tarrier, N.: A systematic review and meta-analysis of cognitive-behavioural interventions to reduce problem gambling: Hedging our bets? Behav. Res. Ther. 47(7), 592–607 (2009)
Thomas, S.A., et al.: Australian guideline for treatment of problem gambling: an abridged outline. Med. J. Aust. 195(11), 664–665 (2011)
Yakovenko, I., et al.: The efficacy of motivational interviewing for disordered gambling: systematic review and meta-analysis. Addict. Behav. 43(11), 72–82 (2015)
Productivity Commission: Gambling, Report no. 50. Canberra (2010)
Slutske, W.S., Blaszczynski, A., Martin, N.G.: Sex differences in the rates of recovery, treatment-seeking, and natural recovery in pathological gambling: results from an Australian community-based twin survey. Twin Res. Hum. Genet. 12(5), 425–432 (2009)
Suurvali, H., et al.: Barriers to seeking help for gambling problems: a review of the empirical literature. J. Gambl. Stud. 25(3), 407–424 (2009)
Hing, N., Nuske, E., Gainsbury, S.: Gamblers at-risk and their help-seeking behaviour. Gambling Research Australia, Melbourne (2012)
Dowling, N.A., et al.: Development and evaluation of an online gambling self-directed program: Effective integration into existing services. Victorian Responsible Gambling Foundation, Melbourne (2018)
Hing, N., et al.: All in the family: help-seeking by significant others of problem gamblers. Int. J. Ment. Heal. Addict. 11(3), 396–408 (2013)
Rodda, S.N., Dowling, N.A., Lubman, D.I.: Gamblers seeking online help are active help-seekers: time to support autonomy and competence. Addict. Behav. 87, 272–275 (2018)
Rodda, S.N., et al.: Reasons for using web-based counselling among family and friends impacted by problem gambling. Asian J. Gambl. Issues Public Health 3(1), 1 (2013)
Cooper, G.: Exploring and understanding online assistance for problem gamblers: the pathways disclosure model ecommunity. Int. J. Ment. Health Addict. 1(2), 32–38 (2004)
Rodda, S.N., Lubman, D.I.: Characteristics of gamblers using a national online counselling service for problem gambling. J. Gambl. Stud. 30(2), 1–13 (2014)
Rodda, S.N., et al.: Treatment for family members of people experiencing gambling problems: family members want both gambler-focused and family-focused options. Int. J. Ment. Health Addict. 18(5), 1–17 (2019)
Hirakis, E., Casey, L.M., Clough, B.A.: Investigating website usability: enhancing engagement of amphetamine users in online treatment. Int. J. Ment. Heal. Addict. 16(2), 420–435 (2018)
Strecher, V., et al.: The role of engagement in a tailored web-based smoking cessation program: randomized controlled trial. J. Med. Internet Res. 10(5), e36 (2008)
Lenert, L., et al.: Design and pilot evaluation of an internet smoking cessation program. J. Am. Med. Inform. Assoc. 10(1), 16–20 (2003)
Ly, K.-H., Ly, A.-M., Andersson, G.: A fully automated conversational agent for promoting mental well-being: a pilot RCT using mixed methods. Internet Interv. 10, 39–46 (2017)
McTear, M., Callejas, Z., Griol, D.: The Conversational Interface: Talking to Smart Devices. Springer International Publishing, Cham (2016)
Castiglione, A., et al.: In: Cyberspace Safety and Security: 10th International Symposium. Amalfi, Italy. Springer (2018)
Di Gaetano, S. and P. Diliberto.: Chatbots and conversational interfaces: three domains of use. In: Fifth International Workshop on Cultures of Participation in the Digital Age, Castiglione della Pescaia, Italy (2018)
Brandtzaeg, P.B., Følstad, A.: Why People Use Chatbots. In: Kompatsiaris, I., et al. (eds.) Internet Science. Springer International Publishing (2017)
Schuetzler, R.M., G.M. Grimes, and J.S. Giboney: An Investigation of Conversational Agent Relevance, Presence, and Engagement. In: AMCIS 2018 Proceedings (2018)
Følstad, A., et al. SIG: Chatbots for Social Good. In: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (2018)
Mittal, A., et al.: A comparative study of chatbots and humans. Situations 2(2) (2016)
Lucas, G.M., et al.: It’s only a computer: virtual humans increase willingness to disclose. Comput. Hum. Behav. 37, 94–100 (2014)
Fitzpatrick, K.K., Darcy, A., Vierhile, M.: Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): a randomized controlled trial. JMIR ment. health 4(2), e19 (2017)
Fulmer, R., et al.: Using psychological artificial intelligence (Tess) to relieve symptoms of depression and anxiety: randomized controlled trial. JMIR ment. health 5(4), e64 (2018)
Inkster, B., Sarda, S., Subramanian, V.: An empathy-driven, conversational artificial intelligence agent (Wysa) for digital mental well-being: real-world data evaluation mixed-methods study. JMIR Mhealth Uhealth 6(11), e12106 (2018)
Demirci, H.M.: User experience over time with conversational agents: case study of woebot on supporting subjective well-being. In: Graduate School of Natural and Applied Sciences. Middle East Technical University (2018)
So, R., et al.: Unguided chatbot-delivered cognitive behavioural intervention for problem gamblers through messaging app: a randomised controlled trial. J. gambl. stud. 36(4), 1–17 (2020)
Vaziri, D.D., et al., Exploring user experience and technology acceptance for a fall prevention system: results from a randomized clinical trial and a living lab. European review of aging and physical activity : official journal of the European Group for Research into Elderly and Physical Activity. 13(6) (2016)
Brooke, J.: SUS: A ‘Quick and Dirty’ Usability Scale. Usability Evaluation in Industry. CRC Press (1996)
Lewis, J.R., Sauro, J.: Revisiting the Factor Structure of the System Usability Scale. J. Usability Stud. 12(4) (2017)
Sauro, J.: A practical guide to the system usability scale: Background, benchmarks & best practices. CreateSpace Independent Publishing Platform (2011)
Lewis, J.R. and J. Sauro, (2009) The Factor Structure of the System Usability Scale. In: (Ed) M. Kurosu, Human Centered Design. 94–103. Springer. Berlin
Lewis, J.R.: Psychometric evaluation of the post-study system usability questionnaire: The PSSUQ. In: Proceedings of the Human Factors Society Annual Meeting. Sage Publications Sage CA: Los Angeles, CA (1992)
Lewis, J.R.: Psychometric evaluation of the PSSUQ using data from five years of usability studies. Int. J. Human-Comput. Interact. 14(3–4), 463–488 (2002)
Sauro, J., SUPR-Q: A comprehensive measure of the quality of the website user experience. J. usability stud. 10(2) (2015)
Sauro, J.: MeasuringU: 10 Things To Know About The Single Ease Question (SEQ). (2012)
Sauro, J., Dumas J.S.: Comparison of three one-question, post-task usability questionnaires. In: Proceedings of the SIGCHI conference on human factors in computing systems (2009)
StataCorp, Stata Statistical Software: Release 16. 2019, StataCorp LLC: College Station, TX.
Braun, V., Clarke, V.: Using thematic analysis in psychology. Qual. Res. Psychol. 3(2), 77–101 (2006)
Abd-Alrazaq, A., et al.: Technical metrics used to evaluate health care chatbots: scoping review. JMIR 22(6), e18301 (2020)
Storozuk, A., Ashley, M., Delage, V., Maloney, E.A.: Got bots? Practical recommendations to protect online survey data from bot attacks. Quant. Methods Psychol. 16(5), 472–481 (2020)