Usability assessment of scholarly publishers’ online journal interfaces

Journal of Data, Information and Management - Tập 5 - Trang 363-374 - 2023
Serhat Peker1, Gonca Gokce Menekse Dalveren2
1Department of Management Information Systems, Izmir Bakirçay University, İzmir, Turkey
2Department of Software Engineering, Atilim University, Ankara, Turkey

Tóm tắt

A well-designed and user-friendly online journal interface not only enhances researchers’ satisfaction but also bolsters the reputation of academic publishers within the scholarly community. Consequently, the present study undertakes an examination of the usability aspects pertaining to online journal interfaces offered by five prominent academic publishers: Wiley, Sage, Elsevier, Springer, and Taylor & Francis. This investigation encompasses a combination of user testing and post-questionnaire methodologies, aiming to accrue both quantitative and qualitative data concerning user task execution and satisfaction. The research findings spotlight the varying degrees of usability across major academic publishers and emphasize the critical role of design in enhancing researchers’ experiences. By identifying both usability strengths and weaknesses, along with offering actionable areas for improvement, this study adds a valuable perspective to the enhancement of academic journal interfaces.

Tài liệu tham khảo

Abras C, Maloney-Krichmar D, Preece J (2004) User-centered design. Bainbridge, W Encycl Human-Computer Interact. Thousand Oaks Sage Publ 37:445–456 Alasem AN (2013) Evaluating the usability of Saudi Digital Library’s Interface (SDL). In: Lecture Notes in Engineering and Computer Science, pp 178–181 Barnum CM, Dragga S (2001) Usability testing and research. Allyn and Bacon Inc Bhosale U (2021) STM Report: global research trends and transformation in Open Access Publishing. In: Enago Acad Bond RR, Finlay DD, Nugent CD et al (2014) A usability evaluation of medical software at an expert conference setting. Comput Methods Programs Biomed 113:383–395. https://doi.org/10.1016/j.cmpb.2013.10.006 Bornmann L, Haunschild R, Mutz R (2021) Growth rates of modern science: a latent piecewise growth curve approach to model publication numbers from established and new literature databases. Humanit Soc Sci Commun 8(1):1–15. https://doi.org/10.1057/s41599-021-00903-w Dumas J, Redish J (1999) A practical guide to usability testing. Intellect Books Forgues B, Liarte S (2013) Academic publishing: past and future. Manag 16:739–756. https://doi.org/10.3917/mana.165.0739 Hariri N, Norouzi Y (2011) Determining evaluation criteria for digital libraries’ user interface: a review. Electron Libr 29:698–722. https://doi.org/10.1108/02640471111177116/FULL/HTML Hasan L, Morris A, Probets S (2012) A comparison of usability evaluation methods for evaluating e-commerce websites. Behav Inf Technol 31:707–737. https://doi.org/10.1080/0144929X.2011.596996 Hass C (2019) A practical guide to usability testing. In: Consumer Informatics and Digital Health. Springer Nature, Cham pp 107–124 Holzinger A (2005) Usability engineering methods for software developers. Commun ACM 48:71–74 Huang Z (2020) Usability of tourism websites: a case study of heuristic evaluation. New Rev Hypermedia Multimed 26:55–91. https://doi.org/10.1080/13614568.2020.1771436 Hurd JM, Blecic DD, Robinson AE (2014) Performance measures for electronic journals: a user-centered approach. Electronic resources and services in Sci-Tech libraries. Routledge, pp 57–71 ISO/TC 159/SC 4 (1998) Ergonomics of human-system interaction Jeng J (2005) Usability assessment of academic digital libraries: effectiveness, efficiency, satisfaction, and learnability. Libri 55:96–121. https://doi.org/10.1515/LIBR.2005.96/HTML Joo S, Lin S, Lu K (2011) A usability evaluation model for academic Library websites: Efficiency, Effectiveness and Learnability. J Libr Inf Stud 2:11–26 Kani-Zabihi E, Ghinea G, Chen SY (2006) Digital libraries: what do users want? Online Inf Rev 30:395–412. https://doi.org/10.1108/14684520610686292/FULL/HTML Kengeri R, Seals CD, Harley HD et al (1998) Usability study of digital libraries: ACM, IEEE-CS, NCSTRL, NDLTD. Int J Digit Libr 2:157–169. https://doi.org/10.1007/s007990050044 Kling R, Callahan E (2003) Electronic journals, the internet, and scholarly communication. Annu Rev Inf Sci Technol 37:127–177. https://doi.org/10.1002/aris.1440370105 Lamb C (2004) Open access publishing models: opportunity or threat to scholarly and academic publishers? Learn Publ 17:143–150 Larivière V, Haustein S, Mongeon P (2015) The oligopoly of academic publishers in the digital era. PLoS ONE 10:e0127502. https://doi.org/10.1371/journal.pone.0127502 Lewis C (1982) Using the thinking aloud method in cognitive interface design. IBM Research Report RC 9265. IBM Thomas J. Watson Research Center, P.O. Box 218, Yorktown Heights, New York Macakoğlu ŞS, Peker S, Medeni İT (2023) Accessibility, usability, and security evaluation of universities’ prospective student web pages: a comparative study of Europe, North America, and Oceania. Univers Access Inf Soc 22:671–683. https://doi.org/10.1007/s10209-022-00869-9 Menekse Dalveren GG, Peker S (2021) Accessibility and usability evaluation of digital library article pages. In: App and Website Accessib. ility Developments and Compliance Strategies. IGI Global, 2022. pp 58–76. https://doi.org/10.4018/978-1-7998-7848-3.ch003 Nielsen J (1993) Usability Engineering. Morgan Kaufmann Nielsen J (2006) Quantitative studies: how many users to test? In: Nielsen Norman Gr. Available at: https://www.nngroup.com/articles/quantitative-studies-how-many-users/ Noh Y (2010) A study on developing evaluation criteria for electronic resources in evaluation indicators of libraries. J Acad Librariansh 36:41–52. https://doi.org/10.1016/j.acalib.2009.11.005 Okhovati M, Karami F, Khajouei R (2017) Exploring the usability of the central library websites of medical sciences universities. J Librariansh Inf Sci 49:246–255. https://doi.org/10.1177/0961000616650932 Rubin J, Chisnell D (2008) Handbook of usability testing: how to plan, design and conduct effective tests. John Wiley and Sons Van Den Haak MJ, De Jong MDT, Schellens PJ (2003) Retrospective vs. concurrent think-aloud protocols: testing the usability of an online library catalogue. Behav Inf Technol 22:339–351. https://doi.org/10.1080/0044929031000 Verkijika SF, De Wet L (2018) A usability assessment of e-government websites in Sub-saharan Africa. Int J Inf Manage 39:20–29. https://doi.org/10.1016/j.ijinfomgt.2017.11.003 Walia PK, Gupta M (2013) Usability analysis of homepage of websites of national libraries in Asia. Libr Philos Pract 2013:1–21 Ware M, Mabe M, Consulting MW (2015) The STM Report: An overview of scientific and scholarly journal publishing Zhang X, Liu J, Li Y, Zhang Y (2009) How usable are operational digital libraries: a usability evaluation of system interactions. In: EICS’09 - Proceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems. pp 177–186