Qualitative usability feature selection with ranking: a novel approach for ranking the identified usability problematic attributes for academic websites using data-mining techniques

Human-centric Computing and Information Sciences - Tập 7 - Trang 1-24 - 2017
Kalpna Sagar1, Anju Saha1
1University School of Information and Communication Technology, Dwarka, Delhi, India

Tóm tắt

The aim of this study is to identify common usability problematic patterns that belong to top-50 academic websites as a whole and then ranking of these identified usability problems is also provided. In this study, a novel approach is proposed that is based upon the integration of conventional usability testing and heuristic evaluation with data-mining knowledge discovery process. An experiment is conducted to evaluate ISO 9241-151 guidelines under 16-different categories by hundred participants who are frequent users of academic websites. After evaluation, the qualitative usability data is collected and different data-mining techniques i.e. association rule and decision tree are applied to recognize fully functional and problematic usability attributes. Identified problematic attributes represent common usability problems patterns related to academic websites from the qualitative viewpoint only. This study further prioritizes these problematic attributes by using the ranking algorithm that represents the order in which usability issues must be resolved. In this study, 16-different categories are considered for usability evaluation of academic websites. The results show that no issues are identified in two-categories i.e. {Headings_Titles_Labels and The Home_Page}. In Scrolling and Paging category, horizontal scrolling is identified as a major issue whereas, in Internationalization category, the users do not identify supported languages on most of the academic websites. Users do not find websites to be highly secured under Security category. Our findings investigate that most of the issues are found in Search and Social Media categories. Furthermore, users easily locate 50.53% guidelines on websites as fully functional whereas, 49.46% of characteristics are considered as problematic usability features that are not functional on the academic website as a whole. Identification of common usability problems at an early stage can lower substantially the development efforts in cost and time. Software developers can restrain from these potential usability problems during the development of novel systems under the same context. Providing appropriate solutions for these problems can become valuable in software development. The proposed approach concludes that conventional usability evaluation methods can go beyond just than testing of systems. The study is a milestone towards identification and prioritizing problematic usability features for academic websites and helps in providing the wholistic approach of usability problematic patterns for web-domain.

Tài liệu tham khảo

Dumas SJ, Redish CJ (2000) A practical guide to usability testing. Intl. Specialized Book Service Inc., Portland

Institute of Electrical and Electronics Engineers (1990) IEEE standard glossary of software engineering terminology IEEE std. 610.12-1990. Institute of Electrical and Electronics Engineers, Los Alamitos

International Organization for Standardization, ISO 9241-11 (1998) Ergonomic requirements for office work with visual display terminals (VDTs). Part 11: guidance on usability. International Organization for Standardization, Geneva

Maguire M (2001) Context of use within usability activities. Int J Hum Comput Stud 55:453–483

Ivory YM, Hearst AM (2001) The state of the art in automating usability evaluation of user interfaces. ACM Comput Surv 33:470–516

Nielsen J (1993) Usability engineering. M. Kaufman Publishers Inc, San Francisco

Gonzalez MP, Granollers T, Lores J (2006) A hybrid approach for modelling early prototype evaluation under user-centred design through association rules. In: Proceeding XIII Intl. Workshop Design. Specification and verification of interactive system DSV-IS ’06. Sponsored by ACM SIGCHI. Eurographics, IFIP WG 13.5. Dublin. Ireland (Lecture Notes in Computer Science Springer Series)

Gonzalez MP, Lores J, Granollers (2008) Enhancing usability testing through datamining techniques: a novel approach to detecting usability problem patterns for a context of use. Inform Softw Technol 50:547–568

Tiedtke T, Martin C, Gerth N (2002) Awusa. A tool for automated website usability analysis. In: 9th International Workshop DSVIS

Alipio J, Pocas J, Azevedo P (2002) Recommendation with association rules: a web mining application. In: Data mining and warehouses conference IS-2002

Finlay J (1997) Machine learning: a tool to support improved usability. Appl Arti Intell 11:633–665

Sagar K, Saha A (2016) Enhancing usability inspection through data-mining techniques: an automated approach for detecting usability problem patterns of academic websites. In: International conference on intelligent human computer interaction. Springer, Cham, pp 229–247

Moumane K, Idri A, Abran A (2016) Usability evaluation of mobile applications using ISO 9241 and ISO 25062 standards. SpringerPlus 5:1–15

Jankowski J, Grabowski A (2015) Usability evaluation of vr interface for mobile robot teleoperation. Int J Hum Comput Interaction 31:882–889

Ji GY, Park HJ, Lee C (2006) A usability checklist for the usability evaluation of mobile phone user interface. Int J Hum Comput Interaction 3(3):207–231

Kjeldskov J, Stage J (2004) New techniques for usability evaluation of mobile systems. Int J Hum Comput Stud 60:599–620

Erickson W, Trerise S, Lee C (2013) The accessibility and usability of college websites: is your website presenting barriers to potential students? Commun College J Res Pract 37:864–876

Fernandez A, Insfran E, Abrahão S (2011) Usability evaluation methods for the web: a systematic mapping study. Inform Softw Technol 53:789–817

Aziz MA, Isa WARWM, Nordin N (2010) Accessing the accessibility and usability of malaysia higher education website. In: IEEE in international conference on user science and engineering. pp 203–208

Panach IJ, Juristo N, Valverde F (2015) A framework to identify primitives that represent usability within model-driven development methods. Inform Softw Technol Elsevier 58:338–354

Lee S, Cho JE (2007) Usability evaluation of korean e-government portal. In: Universal access in human-computer interaction applications and services. Springer, New York, pp 64–72

Sauro J, Kindlund E (2005) A method to standardize usability metrics into a single score. ACM HCI, New York

Bak JO, Nguyen K, Risgaard P, Stage J (2008) Obstacles to usability evaluation in practice: a survey of software development organizations. Proc. NordiCHI. ACM Press, New York

Ardito C, Buono P, Caivano D, Costabile MF, Lanzilotti R, Bruun A, Stage J (2011) Usability evaluation: a survey of software development organizations. In: Proc. SEKE, Knowledge Systems Institute Graduate School, Skokie

Bruun A, Stage J (2012) Training software development practitioners in usability testing: an assessment acceptance and prioritization. OZCHI’12, November 26–30

Bevan N (2005) Guidelines and standards for web usability. In: Proceedings of HCI International, vol 2005. Lawrence Erlbaum, New Jersey

http://www.iso.org/iso/iso_catalogue/catalogue_tc/catalogue_detail.htm?csnumber=37031. Accessed 5 Aug 2016

Teruel AM, Navarro E, Jaquero LV et al (2014) A cscw requirements engineering case tool: development and usability evaluation. Inform Softw Technol 56:922–949

Rodriguez DF, Acuna TS, Juristo N (2015) Design and programming patterns for implementing usability functionalities in web applications. J Syst Softw 105:107–124

McClellan AM, Karumur PR, Vogel IR et al (2016) Designing an educational website to improve quality of supportive oncology care for women with ovarian cancer: an expert usability review and analysis. Int J Hum Comput Interaction 32:297–307

Somervell J, McCrickard D (2004) Comparing generic vs. specific heuristics: Illustrating a new UEM comparison technique. In: Proceedings of the human factors and ergonomics society. pp 2480–2484

Hvannberg ET, Law EL, Lárusdóttir MK (2007) Heuristic evaluation: comparing ways of finding and reporting usability problems. Interact Comput 19(2):225–240

Nielsen J (1994) Heuristic evaluation. In: Nielsen J, Mack RL (eds) Usability inspection methods. Wiley, New York

Dubey KS, Gulati A, Rana A (2012) Usability evaluation of software systems using fuzzy multi-criteria approach. Int J Comput Sci Issues 9(2):1694

Dubey KS, Rana A, Sharma A (2012) Usability evaluation of object oriented software system using fuzzy logic approach. Int J Comput Appl 43(19):0975–8887

Gupta D, Ahlawat AK (2017) Taxonomy of GUM and usability prediction using GUM multistage fuzzy expert system. Int Arab J Inform Technol 16(3):2019

Gupta D, Ahlawat AK, Sagar K (2017) Usability prediction & ranking of SDLC models using fuzzy hierarchical usability model. Open Eng 7(1):161–168

Gupta D, Ahlawat AK (2016) Usability determination using multistage fuzzy system. Procedia Comput Sci 78:263–270

Mikut R, Reischl M (2011) Data mining tools. In: Wiley interdisciplinary reviews: data mining and knowledge discovery, vol 1. pp 431–443

https://rapidminer.com/. Accessed 23 Sept 2016

http://www.rdatamining.com/. Accessed 23 Sept 2016

Demsar J, Zupan B, Leban G (2004) Orange: from experimental machine learning to interactive data mining white paper. Faculty of Computer and Information Science University of Ljubljana, Ljubljana

Ian H, Witten Frank E (2005) Data Mining: Practical machine learning tools and techniques. M. Kaufman Publishers Inc., San Francisco

WEKA. http://www.cs.waikato.ac.nz/ml/weka/. Accessed 14 Oct 2016

Han J, Kamber M (2000) Data mining: concepts and techniques. M. Kaufmann, San Francisco

Mitchell T (1997) Machine learning. McGraw Hill, New York

Hall Mark A, Holmes G (2003) Benchmarking attribute selection techniques for discrete class data mining. IEEE Trans Knowl Data Eng 15(6):1437–1447

Kohavi R, John HG (1997) Wrappers for feature subset selection. Artif Intell 97(1):273–324

Pyle D, Kamber M (1999) Data preparation for data mining. M. Kaufmann, San Francisco

http://classroom.synonym.com/advantage-doing-experiments-large-samples-13175.html. Accessed 5 Jun 2017

Thông tin
Thông tin xuất bản

Human-centric Computing and Information Sciences

Tập 7

1-24

Thông tin tác giả