Usability evaluation of mobile applications using ISO 9241 and ISO 25062 standards
Tóm tắt
This paper presents an empirical study based on a set of measures to evaluate the usability of mobile applications running on different mobile operating systems, including Android, iOS and Symbian. The aim is to evaluate empirically a framework that we have developed on the use of the Software Quality Standard ISO 9126 in mobile environments, especially the usability characteristic. To do that, 32 users had participated in the experiment and we have used ISO 25062 and ISO 9241 standards for objective measures by working with two widely used mobile applications: Google Apps and Google Maps. The QUIS 7.0 questionnaire have been used to collect measures assessing the users’ level of satisfaction when using these two mobile applications. By analyzing the results we highlighted a set of mobile usability issues that are related to the hardware as well as to the software and that need to be taken into account by designers and developers in order to improve the usability of mobile applications.
Tài liệu tham khảo
Ahmadi H, Kong J (2008) Efficient web browsing on small screens. Proceedings of the working conference on advanced visual interfaces (AVI ‘08). ACM, New York, NY, USA, pp 23–30
Brewster S (2002) Overcoming the lack of screen space on mobile computers. Personal Ubiquitous Comput 6:188–205
Chin JP, Diehl VA, Norman KL (1988) Development of an instrument measuring user satisfaction of the human–computer interface. In: CHI 88 conference proceedings: human factors in computing systems. ACM Press, New York, pp 213–218
Cisco Visual Networking Index (2014) Global mobile data traffic forecast update, 2012–2017. http://www.cisco.com/en/US/solutions/collateral/ns341/ns525/ns537/ns705/ns827/white_paper_c11-520862.html. Accessed Nov 2014
Constantinos KC, Dan K (2007) A research agenda for mobile usability. In: Proceedings on CHI ‘07 extended abstracts on human factors in computing systems, San Jose, CA, USA, pp 2345-2350
Dey AK, Salber D, Abowd GD (2001) A conceptual framework and a toolkit for supporting the rapid prototyping of context-aware applications. Human Comput Interact 16, pp 2–4
Dumas JS, Redish JC (1999) A practical guide to usability testing. Intellect Book, Portland
Echtibi A, Zemerly MJ, Berri J (2009) A service-based mobile tourist advisor. Int J Comput Inf Syst Indus Manag Appl 1, pp 177–187
Gartner Website (2014) Gartner says more than 1 billion PCs in use worldwide and headed to 2 billion units by 2014. [Online]. http://www.gartner.com/it/page.jsp?id=703807. Accessed Nov 2014
Geven A, Sefelin R, Tscheligi M (2006) Depth and breadth away from the desktop: the optimal information hierarchy for mobile use. Proceedings of the 8th conference on Human-computer interaction with mobile devices and services (MobileHCI ‘06). ACM, New York, NY, USA, pp 157–164
Harper B, Slaughter L, Norman K (1990) Questionnaire administration via the www: a validation and reliability study for a user satisfaction questionnaire. Retrieved on December 22 2002 from http://www.lap.umd.edu/webnet/paper.html
Hussain A, Kutar M (2009) Usability metric framework for mobile phone application. In: Proceedings of the 10th annual conference on the convergence of telecommunications, networking and broadcasting, Liverpool, UK
Hussain A, Kutar M (2012a) Usability evaluation of SatNav application on mobile phone using mGQM. Int J Comput Inf Syst Ind Manag Appl 4:92–100
Hussain A, Kutar M (2012b) Apps vs devices: Can the usability of mobile apps be decoupled from the device? IJCSI Int J Comput Sci Issues 9(3):11–16
Idri A, Moumane K, Abran A (2013) On the use of software quality standard ISO/IEC9126 in mobile environments. In: 20th APSEC conference, Bangkok, pp 1–8
ISO (1998) International Standard Organization: ISO 9241-11(Guidance on usability), International Standard: ISO 9241-11(Guidance on usability)
ISO 9126-2 (2001) ISO TR 9126-2: Software engineering—Product quality—Part 2: external metrics. International Organization for Standardization (ISO), Geneva
ISO/IEC 25010-2 (2008) Systems and software engineering—Software product quality requirements and evaluation (SQuaRE) Quality Model. ISO
ISO/IEC TR 25060 (2010) Software product quality requirements and evaluation (SQuaRE)—Common industry format (CIF) for usability—general framework for usability-related information. ISO
ISO/IEC 25062 (2006) Software engineering —software product quality requirements and evaluation (SQuaRE)-common industry format (CIF) for usability test reports. ISO
Johnson P (1998a) Usability and mobility; interactions on the move. In: Proceedings of the first workshop on human-computer interaction with mobile devices, Glasgow, Scotland, GIST Technical Report G98-1
Johnson P (1998b) Usability and mobility: interactions on the move. In: Proceedings of the first workshop on human–computer interaction with mobile devices
Kaikkonen A, Kekäläinen A, Cankar M, Kallio T, Kankainen A (2005) Usability testing of mobile applications: a comparison between laboratory and field testing. J Usability Study 1:4–16
Kim L, Albers MJ (2001) Web design issues when searching for information in a small screen display. In: Proceedings of the 19th annual international conference on computer documentation, Sante Fe, New Mexico, USA, pp 193–200
Kitchenham BA et al (2002) Preliminary guidelines for empirical research in software engineering. IEEE Trans Softw Eng 28(8):721–734
Kjeldskov J, Graham C (2003) A review of mobile HCI research methods. In: Proceedings of the 5th international mobile HCI 2003 conference, Udine, Italy, Springer, pp 317–335
Kjeldskov J, Stage J (2004) New techniques for usability evaluation of mobile systems. Int J Hum Comput Stud 60:599–620
Ling C, Hwang W, Salvendy G (2006) Diversified users’ satisfaction with advanced mobile phone features. Univ Access Inf Soc 5(2):239–249
Longoria R (2001) Designing mobile applications: challenges, methodologies, and lessons learned. In: Smith MJ, Salvenly G, Harris D, Koubek RJ (eds) Usability evaluation and interface design: cognitive engineering, intelligent agents and virtual reality. LEA, Publisher Mahwah, London, pp 91–95
MacKenzie IS, Zhang SX (1999) The design and evaluation of a high performance soft keyboard. In: Proceedings of the SIGCHI conference on human factors in computing systems: the CHI is the limit (CHI’99), May 15–20, Pittsburgh, Pennsylvania, USA, pp 25–31
Mao E, Srite M, Thatcher JB, Yaprak O (2005) A research model for mobile phone service behaviors: empirical validation in the U.S. and Turkey. J Glob Inf Technol Manag 8(4):7–28
Nielsen J (1994) Usability engineering. Morgan Kaufmann, London
Nielsen C (1998) Testing in the field. In: Werner B (ed) Proceedings of the third Asia Pacific computer human interaction conference. IEEE Computer Society, Washington
Nielsen J, Landauer TK (1993) A mathematical model of the finding of usability problems. In: Proceedings of the INTERCHI ‘93 conference on human factors in computing systems. IOS Press: Amsterdam
Oehl M, Sutter C, Ziefle M (2007) Considerations on efficient touch interfaces—how display size influences the performance in an applied pointing task. In: Smith MJ, Salvendy G (eds) HCII 2007. LNCS, vol 4557. Springer, Heidelberg, pp 136–143
Pascoe J, Ryan N, Morse D (2000) Using while moving: HCI issues in fieldwork environments. Trans Comput Hum Interact 7(3):417–437
Petrie H, Johnson V, Furner S, Strothotte T (1998) Design lifecycles and wearable computers for users with disabilities. In: Proceedings of the first workshop on human–computer interaction with mobile devices, Glasgow
Preece J (1993) A guide to usability: human factors in computing. Addison Wesley, The Open University, Boston
Rakkolainen I, Vainio T (2001) 3D City Info for mobile users. Comput Graph 25:619–625
Ryan C, Gonsalves A (2005) The effect of context and application type on mobile usability: an empirical study. In: The proceeding of the 28th Australasian computer science conference, Australia, 2005, pp 115–124
Sales Force Marketing Cloud (2014) Mobile behavior report: http://www.salesforce.com/marketing-cloud/overview/, http://www.exacttarget.com/sites/exacttarget/files/deliverables/etmc-2014mobilebehaviorreport.pdf
Schmiedl G, Seidl M, Temper K (2009) Mobile phone web browsing: a study on usage and usability of the mobile web. In: Proceedings of the 11th international conference on human–computer interaction with mobile devices and services (MobileHCI ‘09). ACM, New York, NY, USA
Sears A, Jacko JA (2000) Understanding the relation between network quality of service and the usability of distributed multimedia documents. Hum Comput Interact 15:43–68
Shrestha S (2007) Mobile web browsing: usability study. In: Proceedings of the 4th international conference on mobile technology, applications, and systems and the 1st international symposium on Computer human interaction in mobile technology (Mobility ‘07). ACM, New York, NY, USA, pp 187–194
Soukoreff RW, MacKenzie IS (1995) Theoretical upper and lower bounds on typing speed using a stylus and soft keyboard. Behav Inf Technol 14:370–379
Suzuki S, Nakao Y, Asahi T, Bellotti V, Yee N, Fukuzumi S (2009) Empirical comparison of task completion time between mobile phone models with matched interaction sequences. In: Jacko JA (ed) Human-Computer Interaction, Part III, LNCS, vol 5612. Springer, Berlin, Heidelberg, pp 114–122
Tamminen S, Oulasvirta A, Toiskallio K, Kankainen A (2004) Understanding mobile contexts. Spec Issue J Personal Ubiquitous Comput 8:135–143
van Elzakker C et al (2008) Field-based usability evaluation methodology for mobile geo-applications. Cartogr J 45:139–149
Wohlin C, Runeson P, Hst M, Ohlsson MC, Regnell B, Wesslén A (2012) Experimentation in software engineering: an introduction. Kluwer Academic Publishers, Norwell