A systematic literature review of semiotics perception in user interfaces
Tóm tắt
The underlying objective of this literature review was to investigate what kinds of semiotics researches have been employed in user interfaces design and usability evaluation, and how were they employed.
This research follows a systematic literature review process that consists of three key stages: planning the review, conducting the review, and reporting the review. Starting with an initial set of about 1,000 research articles, 65 were selected for this review, using an inclusion and exclusion criteria. Qualitative and quantitative data were extracted from the selected literatures following a data extraction strategy in six themes of data extraction. The extracted data were synthesized to formulate the stated research questions to obtain the review goals.
This systematic review identified research strengths, gaps, and challenges. Apart from this, further research possibilities were also explored in this review. For research, the review showed clear needs for more researches to increase both the number and the quality of studies that can be focused on the research gaps identified by this systematic review related to: outcome validation; cultural issues consideration; user interfaces of mobile applications and websites; semiotics perception in usability evaluation; and further improve the value and applicability of research ideas. For practice, the review showed the significance of semeiotics in user interface design and usability evaluation to develop users' intuitive interfaces for boosting the system's usability.
Based on a systematic literature review, the paper not only depicts the current status of semiotics research in user interface design and evaluation, but also provides a number of implications for research and practice. Thus, the review contributes to the scientific community of user interface design and evaluation, as well as suggesting the actual advances in the state of the practice in semiotics research on user interface.
Từ khóa
Tài liệu tham khảo
Abdulhassan, R.S., Masood, M. and Hosam, A.S. (2011), “Semiotic differences of Macintosh Os X & Microsoft Windows 7 based on metaphors and interpretation”, Proceeding of the Second International Conference on Intelligent Systems, Modelling and Simulation (ISMS 2011), Phnom Penh, Cambodia, pp. 209‐213.
Amare, N. and Manning, A. (2006), “Back to the future: a usability model of hypertext based on the semiotics of C.S. Peirce”, Proceeding of IEEE International Professional Communication Conference, Saratoga Springs, NY, pp. 47‐56.
Andersen, P.B. (1992), “Computer semiotics”, Scandinavian Journal of Information Systems, Vol. 4, pp. 3‐30.
Andersen, P.B. (2001), “What semiotics can and cannot do for HCI”, Knowledge‐Based Systems, Vol. 14 No. 8, pp. 419‐424.
Barr, P., Biddle, R. and Noble, J. (2004), “A semiotic model of user‐interface metaphore”, in Liu, K. (Ed.), Virtual, Distributed and Flexible Organisations: Studies in Organisational Semiotics, Kluwer Academic Publisher, Dordrecht, pp. 189‐215.
Barron, T.M., Chiang, R.H.L. and Storey, V.C. (1999), “A semiotics framework for information systems classification and development”, Journal of Decision Support System, Vol. 1 No. 25, pp. 1‐17.
Bolchini, D., Chatterji, R. and Speroni, M. (2009), “Developing heuristics for the semiotics inspection of websites”, Proceedings of the 27th ACM International Conference on Design of Communication, Indiana, USA.
Bonacin, R., Baranauskas, M.C.C. and dos Santos, T.M. (2007), “A semiotic‐based framework for the development of tailorable web applications”, in Jacko, J. (Ed.), Human‐Computer Interaction, Part IV, HCII 2007, LNCS 4553, Springer, Berlin, pp. 859‐868.
Caldwell, J. (2009) “Safety icons and usability: a Peircean reanalysis”, Proceeding of the IEEE International Professional Communication Conference (IPCC 2009), Hilton Hawaiian Village Beach, Waikiki, Springer, Hawaii.
Cattuto, C.V., Loreto, V. and Pietronero, L. (2006), “Semiotic dynamics in online social communities”, The European Physical Journal C, Vol. 46 No. 2, pp. 32‐37.
Chan, M. and Liu, K. (2005), “Applying semiotic analysis to the design and modeling of distributed multimedia systems”, in Shen, W., Lin, Z., Barthès, J.‐P.A. and Li, T. (Eds), 8th International Conference Computer Supported Cooperative Work in Design (CSCWD 2004), LNCS, Springer, Guiyang, pp. 437‐447.
Corea, S. (2005), “Refocusing systems analysis of organizations through a semiotic lens: interpretive framework and method”, Journal of Systematic Practice and Action Research, Vol. 18 No. 4, pp. 339‐346.
de Souza, C.S. (2005a), “Semiotic engineering: bringing designers and users together at interaction time”, Interdisciplinary Journal of Human‐Computer Interaction – Interacting with Computers, Vol. 17 No. 3, pp. 317‐341.
de Souza, C.S. (2005b), The Semiotic Engineering of Human‐Computer Interaction, The MIT Press, Cambridge, MA.
de Souza, C.S. and Cypher, A. (2008), “Semiotic engineering in practice: redesigning the CoScripter interface”, Proceedings of the Working Conference on Advanced Visual Interfaces (AVI 2008), ACM, Napoli, pp. 165‐172.
de Souza, C.S., Barbosa, S.D.J. and Prates, R.O. (2001), “A semiotics engineering approach to user interface design”, Journal of Knowledge Based System, Vol. 14 No. 8, pp. 461‐465.
de Souza, C.S., Leitão, C.F., Prates, R.O. and da Silva, E.J. (2006), “The semiotic inspection method”, Proceedings of VII Brazilian Symposium on Human Factors in Computing Systems (IHC 2006), ACM, Natal, pp. 148‐157.
dos Reis, J.C., Bonacin, R. and Baranauskas, M.C.C. (2010), “Search informed by a semiotic approach in social network services”, Proceeding of the 10th Annual International Conference on New Technologies of Distributed Systems (NOTERE 2010), Tunisia, pp. 321‐326.
Ferreira, J. (2004), “Semiotic explorations in user interface design”, unpublished Masters dissertation, Department of Computer Science, Victoria University of Wellington, Wellington.
Ferreira, J., Barr, P. and Noble, J. (2005), “The semiotics of user interface redesign”, Proceedings of 6th Australasian User Interface Conference (AUIC 2005), Newcastle, NSW, Australia.
Ferreira, J., Crossler, R. and Haggard, G. (2007), “Improving mutual understanding of development artifacts: a semiotics‐based approach”, Proceedings of the Americas Conference on Information Systems (AMCIS 2007), Colorado, USA.
Ferreira, J., Noble, J. and Biddle, R. (2006), “A case for iconic icons”, Proceedings of 7th Australasian User Interface Conference (AUIC 2006), Hobart, Australia.
Fone, W. (2004), “Applying semiotics to the design of teaching tools”, Proceedings of the IEEE International Conference on Advanced Learning Technologies (ICALT ‘04), Joensuu, Finland, pp. 669‐671.
Frege, G. (1879), Begriffsschrift, English Translation, Edited by van Heijenoort, J., Harvard University Press, Cambridge, MA, pp. 1‐82.
French, T., Polovina, S. and Vile, A. (1999), “Semiotics for e‐commerce: shared meanings and generative futures”, Proceedings of BIT’99, UK.
Goonetilleke, R.S., Shih, H.M., On, H.K. and Fritsch, J. (2001), “Effects of training and representational characteristics in icon design”, International Journal of Human‐Computer Studies, Vol. 55 No. 5, pp. 741‐760.
Guillemette, L. and Cossette, J. (2006), “Mode of sign production”, available at: www.signosemio.com (accessed August 30, 2011).
Hargood, C., Millard, D.E. and Weal, M.J. (2010), “Capturing the semiotic relationship between terms”, Journal of New Review Hypermedia Multimedia, Vol. 16 Nos 1/2, pp. 71‐84.
Helen, C., Purchase, H.C. and Naumann, D. (2001), “A semiotic model of multimedia: theory and evaluation”, in Syed, M.R. (Ed.), Design and Management of Multimedia Information Systems: Opportunities and Challenges, Idea Group Publishing, Hershey, PA, pp. 1‐21.
Huang, A.W. and Chuang, T. (2009), “Social tagging, online communication, and Peircean semiotics: a conceptual framework”, Journal of Information Science, Vol. 35 No. 3, pp. 340‐357.
Hynes, G.E. and Janson, M. (2007), “Using semiotic analysis to determine effectiveness of internet marketing”, Proceedings of the 2007 Association for Business Communication Annual Convention, Washington, DC.
Insfran, E. and Fernandez, A. (2008), “A systematic review of usability evaluation in web development”, Proceedings of the 2008 International Workshops on Web Information Systems Engineering (WISE 2008), Auckland, New Zealand, pp. 81‐91.
Islam, M.N. (2007), “Semiotics of the web interface: analysis and guidelines”, unpublished Masters dissertation, Facoltà di Ingegneria dell'Informazione, Politecnico di Milano, Milano.
Islam, M.N. (2011a), “A semiotics perspective to web usability: an empirical case study”, Proceedings of the IADIS International Conference on Interfaces and Human Computer Interaction (IHCI 2011), Rome, Italy.
Islam, M.N. (2011b), “Beyond users' inaccurate interpretations of web interface signs: a semiotic perception”, Proceedings of the IFIP 13th International Conference on Informatics and Semiotics in Organizations (ICISO 2011), Leeuwarden, The Netherlands.
Islam, M.N., Ali, M., Al‐Mamun, A. and Islam, M. (2010), “Semiotics explorations on designing the information intensive web interfaces”, International Arab Journal of Information Technology, Vol. 7 No. 1, pp. 45‐54.
ISO (1998), Ergonomic Requirements for Office Work with Visual Display Terminals (VDTs) – Guidance on Usability, ISO 9241‐11, International Organization for Standardization, Geneva.
Kitchenham, B.A. (2004), “Procedures for undertaking systematic reviews”, Technical Report TR/SE‐0401, Department of Computer Science, Keele University and National ICT, Eveleigh.
Kitchenham, B.A., Pfleeger, S.L., Pickard, L.M., Jones, P.W., Hoaglin, D.C., El Emam, K. and Rosenberg, J. (2002), “Preliminary guidelines for empirical research in software engineering”, IEEE Transactions on Software Engineering, Vol. 28 No. 8, pp. 721‐734.
Krogstie, J., Lyytinen, K., Opdahl, A.L., Pernici, B., Siau, K. and Smolander, K. (2004), “Research areas and challenges for mobile information systems”, International Journal of Mobile Communications, Vol. 2 No. 3, pp. 220‐234.
Kryssanov, V.V., Okabe, M., Kakusho, K. and Minoh, M. (2001), “A semiotic model of communication and its implications for the digital city development”, Proceedings of the 14th Australian Joint Conference on Artificial Intelligence: Advances in Artificial Intelligence (AI 2001), Adelaide, Australia, pp. 261‐272.
Liu, K., Crum, G. and Dines, K. (1998), “Design issues in a semiotic description of user responses to three interfaces”, International Journal of Behaviour & Information Technology, Vol. 17 No. 3, pp. 175‐184.
Luna, D., Peracchio, L.A. and de Juan, M.D. (2008), “Cross–cultural and cognitive aspects of website navigation”, Academy of Marketing Journal, Vol. 30 No. 4, pp. 397‐410.
Maguire, M.C. (1999), “A review of user‐interface design guidelines for public information kiosk system”, International Journal of Human‐Computer Studies, Vol. 50 No. 3, pp. 263‐286.
Marghescu, D. (2008), “Usability evaluation of information systems: a review of five international standards”, Proceedings of the 16th International Conference on Information Systems Development (ISD 2007), Galway, Ireland, pp. 131‐142.
Mendes, E. (2005), “A systematic review of web engineering research”, Proceedings of the International Symposium on Empirical Software Engineering (ISESE, 2005), Australia, pp. 498‐507.
Morris, C. (1938), “Foundations of the theory of signs”, International Encyclopedia of Unified Science, Vol. 1 No. 2.
Neumuller, M. (2001), “Hypertext semiotics in the commercialized internet”, unpublished doctoral dissertation, Wirtschaftsuniversität Wien, Vienna.
O'Neill, S. and Benyon, D. (2003a), “An exploration of a semiotic model of interaction through interactive media”, Proceedings of the Workshop in HCI, the Arts and the Humanities, York.
O'Neill, S. and Benyon, D. (2003b), “A semiotic approach to investigating presence”, Proceeding of 3rd International Conference on Computational Semiotics for Games and New Media (COSIGN 2003), University of Teesside, Middlesbrough.
O'Neill, S., Benyon, D. and Turner, S. (2002), “Semiotics and interaction analysis”, Proceeding of the 11th European Conference on Cognitive Ergonomics (ECCE‐11), Catania Sicily.
Peirce, C.S. (1931), Collected Writings, Edited by Hartshorne, C., Weiss, P. and Burks, A., Vol. 8, Harvard University Press, Cambridge, MA.
Prado, A.B., Baranauskas, M.C.C. and Medeiros, C.M.B. (2000), “Cartography and geographic information systems as semiotic systems: a comparative analysis”, Proceeding of the 8th ACM International Symposium on Advances in Geographic Information Systems (GIS 2000), Washington, DC, USA.
Prates, R.O., de Souza, C.S. and Garcia, A.C.B. (1997), “A semiotic framework for multi‐user interfaces”, SIGHCI Bulletin, Vol. 29 No. 2, pp. 28‐39.
Robert, S., Robert, B. and Sandy, F.L. (1992), New Vocabularies in Film Semiotics: Structuralism, Post‐structuralism and Beyond, Routledge, London.
Roberto, V. and Toppano, E. (2009), “Semiotic design of a hypermedia for cultural heritage”, Proceeding of the 15th International Conference on Image Analysis and Processing (ICIAP 2009), Vietri sul Mare, Italy, pp. 425‐433.
Salgado, L.C.d.C., de Souza, C.S. and Leitão, C.F. (2009), “A semiotic inspection of ICDL”, in Carlos José Pereira de Lucena (Ed.), Monografias em Ciência da Computação, No. 31/09, PontifÍcia Universidade CatÓlica do Rio de Janeiro, Gávea.
Saussure, F.D. (1983), Course in General Linguistics, Duckworth, London (translated by Roy Harris).
Sherson, G.W. (2000), The Relevance of Semiotics to the Internet: How Web Designers use Metaphors in Web Development, available at: www.shersonmedia.com/grant/cv/items/papers/Semiotics_and_Web_Design.pdf.
Siau, K. and Tian, Y. (2005), “A semiotics view of modeling method complexity – the case of UML”, Proceedings of the Americas Conference on Information Systems (AMCIS 2005), Nebraska, USA.
Silveira, M.S., de Souza, C.S. and Barbosa, S.D.J. (2001), “Semiotic engineering contributions for designing online help systems”, Proceedings of the 19th Annual International Conference on Computer Documentation (SIGDOC 2001), Sante Fe, NM, USA, pp. 31‐38.
Sjöström, J. and Goldkuhl, G. (2004), “The semiotics of user interfaces: a socio‐pragmatic perspective”, in Liu, K. (Ed.), Virtual, Distributed and Flexible Organisations: Studies in Organisational Semiotics, Kluwer Academic Publisher, Dordrecht, pp. 217‐236.
Smart, K.L., Rice, J.C. and Wood, L.E. (2000), “Meeting the needs of users: toward a semiotics of the web”, Proceeding of the Joint IEEE International Professional Communication Conference and 18th Annual Conference on Computer Documentation (IPCC/SIGDOC 2000), Cambridge, MA, September, pp. 593‐605.
Speroni, M. (2006), “Mastering the semiotics of information‐intensive web interfaces”, unpublished doctoral dissertation, Faculty of Communication Sciences, University of Lugano, Lugano.
Sun, Z. (2010), “Analysis about intelligence evaluation based on computational semiotics theory”, Proceedings of the 3rd International Conferences on Information Management, Innovation Management and Industrial Engineering (ICIII 2010), Shenzhen, China, pp. 76‐79.
Timmins, P.J., McCormick, S., Agu, E. and Wills, C.E. (2006), “Characteristics of mobile web content”, Proceedings of IEEE Workshop on Hot Topics in Web Systems and Technologies (HOTWEB), Boston, MA, USA.
Triacca, L., Speroni, M. and Ramani, C. (2005), “Understanding semiotics issues in usability evaluation of cultural heritage websites: the DICE case study”, Studies in Communication Sciences, Vol. 5 No. 1, pp. 75‐92.
Bento, L.F.H., Prates, R.O. and Chaimowicz, L. (2009), “Using semiotic inspection method to evaluate a human‐robot interface”, Proceeding of Latin American Web Congress, pp. 77‐84.
Bilotta, E. and Pantano, P. (1995), “A semiotic approach for analysing icons in graphical user interface”, Bollettino del CIC, No. 3.
Damean, D. (2008), “Gazing at the body: a semiotic reading of advertisements”, Proceedings of IADIS International Conference Computer Graphics and Visualization, Amsterdam, The Netherlands.
Damjanovic, V., Gasevic, D., Devediiic, V.B. and Djuric, D. (2004), “The semiotics contribution on the web”, Proceeding of the 2nd IEEE International Conference on Intelligent Systems, Varna, Bulgaria, pp. 144‐149.
de Souza, C.S. (1993), “The semiotic engineering of user interface languages”, International Journal of Man‐Machine Studies, Vol. 39, pp. 753‐773.
Dormans, J. (2008), “Beyond iconic simulation”, Proceedings of the IADIS International Conference on Game and Entertainment Technologies, Amsterdam, The Netherlands.
Galarreta, D. (2008), “A contribution of a multi‐viewpoints semiotics to knowledge representation issues”, in Eklund, P.W. and Haemmerlé, O. (Eds), Supplementary Proceedings of the 16th International Conference on Conceptual Structures, Volume 354 of CEUR Workshop Proceedings, pp. 115‐122.
Henningsson, S. and Bjørn‐Andersen, N. (2009), “Exporting e‐Customs to developing countries: a semiotic perspective”, Proceedings of the Second Annual SIG GlobDev Workshop, Phoenix, USA.
Islam, M.N. (2008), “Interpretation framework for information intensive interface signs of e‐commerce websites”, Proceedings of the International Conference on Electronic Commerce in the 21st Century (ECIC 2008), Kathmandu, Nepal, pp. 24‐33.
Janson, M., Cecez‐Kecmanovic, D. and Tsotra, D. (2004), “Marketing on the internet: a semiotic analysis”, Proceedings of the 10th Americas Conference on Information Systems, New York, NY.
Joshua, C. (2009), “Safety icons and usability: a Peircean reanalysis”, Proceeding of the IEEE International Professional Communication Conference (IPCC 2009), Hilton Hawaiian Village Beach, Waikiki, Hawaii.
Malcolm, G. and Goguen, J.A. (1998), “Signs and representations: semiotics for user interface design”, in Paton, R. and Neilson, I. (Eds), Visual Representations and Interpretations, Springer Workshops in Computing.
Moritz, N. (2000), “Applying computer semiotics to hypertext theory and the world wide web”, in Reich, S. and Anderson, K.M. (Eds), 6th Workshop on Open Hypermedia Systems (OHS6)/2nd Workshop on Structural Computing (SC2), Volume 1903, Texas, USA, LNCS, Springer, Berlin.
Price, R.J. and Shanks, G. (2005), “Empirical refinement of a semiotic information quality framework”, Proceedings of the 38th Hawaii International Conference on System Sciences (HICSS '05), Vol. 8, IEEE Computer Society, Big Island, HI.
Salome, S.I. (2000), “The language of digital genres – a semiotic investigation of style and iconology on the world wide web”, Proceedings of the 33rd Hawaii International Conference on System Sciences, IEEE Computer Society, Maui, HI.
Schrøder, L. (2005), “Signs of meta‐understanding – a semiotic perspective on multidimensional ontologies and gi‐usability”, Proceedings of the Scandinavian Research Conference on Geographical Information Science (ScanGIS'05), Stockholm, Sweden, pp. 221‐230.
Tissiani, G., Hoeschl, H.C. and Barcia, R.M. (2002), “Semiotic approach for the design of adaptive graphical user interfaces using universal networking language”, Proceedings of the International Conference on Universal Knowledge and Language, Goa, India.