Empowering cultural heritage professionals with tools for authoring and deploying personalised visitor experiences
Tóm tắt
This paper presents an authoring environment, which supports cultural heritage professionals in the process of creating and deploying a wide range of different personalised interactive experiences that combine the physical (objects, collection and spaces) and the digital (multimedia content). It is based on a novel flexible formalism that represents the content and the context as independent from one another and allows recombining them in multiple ways thus generating many different interactions from the same elements. The authoring environment was developed in a co-design process with heritage stakeholders and addresses the composition of the content, the definition of the personalisation, and the deployment on a physical configuration of bespoke devices. To simplify the editing while maintaining a powerful representation, the complex creation process is deconstructed into a limited number of elements and phases, including aspects to control personalisation both in content and in interaction. The user interface also includes examples of installations for inspiration and as a means for learning what is possible and how to do it. Throughout the paper, installations in public exhibitions are used to illustrate our points and what our authoring environment can produce. The expressiveness of the formalism and the variety of interactive experiences that could be created was assessed via a range of laboratory tests, while a user-centred evaluation with over 40 cultural heritage professionals assessed whether they feel confident in directly controlling personalisation.
Tài liệu tham khảo
Alexandridis, G., Chrysanthi, A., Tsekouras, G.E., Caridakis, G.: Personalized and content adaptive cultural heritage path recommendation: an application to the Gournia and Çatalhöyük archaeological sites. In: User Modeling and User-Adapted Interaction (2019) (special issue on personalized delivery of cultural heritage content)
Antoniou, A., Lepouras, G.: Modeling visitors’ profiles: a study to investigate adaptation aspects for museum learning technologies. ACM J. Comput. Cult. Herit. 3, 2 (2010)
Aoki, P.M., Grinter, R.E., Hurst, A., Szymanski, M.H., Thornton, J.D., Woodruff, A.: Sotto voce: exploring the interplay of conversation and mobile audio spaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’02). ACM, New York, pp. 431–438 (2002)
Ardissono, L., Kuflik, T., Petrelli, D.: Personalization in cultural heritage: the road travelled and the one ahead. User Model. User Adapt. Interact. 22(1–2), 73–99 (2012). (special 20th anniversary issue)
Ardito, C., Costabile, M.F., Desolda, G., Matera, M., Piccinno, A., Picozzi, M.: Composition of situational interactive spaces by end users: a case for cultural heritage. In: Proceedings of the 7th Nordic Conference on Human–Computer Interaction: Making Sense Through Design (NordiCHI’12). ACM, New York, pp. 79–88 (2012). https://doi.org/10.1145/2399016.2399029
Ardito, C., Buono, P., Desolda, G., Matera, M.: From smart objects to smart experiences: an end-user development approach. Int. J. Hum. Comput. Stud. 114, 51–68 (2018)
Balet, O., Koleva, B., Grubert, J., Yi, K.M., Gunia, M., Katsis, A., Castet, J.: Authoring and living next-generation location-based experiences. In: Proceedings of IEEE Virtual Reality 2015, March 23–27, Arles, France (2015)
Bitgood, S.: When is “museum fatigue” not fatigue? Curator 52(2), 193–202 (2010)
Burke, R.: Hybrid web recommender systems. In: Brusilovsky, P., Kobsa, A., Nejdl, W. (eds.) The Adaptive Web. Springer, Berlin (2007)
Callaway, C., Not, E., Stock, O.: Report generation for post-visit summaries in museum environments. In: Stock, O., Zancanaro, M. (eds.) PEACH—Intelligent Interfaces for Museum Visits, pp. 71–92. Springer, Berlin (2007)
Cavada, D., Elahi, M., Massimo, D., Maule, S., Not, E., Ricci, F., Venturini, A.: Tangible tourism with the internet of things. In: Stangl, B., Pesonen, J. (eds.) Information and Communication Technologies in Tourism 2018, pp. 349–361. Springer, Cham (2018)
Ciolfi, L., Petrelli, D., Goldberg, R., Dulake, N., Willox, M., Marshall, M., Caparrelli, F.: Exploring historical, social and natural heritage: challenges for tangible interaction design at Sheffield General Cemetery. In: Proceedings of NODEM 2013: Beyond Control—the Collaborative Museum and Its Challenges, Stockholm, Sweden (2013)
Ciolfi, L., Avram, G., Maye, L., Dulake, N., Marshall, M.T., van Dijk, D., McDermott, F.: Articulating co-design in museums: reflection on two participatory processes. In: Proceedings of CSCW 2016. ACM, New York, pp. 13–25 (2016)
Ciravegna, F., Dingli, A., Wilks, Y., Petrelli, D.: Using adaptive information extraction for effective human-centred document annotation. In: Franke, J., Nakhaeizadeh, G., Renz, I. (eds.) Text Mining, Theoretical Aspects and Applications, pp. 153–164. Springer, Berlin (2003)
Cristea, A., Aroyo, L.: Adaptive authoring of adaptive educational hypermedia. In: De Bra, P., Brusilovsky, P., Conejo, R. (eds.) Proceedings of the 2nd International Conference on Adaptive Hypermedia and Adaptive Web-Based Systems, Malaga, Spain. LNCS, vol. 2347. Springe, Berlin, pp. 122–132 (2002)
Damala, A., van der Vaart, M., Clarke, L., Hornecker, E., Avram, G., Kockelkorn, H., Ruthven, I.: Evaluating tangible and multisensory museum visiting experiences: lessons learned from the meSch project. In: MW2016—Museums and the Web 2016. Published January 29, 2016. Consulted February 9, 2018 (2016)
De Bra, P., Aqerts, A., Berden, B., de Lange, B., Rousseau B., Santic, T., Smits, D., Stash, N.: AHA! the adaptive hypermedia architecture. In: Proceedings of the International Conference on Hypertext and Hypermedia 2003, Nottingham (UK), pp. 81–84 (2003)
Desolda, G., Ardito, C., Matera, M.: Empowering end users to customize their smart environments: model, composition paradigms, and domain-specific tools. ACM Trans. Comput. Hum. Interact. 24, 52 (2017). https://doi.org/10.1145/3057859
Díaz, P., Aedo, I., van der Vaart, M.: Engineering the creative co-design of augmented digital experiences with cultural heritage. In: Proceedings of International Symposium on End User Development (2015)
Economou, D., Gavalas, D., Kenteris, M., Tsekouras, G.E.: Cultural applications for mobile devices: issues and requirements for authoring tools and development platforms. SIGMOBILE Mob. Comput. Commun. Rev. 12(3), 18–33 (2008). https://doi.org/10.1145/1462141.1462145
eCultValue summary report of interviews with CH stakeholders and technology providers. eCultValue D1.1. Interview summary (2013). http://www.ecultobservatory.eu/documents. Accessed 20 July 2018
Falk, J.H.: Museums as institutions for personal learning. Daedalus 128(30), 259–275 (1999)
Falk, J.H.: Identity and the Museum Visitor Experience. Left Coast Press, Walnut Creek (2009)
Fidas, C., Sintoris, C., Yiannoutsou, N., Avouris, N.: A survey on tools for end user authoring of mobile applications for cultural heritage. In: Proceedings of the 6th International Conference on Information, Intelligence, Systems and Applications (IISA), Corfu, pp. 1–5 (2015). https://doi.org/10.1109/iisa.2015.7388029
Fink, J., Kobsa, A., Nill, A.: Adaptable and adaptive information provision for all users, including disabled and elderly people. New Rev. Hypermedia Multimed. 4(1), 163–188 (1998)
Gellersen, H.W., Schmidt, A., Beigl, M.: Multi-sensor context-awareness in mobile devices and smart artifacts. Mob. Netw. Appl. 7(5), 341–351 (2002)
Ghiani, G., Paternò, F., Spano, L.: Cicero designer: an environment for end-user development of multi-device museum guides. In: Proceedings of IS-EUD 2009. LNCS, vol. 5435. Springer, Berlin, pp 265–274 (2009)
Ghiani, G., Manca, M., Paternò, F., Santoro, C.: Personalization of context-dependent applications through trigger-action rules. ACM Trans. Comput. Hum. Interact. 24(2), 14:1–14:33 (2017)
Greenberg, S., Marquardt, N., Ballendat, T., Diaz-Marino, R., Wang, M.: Proxemic interactions: the new Ubicomp? Interactions 18(1), 42–50 (2011). https://doi.org/10.1145/1897239.1897250
Hansen, A., Kortbek, J., Grønbæk, K.: Mobile urban drama: interactive storytelling in real world environments. New Rev. Hypermedia Multimed. 18(1–2), 63–89 (2012)
Hargood, C., Hunt, V., Weal, M.J., Millard, D.E.: Patterns of sculptural hypertext in location based narratives. In: Proceedings of the 27th ACM Conference on Hypertext and Social Media (HT’16). ACM, New York, pp. 61–70 (2016). https://doi.org/10.1145/2914586.2914595
Hashemi, S.H., Amer, N.O., Kamps, J.: Neural endorsement based contextual suggestion. In: Proceedings of the 25th Text REtrieval Conference (TREC 2016) (2016)
Hornecker, E: Interactions around a contextually embedded system. In: Proceedings of TEI’10—Conference on Tangible, Embedded and Embodied Interaction. ACM, New York, pp. 169–176 (2010)
Katz, S., Kahanov, Y., Kashtan, N., Kuflik, T., Graziola, I., Rocchi, C., Stock, O., Zancanaro, M.: Preparing personalized multimedia presentations for a mobile museum visitors’ guide—a methodological approach. In: Trant, J., Bearman, D. (eds.) Museums and the Web 2006: Proceedings, Toronto: Archives & Museum Informatics, Published March 1, 2006 at http://www.archimuse.com/mw2006/papers/katz/katz.html (2006). Accessed 8 Mar 2019
Kenteris, M., Gavalas, D., Economou, D.: Electronic mobile guides: a survey. Pers. Ubiquitous Comput. 15(1), 97–111 (2011). https://doi.org/10.1007/s00779-010-0295-7
Kubitza, T., Schmidt, A.: Rapid interweaving of smart things with the meSchup IoT platform. In: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct (UbiComp’16). ACM, New York, pp. 313–316 (2016)
Kubitza, T., Schmidt, A.: meSchup: a platform for programming interconnected smart things. IEEE Comput. 55(11), 38–49 (2017)
Kuflik, T., Dim, E.: Early detection of Pairs of visitors by using a museum triage. In: Proceedings of MW2013: Museums and the Web 2013, Portland, OR, USA (2013)
Kuflik, T., Wecker, A.J., Lanir, J., Stock, O.: An integrative framework for extending the boundaries of the museum visit experience: linking the pre, during and post visit phases. Inf. Technol. Tour. 15(1), 17–47 (2015)
Lanir, J., Kuflik, T., Zolantz, I., Lanzet, U.: Personalized video summary of a museum visit. In: Proceedings of the First International Workshop on Intelligent User Interfaces: Artificial Intelligence Meets Human Computer Interaction (AI*HCI 2013). CEUR Workshop Proceedings, vol. 1125 (2013)
Linaza, M.T., Torre, I., Beusing, R., Tavernise, A., Etz, M: authoring tools for archaeological mobile guides. In: Proceedings of VAST 2008, Eurographics, pp. 47–54 (2008)
Long, S., Kooper, R., Abowd, G.D., Atkeson, C.G.: Rapid prototyping of mobile context-aware applications: the Cyberguide case study. In: Proceedings of the 2nd Annual International Conference on Mobile Computing and Networking (MobiCom’96). ACM, New York, pp. 97–107 (1996)
Mann, W.C., Thompson, S.: Rhetorical structure theory: a theory of text organization. In: Polanyi, L. (ed.) The Structure of Discourse. Ablex Publishing Corporation, New York (1987)
Manning, C.D., Raghavan, P., Schütze, H.: Introduction to Information Retrieval. Cambridge University Press, Cambridge (2008)
Marshall, M., Dulake, N., Ciolfi, L., Duranti, D., Petrelli, D.: Using tangible smart replicas as controls for an interactive museum exhibition. In: Proceedings of TEI 2016—Tenth Anniversary Conference on Tangible, Embedded and Embodied Interaction. ACM, New York, pp. 159–167 (2016a)
Marshall, M.T., Petrelli, D., Dulake, N., Not, E., Marchesoni, M., Trenti, E., Pisetti, A.: Audio-based narratives for the trenches of World War I: intertwining stories, places and interaction for an evocative experience. Int. J. Hum. Comput. Stud. 85, 27–39 (2016b)
Maye, L.A., McDermott, F.E., Ciolfi, L., Avram, G.: Interactive exhibitions design: what can we learn from cultural heritage professionals? In: Proceedings of the 8th Nordic Conference on Human–Computer Interaction: Fun, Fast, Foundational. ACM, pp. 598–607 (2014)
McDermott, F., Maye, L., Avram, G.: Co-designing a collaborative platform with cultural heritage professionals. In: Proceedings of the 8th Irish Human–Computer Interaction Conference (2014)
McKeown, K.R.: Text generation: using discourse strategies and focus constraints to generate natural language text. Cambridge University Press, New York (1985)
Nielsen, J.: Enhancing the explanatory power of usability heuristics. In: Proceedings of ACM CHI’94 Conference, Boston, MA, April 24–28, pp. 152–158 (1994)
Not, E., Cavada, D., Maule, S., Pisetti, A., Venturini, A.: Digital augmentation of historical objects through tangible interaction. ACM J. Comput. Cult. Herit. (in press)
Not, E., Petrelli, D.: Balancing adaptivity and customisation: in search of sustainable personalisation in cultural heritage. In: User Modeling, Adaptation, and Personalization, vol. 8538. Springer, Cham, pp. 405–410 (2014)
Not, E., Zancanaro, M., Marshall, M.T., Petrelli, D., Pisetti, A.: Writing postcards from the museum: composing personalised tangible souvenirs. In: Proceedings of the 12th Biannual Conference on Italian SIGCHI Chapter (CHItaly’17). ACM, New York (2017)
Not, E., Petrelli, D.: Blending customisation, context-awareness and adaptivity for personalised tangible interaction in cultural heritage. Int. J. Hum. Comput. Stud. 114, 3–19 (2018). https://doi.org/10.1016/j.ijhcs.2018.01.001
Oppermann, R., Specht, M.: A context-sensitive nomadic exhibition guide. In: Thomas, P.J., Gellersen, H. (eds.) Proceedings of the 2nd International Symposium on Handheld and Ubiquitous Computing. Lecture Notes in Computer Science, Bristol, UK, pp. 127–142 (2000)
Pan, P., Kastner, C., Crow, D., Davenport, G.: M-Studio: an authoring application for context-aware multimedia. In: Proceedings of the Tenth ACM International Conference on Multimedia (MULTIMEDIA’02). ACM, New York, pp. 351-354 (2002). https://doi.org/10.1145/641007.641082
Petrelli, D., Baggio, D., Pezzulo, G.: Adaptive hypertext design environments: putting principles into practice. In: Brusilovsky, P., Stock, O., Strapparava, C. (eds.) Adaptive Hypermedia and Adaptive Web-Based Systems. AH 2000. Lecture Notes in Computer Science, vol. 1892. Springer, Berlin (2000)
Petrelli, D., Lanfranchi, V., Ciravegna, F.: Working out a common task: design and evaluation of user-intelligent system collaboration. In: Costabile, M.F., Paternò, F. (eds.) Proceedings of the 10th IFIP TC13 International Conference on Human–Computer Interaction INTERACT 2005, LNCS, vol. 3585, pp 309–322 (2005)
Petrelli, D., Ciolfi, L., van Dijk, D., Hornecker, E., Not, E., Schmidt, A.: Integrating material and digital: a new way for cultural heritage. Interactions 20(4), 58–63 (2013)
Petrelli, D., Dulake, N., Marshall, M.T., Pisetti, A., Not, E.: Voices from the war: design as a means of understanding the experience of visiting heritage. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI’16). ACM, New York, pp. 1033–1044 (2016a)
Petrelli, D., Marshall, M.T., O’Brien, S., McEntaggart, P., Gwilt, I.: Tangible data souvenirs as a bridge between a physical museum visit and online digital experience. Pers. Ubiquitous Comput, 1–15 (2016b)
Petrelli, D., O’Brien, S.: Phone vs. tangible in museums: a comparative study. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI’18). ACM, New York (2018). https://doi.org/10.1145/3173574.3173686
Preece, J., Rogers, Y., Sharp, H., Benyon, D., Holland, S., Carey, T.: Human–Computer Interaction. Addison-Wesley, Reading (1994)
Raptis, G.E., Fidas, C., Katsini, C., Avouris, N.: A cognition-centered personalization framework for cultural-heritage content. In: User Modeling and User-Adapted Interaction (2019) (special issue on personalized delivery of cultural heritage content)
Resnick, P., Iacovou, N., Suchak, M., Bergstrom, P., Riedl, J.: Grouplens: an open architecture for collaborative filtering of netnews. In: Proceedings ACM Conference on Computer-Supported Cooperative Work, pp. 175–186 (1994)
Resnick, P., Varian, H.R.: Recommender systems. Commun. ACM 40(3), 56–58 (1997)
Resnick, M., Maloney, J., Monroy-Hernández, A., Rusk, N., Eastmond, E., Brennan, K., Millner, A., Rosenbaum, E., Silver, J., Silverman, B., Kafai, Y.: Scratch: programming for all. Commun. ACM 52(11), 60–67 (2009). https://doi.org/10.1145/1592761.1592779
Ricci, F., Cavada, D., Mirzadeh, N., Venturini, A.: Case-based travel recommendations. In: Fesemaier, D.R., Werthner, H., Wöber, K.W. (eds.) Destination Recommendation Systems: Behavioural Foundations and Applications, pp. 67–93. CABI Publishers, Wallingford (2006)
Risseeuw, M., Cavada, D., Not, E., Zancanaro, M., Marshall, M.T., Petrelli, D., Kubitza, T.: An authoring environment for smart objects in museums: the meSch approach. In: Proceedings of the First International Workshop on Smart Ecosystems cReation by Visual dEsign (SERVE 2016) Co-located with the International Working Conference on Advanced Visual Interfaces (AVI 2016), CEUR, vol. 1602, pp. 25–30 (2016)
Roussou, M., Pujol, L, Katifori, A., Chrysanthi, A., Perry, S., Vayanou, M.: The museum as digital storyteller: collaborative participatory creation of interactive digital experiences. In: Proceedings of Museums and the Web (2015). https://mw2015.museumsandtheweb.com/paper/the-museum-as-digital-storyteller-collaborative-participatory-creation-of-interactive-digital-experiences/. Accessed 26 Feb 2018
Rowland, C.: Things: the technology of connected devices. Chapter 2. In: Rowland, C., Goodman, E., Charlier, M., Light, A., Lui, A. (eds.) Designing Connected Products: UX for the Consumer Internet of Things. O’Reilly, Newton (2015a)
Rowland, C.: Networks: the technology of connectivity. Chapter 3. In: Rowland, C., Goodman, E., Charlier, M., Light, A., Lui, A. (eds.) Designing Connected Products: UX for the Consumer Internet of Things. O’Reilly, Newton (2015b)
Ruiz, A.: Five challenges for marketing traveling exhibitions to professionals. Exhibition Spring 2012, 46–49 (2012). https://www.name-aam.org/exhibition_spring2012. Accessed 8 Mar 2019
Sansonetti, G., Gasparetti, F., Micarelli, A., Cena, F., Gena, C. Enhancing cultural recommendations through social and linked open data. In: User Modeling and User-Adapted Interaction (2019) (special issue on personalized delivery of cultural heritage content)
Simon, N.: The participatory museum. (2010). http://www.participatorymuseum.org. Accessed 8 Mar 2019
Sprengart, B., Collins, A., Kay, J.: Curator: a design environment for curating tabletop museum experiences. In: Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS’09). ACM, New York, (2009). https://doi.org/10.1145/1731903.1731946
Stratton, A., Bates, C., Dearden, A.: Quando: enabling museum and art gallery practitioners to develop interactive digital exhibits. In: Barbosa, S., Markopoulos, P., Paternò, F., Stumpf, S., Valtolina, S. (eds.) End-User Development. IS-EUD 2017. Lecture Notes in Computer Science, vol. 10303. Springer, Cham (2017)
van der Vaart, M., Damala, A.: Through the loupe: visitor engagement with a primarily text-based handheld AR application. Proc. Dig. Herit. 2015, 565–572 (2015)
Vayanou, M., Katifori, A., Karvounis, M., Kourtis, V., Kyriakidi, M., Roussou, M., Tsangaris, M., Ioannidis, Y., Balet, O., Prados, T., Keil, J., Engelke, T., Pujol, L.: Authoring personalized interactive museum stories. In: Mitchell, A. (ed.) The Seventh International Conference on Interactive Digital Storytelling (ICIDS 2014). LNCS, vol. 8832. Springer, Cham, pp. 37–48 (2014)
Venturini, A., Ricci, F.: Applying Trip@dvice recommendation technology to www.visiteurope.com. In: 4th Prestigious Applications of Intelligent Systems (PAIS-2006), the 17th European Conference on Artificial Intelligence, Riva del Garda, Italy, Aug 28–Sept 1 (2006)
vom Lehn, D., Heath, C: Displacing the object: mobile technology and interpretive resources. In: ICHIM—International Cultural Heritage Informatics Meeting (2003)
Wang, Y., Aroyo, L.M., Stash, N., Rutledge, L.: Interactive user modeling for personalized access to museum collections: The Rijksmuseum case study. In: Conati, C., McCoy, K., Paliouras, G. (eds.) User Modeling 2007. UM 2007. LNCS, vol. 4511. Springer, Berlin, pp. 385–389 (2007)
Weal, M.J., Hornecker, E., Cruickshank, D.G., Michaelides, D.T., Millard, D.E., Halloran, J., De Roure, D.C., Fitzpatrick, G.: Requirements for in situ authoring of location based experiences. In: Proceedings of the 8th Conference on Human–Computer Interaction with Mobile Devices and Services (MobileHCI’06). ACM, New York, pp. 121-128 (2006). http://dx.doi.org/10.1145/1152215.1152241
Weber, G., Kuhl, H.-C., Weibelzahl, S.: Developing adaptive internet based courses with the authoring system NetCoach. In: Reich, S., Tzagarakis, M., De Bra, P. (eds.) Hypermedia: Openess, Structural Awerness, and Adaptivity, pp. 226–238. Springer, Berlin (2001)
Wolf, K., Abdelhady, E., Abdelrahman, Y., Kubitza, T., Schmidt, A.: meSch: tools for interactive exhibitions. In: Proceedings of the Conference on Electronic Visualisation and the Arts (EVA’15). BCS Learning & Development Ltd., Swindon, pp. 261–269 (2015). https://doi.org/10.14236/ewic/eva2015.28
Zancanaro, M., Not, E., Petrelli, D., Marshall, M., van Dijk, T., Risseeuw, M., van Dijk, D., Venturini, A., Cavada, D., Kubitza, T.: Recipes for tangible and embodied visit experiences. In: MW2015: Museums and the Web 2015 (2015)