Design and implement chords and personal windows for multi-user collaboration on a large multi-touch vertical display

Ioannis Leftheriotis1,2, Konstantinos Chorianopoulos1, Letizia Jaccheri2
1Department of Informatics, Ionian University, Corfu, Greece
2Department of Computer and Information Science, Norwegian University of Science and Technology, Trondheim, Norway

Tóm tắt

Co-located collaboration on large vertical screens has become technically feasible, but users are faced with increased effort, or have to wear intrusive personal identifiers. Previous research on co-located collaboration has assumed that all users perform exactly the same task (e.g., moving and resizing photos), or that they negotiate individual actions in turns. However, there is limited user interface software that supports simultaneous performance of individual actions during shared tasks (Fig. 1a). As a remedy, we have introduced multi-touch chords (Fig. 1b) and personal action windows (Fig. 1c) for co-located collaboration on a large multi-touch vertical display. Instead of selecting an item in a fixed menu by reaching for it, users work simultaneously on shared tasks by means of personal action windows, which are triggered by multi-touch chords performed anywhere on the display. In order to evaluate the proposed technique with users, we introduced an experimental task, which stands for the group dynamics that emerge during shared tasks on a large display. A grounded theory analysis of users’ behaviour provided insights into established co-located collaboration topics, such as conflict resolution strategies and space negotiation. The main contribution of this work is the design and implementation of a novel seamless identification and interaction technique that supports diverse multi-touch interactions by multiple users: multi-touch chord interaction along with personal action windows.

Tài liệu tham khảo

Haller M (2008) Interactive displays and next-generation interfaces. In: Becta emerging technologies for learning, vol 3, p 91–101 Nacenta MA, Pinelle D, Stuckel D, Gutwin C (2007) The effects of interaction technique on coordination in tabletop groupware. In: Proceedings of Graphics interface. ACM Press, New York, p 191–198 Elliott A, Hearst M (2002) A comparison of the affordances of a digital desk and tablet for architectural image use tasks. Int J Hum Comp Stud 56(2):173–197 Kurtenbach G, Buxton W (1993) The limits of expert performance using hierarchic marking menus. In: Proceedings of the INTERACT’93 and CHI’93 conference on human factors in computing systems. ACM, New York, p 482–487 Wigdor D, Fletcher J, Morrison G (2009) Designing user interfaces for multi-touch and gesture devices. In: Proceedings of the 27th international conference extended abstracts on Human factors in computing systems—CHI EA’09: 2755 Luyten K, Vanacken D, Weiss M, Borchers J, Izadi S, Wigdor D (2010) Engineering patterns for multi-touch interfaces. In: Proceedings of the 2nd ACM SIGCHI symposium on Engineering interactive computing systems (EICS ‘10). ACM Press, New York, p 365–366 Lepinski GJ, Grossman T, Fitzmaurice G (2010) The design and evaluation of multitouch marking menus. In: Proceedings of the 28th international conference on human factors in computing systems—CHI’10, ACM Press, New York, p 2233–2242 Bau O, Ghomi E, Mackay W (2010) Arpege: design and learning of multifinger chord gestures, CNRS-Université Paris Sud—LRI. Rapport de, Recherche (1533) Wagner J, Lecolinet E, Selker T (2014) Multi-finger chords for hand-held tablets: Recognizable and memorable. In: Proceedings of the 32nd annual ACM conference on human factors in computing systems. ACM Press, New York, p 2883–2892 Bailly G, Lecolinet E, Guiard Y (2010). Finger-count and radial-stroke shortcuts: two techniques for augmenting linear menus on multi-touch surfaces. In: Proceedings of the 28th international conference on Human factors in computing systems—CHI’10. ACM Press, New York, p 591–594 Au OKC, Tai CL (2010) Multitouch finger registration and its applications. In: Proceedings of the 22nd conference of the computer-human interaction special interest group of Australia on computer-human interaction, OZCHI’10, ACM Press, New York, p 41–48 Wobbrock JO, Morris MR, Wilson AD (2009) User-defined gestures for surface computing. In: Proceedings of the 27th international conference on human factors in computing systems (CHI ‘09). ACM Press, New York, p 1083–1092 Scott SD, Sheelagh M, Carpendale T, Inkpen KM (2004) Territoriality in collaborative tabletop workspaces. In: Proceedings of the 2004 ACM conference on computer supported cooperative work. ACM Press, New York, p 294–303 Tuddenham P, Robinson P (2009) Territorial coordination and workspace awareness in remote tabletop collaboration. In: Proceedings of the 27th international conference on human factors in computing systems, ACM Press, New York, p 2139–2148 Morris MR, Paepcke A, Winograd T, Stamberger J (2006) TeamTag: exploring centralized versus replicated controls for co-located tabletop groupware. In: Proceedings of the SIGCHI conference on human factors in computing systems. ACM Press, New York, p 1273–1282 Ryall K, Forlines C, Shen C, MR Morris (2004) Exploring the effects of group size and table size on interactions with tabletop shared-display groupware. In: Proceedings of the 2004 ACM conference on computer supported cooperative work. ACM Press, New York, p 284–293 Kammer D, Keck M, Freitag G, Wacker M (2010) Taxonomy and overview of multi-touch frameworks: architecture, scope and features. In: Proceedings of the EICS’10 workshop on engineering patterns for multi-touch interfaces Tan DS, Gergle D, Mandryk R, Inkpen K, Kellar M, Hawkey K, Czerwinski M (2008) Using job-shop scheduling tasks for evaluating co-located collaboration. Personal Ubiquitous Computing (2008), 12, p 255–267 Kraut RE, Gergle D, Fussell SR (2002) The use of visual information in shared visual spaces: informing the development of virtual co-presence. In: Proceedings of the ACM conference on computer-supported cooperative work 2002. ACM Press, New York, p 31–40 Zhang H, Yang XD, Ens B, Liang HN, Boulanger P, Irani P (2012) See me, see you: a lightweight method for discriminating user touches on tabletop displays. In: Proceedings of the SIGCHI conference on human factors in computing systems. ACM Press, New York, p 2327–2336 Ishii H, Kobayashi M (1992) ClearBoard: a seamless medium for shared drawing and conversation with eye contact. In: Proceedings of the SIGCHI conference on human factors in computing systems. ACM Press, New York, p 525–532 Dillon RF, Edey JD, Tombaugh JW (1990) Measuring the true cost of command selection: techniques and results. In: Proceedings of the SIGCHI conference on human factors in computing systems: empowering people. ACM Press, New York, p 19–26 Leftheriotis I, Chorianopoulos K (2011). Multi-user chorded toolkit for multi-touch screens. In: Proceedings of EICS‘11, ACM SIGCHI symposium on engineering interactive computing systems, ACM Press, New York, p 161–164 Epps J, Lichman S, Wu M (2006) A study of hand shape use in tabletop gesture interaction. In: CHI’06 extended abstracts on human factors in computing systems. ACM Press, New York, p 748–753 Bier EA, Stone MC, Fishkin K, Buxton W, Baudel T (1994) A taxonomy of see-through tools. In: Adelson B, Dumais S, Olson J (eds) Proceedings of the SIGCHI conference on Human factors in computing systems: celebrating interdependence (CHI ‘94). ACM Press, New York, p 358–364 Glaser BG, Strauss AL (2009) The discovery of grounded theory: strategies for qualitative research. Transaction Books, Piscataway Peltonen P, Kurvinen E, Salovaara A, Jacucci G, Ilmonen T, Evans J, Oulasvirta A, Saarikko P (2008) Itʼs mine, don’t touch!: interactions at a large multi-touch display in a city centre. In: Proceedings of the twenty-sixth annual SIGCHI conference on Human factors in computing systems. ACM Press, New York, p 1285–1294 Jakobsen MR, Hornbæk K (2014) Up close and personal: collaborative work on a high-resolution multitouch wall display. ACM Trans Comp Hum Interact (TOCHI) 21(2):11 Hornecker E, Marshall P, Dalton NS, Rogers Y (2008) Collaboration and interference: awareness with mice or touch input. In: Proceedings of the 2008 ACM conference on computer supported cooperative work. ACM Press, New York, p 167–176 Kiger J (1984) The depth/breadth trade-off in the design of menu-driven user interfaces. Int J Man Mach Stud 20(2):201–213 Tuddenham P, Robinson P (2007) Distributed tabletops: supporting remote and mixed-presence tabletop collaboration. In: Second annual IEEE International workshop on horizontal interactive human-computer systems (TABLETOP’07). IEEE, New York, p 19–26 Leftheriotis I, Chorianopoulos K, Jaccheri L (2012) Tool support for developing scalable multi-user applications on multi-touch screens. In: Proceedings of ITS’ 2012, ACM international conference on interactive tabletops and surfaces, ACM Press, New York, p 371–374