A robotic framework for controlling human’s attention
Tóm tắt
It is a major challenge in HRI to design a social robot that is able to selectively direct a target human’s attention towards an intended direction. For this purpose, the robot may first turn its gaze toward him/her in order to establish eye contact. However, such a turning action of the robot may not in itself be sufficient to make eye contact with the target person in all situations, especially when the robot and the person are not facing each other or the human is intensely engaged in a task. In this paper, we propose a conceptual model of attention control with five phases: attention attraction, eye contact, attention avoidance, gaze back, and attention shift. Evaluation experiment by using a robotic head reveals the e effectiveness of the proposed model in different viewing situations.
Tài liệu tham khảo
A. Weiss, T. Scherndl, M. Tscheligi, A. Billard, Evaluating the ICRA 2008 HRI Challenge. In: ACM/IEEE International Conference on Human-Robot Interaction, San Diego, USA, (ACM Press, New York, 2009), 261
G. O. Deak, I. Fasel, J. Movellan, The Emergence of Shared Attention: Using Robots to Test Developmental Theories. In: International Workshop on Epigenetic Robotics, Lund, Sweden, (Lund University Cognitive Studies, 2001), 95
T. Striano, V. M. Reid, S. Hoehl, Neural Mechanisms of Joint Attention in Infancy. The Euro. J. Neurosci, 23, 2819 (2006)
M. L. Patterson, Nonverbal Behavior: A Functional Perspective, (Springer-Verlag, New York, 1983)
E. T. Hall, The Hidden Dimension: Man’s Use of Space in Public and Private, (The Bodley Head Ltd., London, 1966)
E. Goffman, Behavior in Public Place, (The Free Press, New York, 1963)
A. Kendon, Features of the Structural Analysis of Human Communicational Behavior, In: W. R. Engel (Ed.), (Swets and Zeitlinger, Lisse, 1980)
A. Kendon, Spatial Organization in Social Encounters: The F-formation System, In: A. Kendon (Ed.), Conducting Interaction: Patterns of Behavior in Focused Encounters (Cambridge University Press, Massachusetts, 1990) 209
K. Hayashi, D. Sakamoto, T. Kanda, M. Shiomi, S. Koizumi, H. Ishiguro, T. Ogasawara, N. Hagita, Humanoid Robots as a Passive-Social Medium-A Field Experiment at a Train Station. In: ACM/IEEE International Conference on Human Robot Interaction, Arlington, Virginia, USA, (ACM Press, New York, 2007), 137.
M. P. Michalowski, S. Sabanovic, R. Simmons, A Spatial Model of Engagement for a Social Robot. In: IEEE International Workshop on Advanced Motion Control, Istanbul, Turkey, (IEEE, 2006), 762.
K. Dautenhahn, M. Walters, S. Woods, K. L. Koay, C. L. Nehaniv, How May I Serve You?: A Robot Companion Approaching A Seated Person in A Helping Context. In: ACM/IEEE International Conference on Human Robot Interaction, Salt Lake City, Utah, USA, (ACM Press, New York, 2006), 172
C. Shi, M. Shimada, T. Kanda, H. Ishiguro, N. Hagita, Spatial Formation Model for Initiating Conversation, In: International Conference on Robotics: Science and Systems, Los Angeles, USA, (USC, Los Angeles, 2011)
F. Yamaoka, T. Kanda, H. Ishiguro, N. Hagita, A Model of Proximity Control for Information Presenting Robot. IEEE Tran. on Robot., 26, 187 (2010)
B. Mutlu, T. Shiwa, T. Kanda, H. Ishiguro, N. Hagita, Footing in Human Robot Conversations: How Robots Might Shape Participant Roles using Gaze Cues, In: ACM/IEEE International Conference on Human Robot Interaction, San Diego, CA USA, (ACM Press, New York, 2009), 61
C. Breazeal, Toward Sociable Robots. J. of Robo. & Autono. Sys., 42, 162 (2003).
D. Miyauchi, A. Nakamura, Y. Kuno, Bidirectional Eye Contact for Human-Robot Communication. IEICE Trans. of Info. & Syst., 88-D, 2509 (2005).
Z. Yucel, A. A. Salah, C. Mericli, T. Mericli, Joint Visual Attention Modeling for Naturally Interacting Robotic Agents, In: International Symposium on Information and Computer Sciences, METU, North Cyprus, (IEEE, 2009), 242
N. Kubota, T. Shimizu, M. Abe, Joint Attention Between a Human Being and a Partner Robot Based on Computational Intelligence. J. of Adv. Comput. Intelli. & Inte. Info., 11, 1274 (2007).
O. Sugiyama, T. Kandaa, M. Imai, H. Ishiguroa, N. Hagita, Y. Anzai, Human-Like Conversation with Gestures and Verbal Cues Based on Three-Layer Attention Drawing Model. J. Conn. Sci., 18, 379 (2006).
G. Heidemann, R. Rae, H. Bekel, I. Bax, H. Ritter, Integrating Context-Free and Context-Dependant Attentional Mechanisms for Gestural Object Reference. J. of Mac. Vis. & App., 16, 64 (2004).
S. Satake, T. Kanda, D. F. Glas, M. Imai, H. Ishiguro, N. Hagita, How to Approach Humans? Strategies for Social Robots to Initiate Interaction. In: ACM/IEEE International Conference on Human Robot Interaction, San Diego, CA USA, (ACM Press, New York, 2009), 109
M. Buss, D. Carton, B. Gonsior, K. Kuehnlenz, C. Landsiedel, N. Mitsou, Towards Proactive Human-Robot Interaction in Human Environments. In: International Conference on Cognitive Infocommunications, Budapest, Hungary, (IEEE, 2011), 1
A. Cesta, G. Cortellessa, V. Giuliani, F. Pecora, R. Rasconi, M. Scopelliti, L. Tiberio, Psychological Implications of Domestic Assistive Technology for the Elderly. Psychnology J., 5, 229 (2007).
M. Finke, K. L. Koay, K. Dautenhahn, C. L. Nehaniv, M. L. Walters, J. Sauders, Hey, I’m Over Here-How can a Robot Attract People’s Attention? In: IEEE International Workshop on Robot and Human Interactive Communication, Nashville, USA, (IEEE Press, New York, 2005), 7
Y. Yoshikawa, K. Shinozawa, H. Ishiguro, N. Hagita, T. Miyamoto, Impression Conveyance with Responsive Robot Gaze in a Conversational Situation. In: IEEE International Symposium on Robot and Human Interactive Communication, Hatfield, UK, (IEEE Press, New York, 2006), 457
N. Kirchner, A. Alempijevic, G. Dissanayake, Nonverbal Robot-Group Interaction Using an Imitated Gaze Cue. In: ACM/IEEE International Conference on Human-Robot Interaction, Lausanne, Switzerland, (ACM Press, New York, 2011) 497
M. Shiomi, T. Kanda, N. Mirallers, T. Miyashita, Face-to-Face Interactive Humanoid Robot. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, Sendai, Japan, (IEEE, 2004), 1340
D. V. Pol, J. Juola, L. Meesters, C. Weber, A. Yan, S. Wermter, Deliverable D3.1: Human Robot Interaction. http://www.kseraproject.eu
M. M. Hoque, T. Onuki, Y. Kobayashi, Y. Kuno, Y. Sato, S. Kodama, In: R. Koch (Ed.), An Empirical Framework to Control Human Attention by Robot, (Springer, Heidelberg, 2010) 430
M. M. Hoque, T. Onuki, Y. Kobayashi, Y. Kuno, Controlling Human Attention through Robot’s Gaze Behaviors, In: International Conference on Human System Interaction, Yokohama, Japan, (IEEE, 2011), 95
M. Argyle, M. Cook, Gaze and Mutual Gaze, (Cambridge University Press, Oxford, 1976)
M. V. Cranach, J. H. Ellgring, The Perception of Looking Behaviour, (Academic Press, London, 1973)
N. J. Emery, The Eyes Have It: The Neuroethology, Function and Evolution of Social Gaze, Neurosci. & Biobeha. Rev., 24, 581 (2000)
M. Imai, T. Kanda, T. Ono, H. Ishiguro, K. Mase, Robot Mediated Round Table: Analysis of The Effect of Robot’s Gaze, In: IEEE International Workshop on Robot and Human Interactive Communication, Berlin, Germany, (IEEE Press, 2002), 411
W. James, The Principle of Psychology, (Dover, New York, 1950)
Y. Okano, S. Fukushima, M. Furukawa, H. Kajimoto, Embedded Motion-Generating the Perception of Motion in Peripheral Vision. In: International Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia, Seoul, Korea, (ACM Press, New York, 2010)
J. Jonides, A. Arbor, Voluntary vs. Automatic Control Over the Mind’s Eye’s Movement. (Lawrence Erlbaum Associates Inc., Hillsdale, NJ, 1981)
S. Yantis, J. Jonides, Abrupt Visual Onsets and Selective Atten tion: Voluntary Versus Automatic Allocation. J. of Expt. Psy.: Human Percep. & Per., 16, 121 (1990)
M. M. Hoque, D. Das, T. Onuki, Y. Kobayashi, Y. Kuno, Model for Controlling a Target Human’s Attention in Multi-Party Settings, In: IEEE International Symposium on Robot and Human Interactive Communication, Paris, France, (IEEE, 2012), 476
V. M. Cranach, In: A. H. Esser (Ed.), The Role of Orienting Behavior in Human Interaction, Behavior and Environment, (Plenum Press, New York, 1971), 217
M. Cook, M. C. Smith, The Role of Gaze in Impression Formation, Brit. J. Soc. Clin. Psycho., 14, 19 (1975).
H. H. Clark, Using Language, (Cambridge University Press, Cambridge, 1996)
R. B. Miller, Response Time in Man-Computer Conversational Transactions, In: AFIPS Fall Joint Computer Conference, San Francisco, USA, (ACM Press, New York, 1968), 267
K. Takashima, Y. Omori, Y. Yoshimoto, Y. Itoh, Y. Kitamura, F. Kishino, Effects of Avater’s Blinking Animation on Person Impressions. In: International Conference on Graphics Interface, Windsor, Canada, (Canadian Information Processing Society, 2008), 169
F. Delaunay, T. Belpaeme, Towards Retro-Projected Robot Faces: An Alternative to Mechatronic and Android Faces, In: IEEE International Workshop on Robot and Human Interactive Communication, Toyama, Japan, (IEEE, 2009), 306
FaceAPI: Face Tracking for OEM Product Development, Seeing Machines Int., (2010), http://www.faceapi.com
Y. Kobayashi, Y. Kuno, People Tracking using Integrated Sensors for Human Robot Interaction, In: IEEE International Conference on Industrial Technology, Vina del Mar, Chile, (IEEE Press, 2010), 1597
G. Bradsky, A. Kaehler, V. Pisarevskky, Learning Based Computer Vision with Intel’s Open Source Computer Vision Library, J. Intel Tech., 9, 119 (2005)
M. M. Hoque, T. Onuki, Y. Kobayashi, Y. Kuno, E ect of Robot’s Gaze Behaviors for Attracting and Controlling Human Attention, International Journal of Advanced Robotics (Accepted)
P. E. Downing, C. M. Dodds, D. Bray, Why Does the Gaze of Others Direct Visual Attention. Vis. Cog., 11, 71 (2004)
Y. Mohammad, T. Nishida, Unsupervised Learning of Interactive Behavior for HRI, In: RSS 2010 Workshop on Learning for Human Robot Interaction Modeling, Zaragoza, Spain, (June 2010)
Y. Mohammad, S. Okada, T. Nishida, Autonomous Development of Gaze Control for Natural Human-Robot Interaction, In: International IUI 2010 Workshop on Eye Gaze in Intelligent Human Machine Interaction (ACM, 2010)
J. Lee, J. F. Kiser, A. F. Bobick, A. L. Thomaz, Vision-based Contigency Detection, In: ACM/IEEE International Conference on Human Robot Interaction, Lausanne, Switzerland, (ACM, 2011), 297