Lessons from human vision for robotic design
Tóm tắt
The visual guidance of goal-directed movements requires transformations of incoming visual information that are different from those required for visual perception. For us to grasp an object successfully, our brain must use just-in-time computations of the object’s real-world size and shape, and its orientation and disposition with respect to our hand. These requirements have led to the emergence of dedicated visuomotor modules in the posterior parietal cortex of the human brain (the dorsal visual stream) that are functionally distinct from networks in the occipito-temporal cortex (the ventral visual stream) that mediate our conscious perception of the world. Although the identification and selection of goal objects and an appropriate course of action depends on the perceptual machinery of the ventral stream and associated cognitive modules, the execution of the subsequent goal-directed action is mediated by dedicated online control systems in the dorsal stream and associated motor areas. The dorsal stream allows an observer to reach out and grasp objects with exquisite ease, but by itself, deals only with objects that are visible at the moment the action is being programmed. The ventral stream, however, allows an observer to escape the present and bring to bear information from the past – including information about the function of objects, their intrinsic properties, and their location with reference to other objects in the world. Ultimately then, both streams contribute to the production of goal-directed actions. The principles underlying this division of labour between the dorsal and ventral streams are relevant to the design and implementation of autonomous robotic systems.
Tài liệu tham khảo
L.G. Ungerleider, M. Mishkin, in Mansfield, ed. by D. J. Ingle, M. A. Goodale, RJW. Analysis of Visual Behavior (MIT Press, Cambridge, 1982), p. 549
M.A. Goodale, A.D. Milner, Trends. Neurosci. 15, 20 (1992)
A.D. Milner, M.A. Goodale, The Visual Brain in Action, 2nd edn. (OUP, Oxford UK, 2006), pp. 1–297
M.A. Goodale, A.D. Milner, Sight Unseen: An Exploration of Conscious and Unconscious Vision, 2nd edn. (OUP, Oxford UK, 2013), pp. 1–218
H.C. Dijkerman, E.H. De Haan, Behav. Brain. Sci. 30, 189 (2007)
J.P. Rauschecker, Eur. J. Neurosci. 41, 579 (2015)
B. Bridgeman, S. Lewis, G. Heit, M. Nagle, J. Exp. Psychol. [Hum. Percept.] 5, 692 (1979)
M.A. Goodale, D. Pélisson, C. Prablanc, Nature 320, 748 (1986)
M.A. Goodale, A.D. Milner, L.S. Jakobson, D.P. Carey, Nature 349, 154 (1991)
G.K. Humphrey, M.A. Goodale, L.S. Jakobson, P. Servos, Perception 23, 1457 (1994)
P. Servos, M.A. Goodale, G.K. Humphrey, Neuropsychologia 31, 251 (1993)
H. Lissauer, Arch. Psychiatr. 21, 222 (1890)
D.F. Benson, J.P. Greenberg, Arch. Neurol. 20, 82 (1969)
D.P. Carey, M. Harvey, A.D. Milner, Neuropsychologia 34, 329 (1996)
N.J. Rice, R.D. McIntosh, I. Schindler, M. Mon-Williams, J. Demonet, A.D. Milner, Intact automatic avoidance of obstacles in patients with visual form agnosia. Exp. Brain Res. 174, 176 (2006)
M.A. Goodale, J.P. Meenan, H.H. Bülthoff, D.A. Nicolle, K.J. Murphy, C. Racicot, Curr. Biol. 4, 604 (1994)
M.A. Goodale, Vis. Res. 51, 1567 (2011)
R. Bálint, Monatsschr. Psychiatr. Neurol. 25, 51 (1909)
M.-T. Perenin, A. Vighetto, Brain 111, 643 (1988)
L.S. Jakobson, Y.M. Archibald, D.P. Carey, M.A. Goodale, Neuropsychologia 29, 803 (1991)
I. Schindler, N.J. Rice, R.D. McIntosh, Y. Rossetti, A. Vighetto, A.D. Milner, Automatic avoidance of obstacles is a dorsal stream function: Evidence from optic ataxia. Nature Neurosci. 7, 779 (2004)
J.P. Gallivan, M.A. Goodale, in Handbook of Clinical Neurology, Vol. 151: The Parietal Lobe, ed. by G. Vallar, H. P. Coslett. (Elsevier, Amsterdam, 2018), p. 449
A. Alipour, J. Beggs, J. Brown, T. James, bioRxiv 2020.09.30.321299. https://doi.org/10.1101/2020.09.30.321299
M. Glickstein, Trends. Neurosci. 23, 613 (2000)
S. Kouider, S. Dehaene, Philos. Trans. R. Soc. 362, 857 (2007)
P. Haggard, Nat. Rev. Neurosci. 18, 196 (2017)
A.D. Milner, Proc. R. Soc. B 279, 2289 (2012)
A. Clark, Philos. Rev. 110, 495 (2001)
P.K. Pook, D.H. Ballard, Rob. Auton. Syst. 18, 259 (1996)
M.A. Goodale, G.K. Humphrey, Cognition 67, 181 (1998)
R. Desimone, J. Duncan, Ann. Rev. Neurosci. 18, 193 (1995)
M.A. Goodale, A.M. Haffenden, Adv. Neurol. 93, 249 (2003)
M. Corbetta, J.M. Kincade, G.L. Shulman, J. Cogn. Neurosci. 14, 508 (2002)
J.W. Bisley, M.E. Goldberg, Adv. Neurol. 93, 141 (2003)
J.P. Gallivan, J.S. Cant, M.A. Goodale, J.R. Flanagan, Curr. Biol. 24, 1866 (2014)
S.R. Jackson, A. Shaw, J. Exp. Psychol. Hum. Percept. Perform. 26, 418 (2000)
M.A. Goodale, T. Ganel, in Oxford Handbook of Perceptual Organization, ed. by B. J. Wagemans. (OUP, Oxford, 2015), p. 672
D.A. Rosenbaum, F. Marchak, H.J. Barnes, J. Vaughan, J.D. Slotta, M.J. Jorgensen, MJ, in Attention and Performance XIII: Motor Representation and Control, ed. by M. Jeannerod. (Erlbaum, Hillsdale, NJ, 1990), p. 321
J.P. Gallivan, D.A. McLean, K.F. Valyear, J.C. Culham, Elife 2, e00425 (2013)
J. Chen, J.C. Snow, J.C. Culham, M.A. Goodale, What role does “elongation” play in “tool-specific” activation and connectivity in the dorsal and ventral visual streams? Cereb. Cortex 28, 1117 (2018)
E. Chinellato, A.P. Del Pobil, International Work-Conference on the Interplay between Natural and Artificial Computation (Springer, Heidelberg, 2005) p. 366
E. Chinellato, A.P. Del Pobil, Visual Neuroscience of Robotic Grasping: Achieving Sensorimotor Skills through Dorsal-Ventral Stream Integration (Springer, Heidelberg, 2016), pp. 1–165
M. Helms, S.S. Vattam, A.K. Goel, Design Stud. 30, 606 (2009)
L.H. Shu, K. Ueda, I. Chiu, H. Cheong, CIRP Ann. Manuf. Technol. 60, 673 (2011)
A. Saxena, J. Driemeyer, A.Y. Ng, Int. J. Robot. Res. 27, 157 (2008)
L.Y. Ku, L.E. Learned-Miller, R. Grupen, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IEEE, 2017), p. 2434
R. Detry, J. Papon, L. Matthies, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IEEE, 2017), p. 3266
E. Jang, S. Vijayanarasimhan, P. Pastor, J. Ibarz, S. Levine, Proc. Mach. Learn. Res. 78, 119 (2017)
G. Ferretti, E. Chinellato, in Blended Cognition, ed. by B. J. Vallverdú, V. Müller. (Springer, Cham, 2019), p. 99