Audio–visual interaction in visual motion detection: Synchrony versus Asynchrony

Burr, 2011, Motion psychophysics: 1985–2010, Vis Res, 51, 1431, 10.1016/j.visres.2011.02.008 Driver, 2000, Multisensory perception: beyond modularity and convergence, Curr Biol, 10, R731, 10.1016/S0960-9822(00)00740-5 Hidaka, 2013, Effect of pitch-space correspondence on sound-induced visual motion perception, Exp Brain Res, 231, 117, 10.1007/s00221-013-3674-2 Kitagawa, 2002, Hearing visual motion in depth, Nature, 416, 172, 10.1038/416172a Koelewijn, 2010, Attention and the multiple stages of multisensory integration: a review of audiovisual studies, Acta Psychol (Amst), 134, 372, 10.1016/j.actpsy.2010.03.010 Maeda, 2004, Changing pitch induced visual motion illusion, Curr Biol, 14, R990, 10.1016/j.cub.2004.11.018 Sadaghiani, 2009, Natural, metaphoric, and linguistic auditory direction signals have distinct influences on visual motion processing, J Neurosci, 29, 6490, 10.1523/JNEUROSCI.5437-08.2009 Sanabria, 2007, Perceptual and decisional contributions to audiovisual interactions in the perception of apparent motion: a signal detection study, Cognition, 102, 299, 10.1016/j.cognition.2006.01.003 Shams, 2010, Crossmodal influences on visual perception, Phys Life Rev, 7, 269, 10.1016/j.plrev.2010.04.006 Shimojo, 2001, Sensory modalities are not separate modalities: plasticity and interactions, Curr Opin Neurobiol, 11, 505, 10.1016/S0959-4388(00)00241-5 Spence, 2010, Multisenory integration – solving the crossmodal binding problem. comment on “crossmodal influences on visual perception” by shams & kim, Phys Life Rev, 7, 285, 10.1016/j.plrev.2010.06.004 Teramoto, 2010, Visual motion perception induced by sounds in vertical plane, Neurosci Lett, 479, 221, 10.1016/j.neulet.2010.05.065 Alais, 2004, No direction-specific bimodal facilitation for audiovisual motion detection, Brain Res Cogn Brain Res, 19, 185, 10.1016/j.cogbrainres.2003.11.011 Baumann, 2007, Neural correlates of coherent audiovisual motion perception, Cerebral Cortex, 17, 1433, 10.1093/cercor/bhl055 Frings, 2010, Crossmodal congruency effects based on stimulus identity, Brain Res, 1354, 113, 10.1016/j.brainres.2010.07.058 Gleiss, 2014, Oscillatory mechanisms underlying the enhancement of visual motion perception by multisensory congruency, Neuropsychologia, 53, 84, 10.1016/j.neuropsychologia.2013.11.005 Jaekl, 2014, On the ‘visual’ in ‘audio–visual integration’: a hypothesis concerning visual pathways, Exp Brain Res, 232, 1631, 10.1007/s00221-014-3927-8 Kim, 2012, 0+1>1: how adding noninformative sound improves performance on a visual task, Psychol Sci, 23, 6, 10.1177/0956797611420662 Lewkowicz, 1986, The value of multisensory redundancy in the development of intersensory perception 67, Dev Psychol, 373, 373 McDonald, 2000, Involuntary orienting to sound improves visual perception, Nature, 407, 906, 10.1038/35038085 Meyer, 2005, Low-level integration of auditory and visual motion signals requires spatial co-localisation, Exp Brain Res, 166, 538, 10.1007/s00221-005-2394-7 Mossbridge, 2011, Changes in auditory frequency guide visual-spatial attention, Cognition, 121, 133, 10.1016/j.cognition.2011.06.003 Noesselt, 2010, Sound-induced enhancement of low-intensity vision: multisensory influences on human sensory-specific cortices and thalamic bodies relate to perceptual enhancement of visual detection sensitivity, J Neurosci, 30, 13609, 10.1523/JNEUROSCI.4524-09.2010 Spence, 1997, Audiovisual links in exogenous covert spatial orienting, Percept Psychophys, 59, 1, 10.3758/BF03206843 Takeshima, 2013, Changing pitch of sounds alters perceived visual motion trajectory, Multisens Res, 26, 317, 10.1163/22134808-00002422 Teder-Salejarvi, 1999, Intra-modal and cross-modal spatial attention to auditory and visual stimuli. an event-related brain potential study, Brain Res Cogn Brain Res, 8, 327, 10.1016/S0926-6410(99)00037-3 Evans, 2011, Natural cross-modal mappings between visual and auditory features, J Vis, 10, 10.1167/10.1.6 Spence, 2011, Crossmodal correspondences: a tutorial review, Atten Percept Psychophys, 73, 971, 10.3758/s13414-010-0073-7 Alais, 2010, Multisensory perceptual learning of temporal order: audiovisual learning transfers to vision but not audition, PLoS One, 5, e11283, 10.1371/journal.pone.0011283 Bendixen, 2010, The time-course of auditory and visual distraction effects in a new crossmodal paradigm, Neuropsychologia, 48, 2130, 10.1016/j.neuropsychologia.2010.04.004 Soto-Faraco, 2004, Cross-modal dynamic capture: congruency effects in the perception of motion across sensory modalities, J Exp Psychol Hum Percept Perform, 30, 330, 10.1037/0096-1523.30.2.330 Gilbert, 2012, Seeing facial motion affects auditory processing in noise, Atten Percept Psychophys, 74, 1761, 10.3758/s13414-012-0375-z Kim, 2011, Hearing speech in noise: seeing a loud talker is better, Perception, 40, 853, 10.1068/p6941 Maguinness, 2011, The effect of combined sensory and semantic components on audio–visual speech perception in older adults, Front Aging Neurosci, 3, 19, 10.3389/fnagi.2011.00019 Rouger, 2007, Evidence that cochlear-implanted deaf patients are better multisensory integrators, Proc Natl Acad Sci U S A, 104, 7295, 10.1073/pnas.0609419104 Michikawa, 2009, Gender-specific associations of vision and hearing impairments with adverse health outcomes in older japanese: a population-based cohort study, BMC Geriatr, 9, 50, 10.1186/1471-2318-9-50 Lomber, 2011, Adaptive crossmodal plasticity in deaf auditory cortex: areal and laminar contributions to supranormal vision in the deaf, Prog Brain Res, 191, 251, 10.1016/B978-0-444-53752-2.00001-1 Rauschecker, 1983, Auditory compensation of the effects of visual deprivation in the cat's superior colliculus, Exp Brain Res, 50, 69, 10.1007/BF00238233 Rettenbach, 1999, Do deaf people see better?. Texture segmentation and visual search compensate in adult but not in juvenile subjects, J Cogn Neurosci, 11, 560, 10.1162/089892999563616 Dundon, 2015, Visual rehabilitation: visual scanning, multisensory stimulation and vision restoration trainings, Front Behav Neurosci, 9, 192, 10.3389/fnbeh.2015.00192 Frassinetti, 2005, Audiovisual integration in patients with visual deficit, J Cogn Neurosci, 17, 1442, 10.1162/0898929054985446 Lewald, 2012, Passive auditory stimulation improves vision in hemianopia, PLoS One, 7, e31603, 10.1371/journal.pone.0031603 Nishida, 2011, Advancement of motion psychophysics: review 2001–2010, J Vis, 11, 11, 10.1167/11.5.11 Talsma, 2010, The multifaceted interplay between attention and multisensory integration, Trends Cogn Sci, 14, 400, 10.1016/j.tics.2010.06.008 Alink, 2012, Auditory motion direction encoding in auditory cortex and high-level visual cortex, Hum Brain Mapp, 33, 969, 10.1002/hbm.21263 Hidaka, 2011, Auditory motion information drives visual motion perception, PLoS One, 6, e17499, 10.1371/journal.pone.0017499 Meyer, 2001, Cross-modal integration of auditory and visual motion signals, Neuroreport, 12, 2557, 10.1097/00001756-200108080-00053 Soto-Faraco, 2005, Assessing automaticity in the audiovisual integration of motion, Acta Psychol (Amst), 118, 71, 10.1016/j.actpsy.2004.10.008 Jain, 2008, Audiovisual short-term influences and aftereffects in motion: examination across three sets of directional pairings, J Vis, 8, 10.1167/8.15.7 Caclin, 2011, Auditory enhancement of visual perception at threshold depends on visual abilities, Brain Res, 1396, 35, 10.1016/j.brainres.2011.04.016 Prime, 2010, Predicting the position of moving audiovisual stimuli, Exp Brain Res, 203, 249, 10.1007/s00221-010-2224-4 Radeau, 1987, Auditory–visual interaction and the timing of inputs, Psychol Res, 49, 17, 10.1007/BF00309198 Soto-Faraco, 2003, Multisensory contributions to the perception of motion, Neuropsychologia, 41, 1847, 10.1016/S0028-3932(03)00185-4 Vroomen, 2000, Sound enhances visual perception: cross-modal effects of auditory organization on vision, J Exp Psychol Hum Percept Perform, 26, 1583, 10.1037/0096-1523.26.5.1583 Colonius, 2010, The optimal time window of visual-auditory integration: a reaction time analysis, Front Integr Neurosci, 4, 11 Denison, 2013, Temporal structure and complexity affect audio–visual correspondence detection, Front Psychol, 3 Stevenson, 2013, Multisensory temporal integration: task and stimulus dependencies, Exp Brain Res, 227, 249, 10.1007/s00221-013-3507-3 Sugita, 2003, Audiovisual perception: implicit estimation of sound-arrival time, Nature, 421, 911, 10.1038/421911a Ogawa, 2013, Audio–visual interactions for motion perception in depth modulate activity in visual area V3A, Neuroimage, 71, 158, 10.1016/j.neuroimage.2013.01.012 Wuerger, 2003, The integration of auditory and visual motion signals at threshold, Percept Psychophys, 65, 1188, 10.3758/BF03194844 Lang, 1983, Vol 182, 373 Ishihara, 1986 McDonald, 2005, Neural basis of auditory-induced shifts in visual time-order perception, Nature Neurosci, 8, 1197, 10.1038/nn1512 Feng, 2014, Sounds activate visual cortex and improve visual discrimination, J Neurosci, 34, 9817, 10.1523/JNEUROSCI.4869-13.2014 Puschmann, 2014, Age-realted hearing loss increases cross-modal distractibility, Hear Res, 316, 28, 10.1016/j.heares.2014.07.005 MATLAB Statistics Toolbox Release, 2013