Effects of Musical Training, Timbre, and Response Orientation on the ROMPR Effect
Tóm tắt
Music perception involves multisensory perception. In this study, the impact of timbre on the interaction between pitch-space crossmodal correspondences and response orientation (the ROMPR effect) is explored across two experiments. Participants were examined in both auditory and visual stimuli, then were asked to judge the pitch of the auditory stimulus they heard. Tones were presented in different timbres for each experiment: Experiment 1 examined the impact of timbre on the ROMPR effect by comparing piano and flute tones. Experiment 2 examined the effect of differing response orientation on the presence and strength of the ROMPR effect in the context of cello tones. In the first experiment, results showed that piano tones have a stronger ROMPR effect than flute tones at high pitches, likely because of the piano’s construction, which is congruent to the horizontal orientation. Also, a stronger ROMPR effect was found on low pitches comparison to high pitches. The results of the second experiment showed that response orientation affects the presence and directionality of the ROMPR effect, but that this feature is mediated by musical ability. Specifically, only those with above-median musical abilities demonstrated the horizontal ROMPR effect in the congruent condition. Overall, these findings suggest that timbre plays a role in the strength of the ROMPR effect only to the extent that the timbre can be associated with the spatial orientation of the source of the sound. This adds to a mixed literature, where many of the observed effects are relatively small in magnitude, and suggests the need for additional large-sample studies to draw firmer conclusions.
Tài liệu tham khảo
citation_journal_title=i-Perception; citation_title=A SMARC effect for loudness; citation_author=E Bruzzi, F Talamini, K Priftis, M Grassi; citation_volume=8; citation_issue=6; citation_publication_date=2017; citation_pages=2041669517742175; citation_doi=10.1177/2041669517742175; citation_id=CR1
citation_journal_title=Journal of Physiology, Paris; citation_title=Multisensory integration: Methodological approaches and emerging principles in the human brain; citation_author=GA Calvert, T Thesen; citation_volume=98; citation_issue=1; citation_publication_date=2004; citation_pages=191-205; citation_doi=10.1016/j.jphysparis.2004.03.018; citation_id=CR2
citation_journal_title=Attention, Perception, & Psychophysics; citation_title=The spatial musical association of response codes does not depend on a normal visual experience: A study with early blind individuals; citation_author=Z Cattaneo, C Lega, L Rinaldi, M Fantino, C Ferrari, LB Merabet, T Vecchi; citation_volume=80; citation_publication_date=2018; citation_pages=813-821; citation_doi=10.3758/s13414-018-1495-x; citation_id=CR3
citation_journal_title=Journal of Experimental Psychology: Human Perception and Performance; citation_title=Referential coding contributes to the horizontal SMARC effect; citation_author=YS Cho, GY Bae, RW Proctor; citation_volume=38; citation_issue=3; citation_publication_date=2012; citation_pages=726-734; citation_doi=10.1037/a0026157; citation_id=CR4
citation_journal_title=Brain Research; citation_title=Semantics and the multisensory brain: How meaning modulates processes of audio-visual integration; citation_author=O Doehrmann, MJ Naumer; citation_volume=1242; citation_publication_date=2008; citation_pages=136-150; citation_doi=10.1016/j.brainres.2008.03.071; citation_id=CR5
citation_journal_title=Psychological Science; citation_title=Prelinguistic infants are sensitive to space-pitch associations found across cultures; citation_author=S Dolscheid, S Hunnius, D Casasanto, A Majid; citation_volume=25; citation_issue=6; citation_publication_date=2014; citation_pages=1256-1261; citation_doi=10.1177/0956797614528521; citation_id=CR6
citation_journal_title=Cognition; citation_title=Beethoven’s last piano sonata and those who follow crocodiles: Cross-domain mappings of auditory pitch in a musical context; citation_author=Z Eitan, R Timmers; citation_volume=114; citation_issue=3; citation_publication_date=2010; citation_pages=405-422; citation_doi=10.1016/j.cognition.2009.10.013; citation_id=CR7
citation_journal_title=Science; citation_title=Increased cortical representation of the fingers of the left hand in string players; citation_author=T Elbert, C Pantev, C Wienbruch, B Rockstroh, E Taub; citation_volume=270; citation_issue=5234; citation_publication_date=1995; citation_pages=305-307; citation_doi=10.1126/science.270.5234.305; citation_id=CR8
citation_journal_title=Acta Psychologica; citation_title=Looking at the world with your ears: How do we get the size of an object from it’s sound?; citation_author=M Grassi, M Pastore, G Lemaitre; citation_volume=143; citation_issue=1; citation_publication_date=2013; citation_pages=96-104; citation_doi=10.1016/j.actpsy.2013.02.005; citation_id=CR9
citation_journal_title=Laterality; citation_title=About the existence of a horizontal mental pitch line in non-musicians; citation_author=A Guilbert; citation_volume=25; citation_issue=2; citation_publication_date=2020; citation_pages=215-228; citation_doi=10.1080/1357650X.2019.1646756; citation_id=CR10
citation_journal_title=Cognitive Processing; citation_title=Non-musicians also have a piano in the head: evidence for spatial–musical associations from line bisection tracking; citation_author=M Hartmann; citation_volume=18; citation_issue=1; citation_publication_date=2017; citation_pages=75-80; citation_doi=10.1007/s10339-016-0779-0; citation_id=CR11
citation_journal_title=Quarterly Journal of Experimental Psychology; citation_title=Loudness counts: interactions between loudness, number magnitude, and space; citation_author=M Hartmann, FW Mast; citation_volume=70; citation_issue=7; citation_publication_date=2017; citation_pages=1305-1322; citation_doi=10.1080/17470218.2016.1182194; citation_id=CR12
Klapman, S. F., Munn, J. T., & Wilbiks, J. M. P. (2020). Response orientation modulates pitch–space relationships: The ROMPR effect. Psychological Research Psychologische Forschung.
https://doi.org/10.1007/s00426-020-01388-z
.
citation_journal_title=Frontiers in Psychology; citation_title=Magnitude or multitude—What counts?; citation_author=M Lachmair, S Ruiz Fernández, K Moeller, H-C Nuerk, B Kaup; citation_volume=9; citation_publication_date=2018; citation_doi=10.3389/fpsyg.2018.00522; citation_id=CR14
citation_journal_title=Psychological Research; citation_title=Music-space associations are grounded, embodied and situated: examination of cello experts and non-musicians in a standard tone discrimination task; citation_author=M Lachmair, U Cress, T Fissler, S Kurek, J Leininger, H-C Nuerk; citation_volume=83; citation_issue=5; citation_publication_date=2019; citation_pages=894-906; citation_doi=10.1007/s00426-017-0898-y; citation_id=CR15
citation_journal_title=PLoS ONE; citation_title=Assessing musical abilities objectively: Construction and validation of the profile of music perception skills; citation_author=LNC Law, M Zentner; citation_volume=7; citation_issue=12; citation_publication_date=2012; citation_doi=10.1371/journal.pone.0052508; citation_id=CR16
citation_journal_title=Psychological Research; citation_title=Item-specific congruency effects in nonverbal auditory Stroop; citation_author=LC Leboe, LC Leboe, TA Mondor, TA Mondor; citation_volume=71; citation_issue=5; citation_publication_date=2007; citation_pages=568-575; citation_doi=10.1007/s00426-006-0049-3; citation_id=CR17
citation_journal_title=Frontiers in Human Neuroscience; citation_title=The effect of musical expertise on the representation of space; citation_author=C Lega, Z Cattaneo, LB Merabet, T Vecchi, S Cucchi; citation_volume=8; citation_publication_date=2014; citation_pages=250; citation_doi=10.3389/fnhum.2014.00250; citation_id=CR18
citation_journal_title=Quarterly Journal of Experimental Psychology; citation_title=Instrumental expertise and musical timbre modulate the spatial representation of pitch; citation_author=C Lega, Z Cattaneo, N Ancona, T Vecchi, L Rinaldi; citation_volume=73; citation_issue=8; citation_publication_date=2020; citation_pages=1162-1172; citation_doi=10.1177/1747021819897779; citation_id=CR19
citation_journal_title=Human brain mapping; citation_title=Musical training induces functional and structural auditory-motor network plasticity in young adults; citation_author=Q Li, X Wang, S Wang, Y Xie, X Li, Y Xie, S Li; citation_volume=39; citation_issue=5; citation_publication_date=2018; citation_pages=2098-2110; citation_doi=10.1002/hbm.23989; citation_id=CR20
citation_journal_title=Journal of Experimental Psychology. Human Perception and Performance; citation_title=Spatial associations for musical stimuli: A piano in the head?; citation_author=P Lidji, R Kolinsky, A Lochy, J Morais; citation_volume=33; citation_publication_date=2007; citation_pages=1189-1207; citation_doi=10.1037/0096-1523.33.5.1189; citation_id=CR21
citation_journal_title=Perception & Psychophysics; citation_title=Interaction among auditory dimensions: Timbre, pitch, and loudness; citation_author=RD Melara, LE Marks; citation_volume=48; citation_issue=2; citation_publication_date=1990; citation_pages=169-178; citation_doi=10.3758/BF03207084; citation_id=CR22
citation_journal_title=PLoS ONE; citation_title=The musicality of non-musicians: An index for assessing musical sophistication in the general population; citation_author=D Müllensiefen, B Gingras, J Musil, L Stewart; citation_volume=9; citation_issue=2; citation_publication_date=2014; citation_doi=10.1371/journal.pone.0089642; citation_id=CR23
citation_journal_title=Psychonomic Bulletin & Review; citation_title=Effects of laterality and pitch height of an auditory accessory stimulus on horizontal response selection: The Simon effect and the SMARC effect; citation_author=A Nishimura, K Yokosawa; citation_volume=16; citation_issue=4; citation_publication_date=2009; citation_pages=666-670; citation_doi=10.3758/PBR.16.4.666; citation_id=CR24
citation_journal_title=Neuroscience Letters; citation_title=Synesthetic congruency modulates the temporal ventriloquism effect; citation_author=C Parise, C Spence; citation_volume=442; citation_issue=3; citation_publication_date=2008; citation_pages=257-261; citation_doi=10.1016/j.neulet.2008.07.010; citation_id=CR25
citation_journal_title=PLoS One; citation_title=‘When birds of a feather flock together’: Synesthetic correspondences modulate audiovisual integration in non-synesthetes; citation_author=CV Parise, C Spence; citation_volume=4; citation_issue=5; citation_publication_date=2009; citation_doi=10.1371/journal.pone.0005664; citation_id=CR26
citation_journal_title=Proceedings of the National Academy of Sciences of the United States of America; citation_title=Natural auditory scene statistics shapes human spatial hearing; citation_author=CV Parise, K Knorre, MO Ernst; citation_volume=111; citation_issue=16; citation_publication_date=2014; citation_pages=6104-6108; citation_doi=10.1073/pnas.1322705111; citation_id=CR27
citation_journal_title=Journal of the American Geriatrics Society; citation_title=Music, spatial task performance, and brain plasticity in elderly adults; citation_author=MT Pecci, W Verrusio, AF Radicioni, A Anzuini, A Renzi, V Martinelli; citation_volume=64; citation_issue=10; citation_publication_date=2016; citation_pages=e78-e80; citation_doi=10.1111/jgs.14361; citation_id=CR28
citation_journal_title=Attention, Perception & Psychophysics; citation_title=Low is large: Spatial location and pitch interact in voice-based body size estimation; citation_author=K Pisanski, SGE Isenstein, KJ Montano, JJM O’Connor, DR Feinberg; citation_volume=79; citation_issue=4; citation_publication_date=2017; citation_pages=1239-1251; citation_doi=10.3758/s13414-016-1273-6; citation_id=CR29
citation_journal_title=Psychological Research; citation_title=Naturally together: Pitch-height and brightness as coupled factors for eliciting the SMARC effect in non-musicians; citation_author=M Pitteri, M Marchetti, K Priftis, M Grassi; citation_volume=81; citation_issue=1; citation_publication_date=2017; citation_pages=243-254; citation_doi=10.1007/s00426-015-0713-6; citation_id=CR30
Pitteri, M., Marchetti, M., Grassi, M., & Priftis, K. (2020). Pitch height and brightness both contribute to elicit the SMARC effect: A replication study with expert musicians. Psychological Research Psychologische Forschung.
https://doi.org/10.1007/s00426-020-01395-0
.
citation_journal_title=Journal of Experimental Psychology; citation_title=The spatial character of high and low tones; citation_author=CC Pratt; citation_volume=13; citation_issue=3; citation_publication_date=1930; citation_pages=278; citation_doi=10.1037/h0072651; citation_id=CR32
citation_journal_title=Cognition; citation_title=Spatial representation of pitch height: The SMARC effect; citation_author=E Rusconi, B Kwan, BL Giordano, C Umiltà, B Butterworth; citation_volume=99; citation_issue=2; citation_publication_date=2006; citation_pages=113-129; citation_doi=10.1016/j.cognition.2005.01.004; citation_id=CR33
citation_journal_title=Scientific Reports; citation_title=On the generalization of tones: A detailed exploration of non-speech auditory perception stimuli; citation_author=M Schutz, J Gillard; citation_volume=10; citation_publication_date=2020; citation_pages=9520; citation_doi=10.1038/s41598-020-63132-2; citation_id=CR34
citation_journal_title=Quarterly Journal of Experimental Psychology; citation_title=Name that percussive tune: Associative memory and amplitude envelope; citation_author=M Schutz, J Stefanucci, S Baum, A Roth; citation_volume=70; citation_publication_date=2017; citation_pages=1323-1343; citation_doi=10.1080/17470218.2016.1182562; citation_id=CR35
citation_journal_title=Quarterly Journal of Experimental Psychology; citation_title=Action–perception coupling in pianists: Learned mappings or spatial musical association of response codes (SMARC) effect?; citation_author=L Stewart, RG Verdonschot, P Nasralla, J Lanipekun; citation_volume=66; citation_issue=1; citation_publication_date=2018; citation_pages=37-50; citation_doi=10.1080/17470218.2012.687385; citation_id=CR36
citation_journal_title=Psychomusicology: Music, Mind, and Brain; citation_title=Representation of pitch in horizontal space and its dependence on musical and instrumental experience; citation_author=R Timmers, S Li; citation_volume=26; citation_issue=2; citation_publication_date=2016; citation_pages=139-148; citation_doi=10.1037/pmu0000146; citation_id=CR37
citation_journal_title=Perception (London); citation_title=A common scheme for cross-sensory correspondences across stimulus domains; citation_author=L Walker, P Walker, B Francis; citation_volume=41; citation_issue=10; citation_publication_date=2012; citation_pages=1186-1192; citation_doi=10.1068/p7149; citation_id=CR38
citation_journal_title=Quarterly Journal of Experimental Psychology (2006); citation_title=When speech enhances spatial musical association of response codes: Joint spatial associations of pitch and timbre in nonmusicians; citation_author=T Weis, B Estner, T Lachmann; citation_volume=69; citation_issue=9; citation_publication_date=2016; citation_pages=1687-1700; citation_doi=10.1080/17470218.2015.1091850; citation_id=CR39
citation_journal_title=Journal of Neuroscience; citation_title=Older adults benefit from music training early in life: biological evidence for longterm training-driven plasticity; citation_author=T White-Schwoch, KW Carr, S Anderson, DL Strait, N Kraus; citation_volume=33; citation_issue=45; citation_publication_date=2013; citation_pages=17667-17674; citation_doi=10.1523/JNEUROSCI.2560-13.2013; citation_id=CR40