Exploring Frequency-Dependent Brain Networks from Ongoing EEG Using Spatial ICA During Music Listening
Tóm tắt
Recently, exploring brain activity based on functional networks during naturalistic stimuli especially music and video represents an attractive challenge because of the low signal-to-noise ratio in collected brain data. Although most efforts focusing on exploring the listening brain have been made through functional magnetic resonance imaging (fMRI), sensor-level electro- or magnetoencephalography (EEG/MEG) technique, little is known about how neural rhythms are involved in the brain network activity under naturalistic stimuli. This study exploited cortical oscillations through analysis of ongoing EEG and musical feature during freely listening to music. We used a data-driven method that combined music information retrieval with spatial Fourier Independent Components Analysis (spatial Fourier–ICA) to probe the interplay between the spatial profiles and the spectral patterns of the brain network emerging from music listening. Correlation analysis was performed between time courses of brain networks extracted from EEG data and musical feature time series extracted from music stimuli to derive the musical feature related oscillatory patterns in the listening brain. We found brain networks of musical feature processing were frequency-dependent. Musical feature time series, especially fluctuation centroid and key feature, were associated with an increased beta activation in the bilateral superior temporal gyrus. An increased alpha oscillation in the bilateral occipital cortex emerged during music listening, which was consistent with alpha functional suppression hypothesis in task-irrelevant regions. We also observed an increased delta–beta oscillatory activity in the prefrontal cortex associated with musical feature processing. In addition to these findings, the proposed method seems valuable for characterizing the large-scale frequency-dependent brain activity engaged in musical feature processing.
Tài liệu tham khảo
Abou-Elseoud A, Starck T, Remes J, Nikkinen J, Tervonen O, Kiviniemi V (2010) The effect of model order selection in group PICA. Hum Brain Mapp 31(8):1207–1216
Alluri V, Toiviainen P (2010) Exploring perceptual and acoustical correlates of polyphonic timbre. Music Perception: An Interdisciplinary Journal 27(3):223–242
Alluri V, Toiviainen P, Jaaskelainen IP, Glerean E, Sams M, Brattico E (2012a) Large-scale brain networks emerge from dynamic processing of musical timbre, key and rhythm. Neuroimage 59(4):3677–3689. https://doi.org/10.1016/j.neuroimage.2011.11.019
Alluri V, Toiviainen P, Jääskeläinen IP, Glerean E, Sams M, Brattico E (2012b) Large-scale brain networks emerge from dynamic processing of musical timbre, key and rhythm. Neuroimage 59(4):3677–3689
Alluri V, Toiviainen P, Lund TE, Wallentin M, Vuust P, Nandi AK, … Brattico E (2013) From Vivaldi to Beatles and back: predicting lateralized brain responses to music. Neuroimage 83:627–636. https://doi.org/10.1016/j.neuroimage.2013.06.064
Arnal LH, Doelling KB, Poeppel D (2015) Delta-Beta Coupled Oscillations Underlie Temporal Prediction Accuracy. Cereb Cortex 25(9):3077–3085. https://doi.org/10.1093/cercor/bhu103
Brookes MJ, O'neill, GC, Hall, EL, Woolrich MW., Baker A, Corne, SP, … Barnes GR (2014) Measuring temporal, spectral and spatial changes in electrophysiological brain network connectivity. Neuroimage 91:282–299
Burunat I, Alluri V, Toiviainen P, Numminen J, Brattico E (2014) Dynamics of brain activity underlying working memory for music in a naturalistic condition. Cortex 57:254–269. https://doi.org/10.1016/j.cortex.2014.04.012
Burunat I, Toiviainen P, Alluri V, Bogert B, Ristaniemi T, Sams M, Brattico E (2016a) The reliability of continuous brain responses during naturalistic listening to music. Neuroimage 124(Pt A):224–231. https://doi.org/10.1016/j.neuroimage.2015.09.005
Burunat I, Toiviainen P, Alluri V, Bogert B, Ristaniemi T, Sams M, Brattico E (2016b) The reliability of continuous brain responses during naturalistic listening to music. NeuroImage 124:224–231
Cong F, Alluri V, Nandi AK, Toiviainen P, Fa R, Abu-Jamous B, … Huotilainen M (2013) Linking brain responses to naturalistic music through analysis of ongoing EEG and stimulus features. IEEE Trans Multimed 15(5):1060–1069
Daly I, Malik A, Hwang F, Roesch E, Weaver J, Kirke A, … Nasuto SJ (2014) Neural correlates of emotional responses to music: an EEG study. Neurosci Lett 573:52–57. https://doi.org/10.1016/j.neulet.2014.05.003
Daly I, Williams D, Hallowell J, Hwang F, Kirke A, Malik A, … Nasuto SJ (2015) Music-induced emotions can be predicted from a combination of brain activity and acoustic features. Brain Cogn 101:1–11. https://doi.org/10.1016/j.bandc.2015.08.003
Delorme A, Makeig S (2004) EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J Neurosci Methods 134(1):9–21. https://doi.org/10.1016/j.jneumeth.2003.10.009
Doelling KB, Poeppel D (2015) Cortical entrainment to music and its modulation by expertise. Proc Natl Acad Sci USA 112(45):E6233–6242. https://doi.org/10.1073/pnas.1508431112
Hasson U, Malach R, Heeger DJ (2010) Reliability of cortical activity during natural stimulation. Trends Cogn Sci 14(1):40–48. https://doi.org/10.1016/j.tics.2009.10.011
Helfrich RF, Knight RT (2016) Oscillatory dynamics of prefrontal cognitive control. Trends Cogn Sci 20(12):916–930. https://doi.org/10.1016/j.tics.2016.09.007
Himberg J, Hyvarinen A, Esposito F (2004) Validating the independent components of neuroimaging time series via clustering and visualization. Neuroimage 22(3):1214–1222. https://doi.org/10.1016/j.neuroimage.2004.03.027
Hyvarinen A (1999) Fast and robust fixed-point algorithms for independent component analysis. IEEE Trans Neural Netw 10(3):626–634. https://doi.org/10.1109/72.761722
Hyvarinen A, Ramkumar P, Parkkonen L, Hari R (2010) Independent component analysis of short-time Fourier transforms for spontaneous EEG/MEG analysis. Neuroimage 49(1):257–271. https://doi.org/10.1016/j.neuroimage.2009.08.028
Janata, P., Birk, J. L., Van Horn, J. D., Leman, M., Tillmann, B., & Bharucha, J. J. (2002). The cortical topography of tonal structures underlying Western music. Science, 298 (5601), 2167–2170.
Jäncke L, Alahmadi N (2016) Detection of independent functional networks during music listening using electroencephalogram and sLORETA-ICA. Neuroreport 27(6):455–461
Jäncke L, Kühnis J, Rogenmoser L, Elmer S (2015) Time course of EEG oscillations during repeated listening of a well-known aria. Front Hum Neurosci 9:401
Jäncke L, Leipold S, Burkhard A (2018) The neural underpinnings of music listening under different attention conditions. Neuroreport 29(7):594–604
Kauppi J-P, Parkkonen L, Hari R, Hyvärinen A (2013) Decoding magnetoencephalographic rhythmic activity using spectrospatial information. Neuroimage 83:921–936
Klimesch W (2012) alpha-band oscillations, attention, and controlled access to stored information. Trends Cogn Sci 16(12):606–617. https://doi.org/10.1016/j.tics.2012.10.007
Koskinen M, Viinikanoja J, Kurimo M, Klami A, Kaski S, Hari R (2013) Identifying fragments of natural speech from the listener's MEG signals. Hum Brain Mapp 34(6):1477–1489. https://doi.org/10.1002/hbm.22004
Lankinen K, Saari J, Hari R, Koskinen M (2014) Intersubject consistency of cortical MEG signals during movie viewing. Neuroimage 92:217–224. https://doi.org/10.1016/j.neuroimage.2014.02.004
Lartillot O, Toiviainen P (2007) A Matlab toolbox for musical feature extraction from audio. Paper presented at the International conference on digital audio effects.
Lartillot O, Toiviainen P, Eerola T (2008) A matlab toolbox for music information retrieval. In Data analysis, machine learning and applications (pp. 261–268): Springer.
Lei X, Yao D (2011) EEG source localization based on multiple fMRI spatial patterns. In Advances in Cognitive Neurodynamics (II) (pp. 381–385): Springer.
Li C, Yuan H, Shou G, Cha Y-H, Sunderam S, Besio W, Ding L (2018) Cortical statistical correlation tomography of EEG resting state networks. Front Neurosci 12.
Li F, Yi C, Song L, Jiang Y, Peng W, Si Y, … Zhang Y (2019) Brain network reconfiguration during motor imagery revealed by a large-scale network analysis of scalp EEG. Brain Topogr 32(2):304–314
Li H, Correa NM, Rodriguez PA, Calhoun VD, Adali T (2011) Application of independent component analysis with adaptive density model to complex-valued fMRI data. IEEE Trans Biomed Eng 58(10):2794–2803. https://doi.org/10.1109/TBME.2011.2159841
Lin FH, Belliveau JW, Dale AM, Hamalainen MS (2006) Distributed current estimates using cortical orientation constraints. Hum Brain Mapp 27(1):1–13. https://doi.org/10.1002/hbm.20155
Liu C, Abu-Jamous B, Brattico E, Nandi AK (2017) Towards tunable consensus clustering for studying functional brain connectivity during affective processing. Int J Neural Sys 27(02):1650042
Malcolm GL, Groen II, Baker CI (2016) Making sense of real-world scenes. Trends Cogn Sci 20(11):843–856. https://doi.org/10.1016/j.tics.2016.09.003
Markovic A, Kühnis J, Jäncke L (2017) Task context influences brain activation during music listening.Front Hum Neurosci 11:342
Meyer M, Baumann S, Jancke L (2006) Electrical brain imaging reveals spatio-temporal dynamics of timbre perception in humans. Neuroimage 32(4):1510–1523
Mikutta C, Altorfer A, Strik W, Koenig T (2012) Emotions, arousal, and frontal alpha rhythm asymmetry during Beethoven’s 5th symphony. Brain Topogr 25(4):423–430
Mikutta C, Maissen G, Altorfer A, Strik W, König T (2014) Professional musicians listen differently to music. Neuroscience 268:102–111
Nugent AC, Luber B, Carver FW, Robinson SE, Coppola R, Zarate CA Jr (2017) Deriving frequency-dependent spatial patterns in MEG-derived resting state sensorimotor network: A novel multiband ICA technique. Hum Brain Mapp 38(2):779–791. https://doi.org/10.1002/hbm.23417
Pampalk E, Rauber A, Merkl D (2002) Content-based organization and visualization of music archives. In: Proceedings of the tenth ACM international conference on Multimedia. pp 570–579
Pearce MT, Ruiz MH, Kapasi S, Wiggins GA, Bhattacharya J (2010) Unsupervised statistical learning underpins computational, behavioural, and neural manifestations of musical expectation. Neuroimage 50(1):302–313
Pfurtscheller G (2003) Induced oscillations in the alpha band: functional meaning. Epilepsia 44:2–8
Poikonen H, Alluri V, Brattico E, Lartillot O, Tervaniemi M, Huotilainen M (2016a) Event-related brain responses while listening to entire pieces of music. Neuroscience 312:58–73
Poikonen H, Toiviainen P, Tervaniemi M (2016b) Early auditory processing in musicians and dancers during a contemporary dance piece. Sci Rep 6:33056
Poikonen H, Toiviainen P, Tervaniemi M (2018a) Dance on cortex: Enhanced theta synchrony in experts when watching a dance piece. Eur J Neurosci 47(5):433–445
Poikonen H, Toiviainen P, Tervaniemi M (2018b) Naturalistic music and dance: cortical phase synchrony in musicians and dancers. PloS One 13(4):e0196065
Ramkumar P, Parkkonen L, Hari R, Hyvärinen A (2012) Characterization of neuromagnetic brain rhythms over time scales of minutes using spatial independent component analysis. Hum Brain Mapp 33(7):1648–1662
Ramkumar P, Parkkonen L, Hyvärinen A (2014) Group-level spatial independent component analysis of Fourier envelopes of resting-state MEG data. Neuroimage 86:480–491
Rogenmoser L, Zollinger N, Elmer S, Jäncke L (2016) Independent component processes underlying emotions during natural music listening. Soc Cogn Affect Neurosci 11(9):1428–1439
Schaefer RS, Desain P, Farquhar J (2013) Shared processing of perception and imagery of music in decomposed EEG. Neuroimage 70:317–326. https://doi.org/10.1016/j.neuroimage.2012.12.064
Smith SM, Fox PT, Miller KL, Glahn DC, Fox PM, Mackay CE, … Laird AR (2009) Correspondence of the brain's functional architecture during activation and rest. Proc Nat Acad Sci 106(31):13040–13045
Sockeel S, Schwartz D, Pelegrini-Issac M, Benali H (2016 )Large-scale functional networks identified from resting-state EEG using spatial ICA. PLoS One 11(1):e0146845. https://doi.org/10.1371/journal.pone.0146845
Spiers HJ, Maguire EA (2007) Decoding human brain activity during real-world experiences. Trends Cogn Sci 11(8):356–365. https://doi.org/10.1016/j.tics.2007.06.002
Sturm I, Dahne S, Blankertz B, Curio G (2015) Multi-variate EEG analysis as a novel tool to examine brain responses to naturalistic music stimuli PLoS One 10(10):e0141281. https://doi.org/10.1371/journal.pone.0141281
Tadel F, Baillet S, Mosher JC, Pantazis D, Leahy RM (2011) Brainstorm: a user-friendly application for MEG/EEG analysis. Comput Intell Neurosci 2011:879716. https://doi.org/10.1155/2011/879716
Tian Y, Klein RM, Satel J, Xu P, Yao D (2011) Electrophysiological explorations of the cause and effect of inhibition of return in a cue–target paradigm. Brain Topogr 24(2):164–182
Toiviainen P, Alluri V, Brattico E, Wallentin M, Vuust P (2014) Capturing the musical brain with Lasso: dynamic decoding of musical features from fMRI data. Neuroimage 88:170–180. https://doi.org/10.1016/j.neuroimage.2013.11.017
Wang D, Cong F, Zhao Q, Toiviainen P, Nandi AK, Huotilainen M, Ristaniemi T, Cichocki A (2016) Exploiting ongoing EEG with multilinear partial least squares during free-listening to music. In: Paper presented at the Machine Learning for Signal Processing (MLSP), 2016 IEEE 26th International Workshop on
Zhu Y, Liu J, Mathiak K, Ristaniemi T, Cong F (2020) Deriving electrophysiological brain network connectivity via tensor component analysis during freely listening to music. IEEE Trans Neural Syst Rehabil Eng 28(2):409–418
Zhu Y, Liu J, Ristaniemi T, Cong F (2019) Distinct patterns of functional connectivity during the comprehension of natural, narrative speech. Int J Neural Syst. https://doi.org/10.1142/S0129065720500070