Bacteria Hunt

Journal on Multimodal User Interfaces - Tập 4 - Trang 11-25 - 2010
Christian Mühl1, Hayrettin Gürkök1, Danny Plass-Oude Bos1, Marieke E. Thurlings2,3, Lasse Scherffig4, Matthieu Duvinage5, Alexandra A. Elbakyan6, SungWook Kang7, Mannes Poel1, Dirk Heylen1
1University of Twente, Enschede, The Netherlands
2TNO Human Factors, Soesterberg, The Netherlands
3Utrecht University, Utrecht, The Netherlands
4Academy of Media Arts Cologne, Cologne, Germany
5University of Mons, Mons, Belgium
6Kazakh National Technical University, Almaty, Kazakhstan
7Gwangju Institute of Science and Technology, Gwangju, South Korea

Tóm tắt

The multimodal, multi-paradigm brain-computer interfacing (BCI) game Bacteria Hunt was used to evaluate two aspects of BCI interaction in a gaming context. One goal was to examine the effect of feedback on the ability of the user to manipulate his mental state of relaxation. This was done by having one condition in which the subject played the game with real feedback, and another with sham feedback. The feedback did not seem to affect the game experience (such as sense of control and tension) or the objective indicators of relaxation, alpha activity and heart rate. The results are discussed with regard to clinical neurofeedback studies. The second goal was to look into possible interactions between the two BCI paradigms used in the game: steady-state visually-evoked potentials (SSVEP) as an indicator of concentration, and alpha activity as a measure of relaxation. SSVEP stimulation activates the cortex and can thus block the alpha rhythm. Despite this effect, subjects were able to keep their alpha power up, in compliance with the instructed relaxation task. In addition to the main goals, a new SSVEP detection algorithm was developed and evaluated.

Tài liệu tham khảo

Aarseth E (2003) Playing research: methodological approaches to game analysis. In: Proceedings of the 5th international digital arts and culture conference (DAC), Melbourne, Australia Allison BZ, McFarland DJ, Schalk G, Zheng SD, Jackson MM, Wolpaw JR (2008) Towards an independent brain–computer interface using steady state visual evoked potentials. Clin Neurophysiol 119(2):399–408 Ancoli S, Kamiya J (1978) Methodological issues in alpha biofeedback training. Appl Psychophysiol Biofeedback 3(2):159–183 Arns M, de Ridder S, Strehl U, Breteler M, Coenen A (2009) Efficacy of neurofeedback treatment in ADHD: the effects on inattention, impulsivity and hyperactivity: a meta-analysis. Clin EEG Neurosci 40(3):180–189 Barry RJ, Clarke AR, Johnstone SJ, Magee CA, Rushby JA (2007) EEG differences between eyes-closed and eyes-open resting conditions. Clin Neurophysiol 118(12):2765–2773 Barry RJ, Clarke AR, Johnstone SJ, Brown CR (2009) EEG differences in children between eyes-closed and eyes-open resting conditions. Clin Neurophysiol 120(10):1806–1811 Cheng M, Gao X, Gao S, Xu D (2002) Design and implementation of a brain-computer interface with high transfer rates. IEEE Trans Biomed Eng 49(10):1181–1186 Cohen BA, Sances A Jr (1977) Stationarity of the human electroencephalogram. Med Biol Eng Comput 15(5):513–518 Delorme A (2004) EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J Neurosci Methods 134(1):9–21 Egner T, Gruzelier JH (2003) Ecological validity of neurofeedback: modulation of slow wave eeg enhances musical performance. Neuroreport 14(9):1221–1224 Fairclough SH (2009) Fundamentals of physiological computing. Interact Comput 21(1–2):133–145 Fawcett T (2006) An introduction to ROC analysis. Pattern Recogn Lett 27(8):861–874 Fell J, Elfadil H, Klaver P, Röschke J, Elger CE, Fernández G (2002) Covariation of spectral and nonlinear EEG measures with alpha biofeedback. Int J Neurosci 112(9):1047–1057 Gruzelier J, Egner T, Vernon D (2006) Validating the efficacy of neurofeedback for optimising performance. Prog Brain Res 159:421–431 Hammond D (2005) Neurofeedback treatment of depression and anxiety. J Adult Develop 12(2):131–137 Hardt JV, Kamiya J (1978) Anxiety change through EEG alpha feedback seen only in high anxiety subjects. Science 201(201):79–81 Hare JF, Timmons BH, Roberts JR, Burman AS (1982) EEG alpha-biofeedback training: an experimental technique for the management of anxiety. J Med Eng Technol 6(1):19–24 Herrmann C (2001) Human EEG responses to 1–100 Hz flicker: resonance phenomena in visual cortex and their potential correlation to cognitive phenomena. Exp Brain Res 137(3):346–353 Hjelm SI (2003) Research + design: the making of brainball. Interactions 10(1):26–34 IJsselsteijn W, de Kort Y, Poels K, Jurgelionis A, Bellotti F (2007) Characterising and measuring user experiences in digital games. In: International conference on advances in computer entertainment technology (ACE 2007), Salzburg, Austria Jasper HH (1958) The ten-twenty electrode system of the international federation. Electroencephalogr Clin Neurophysiol 10:371–375 Jia C, Xu H, Hong B, Gao X, Zhang Z, Gao S (2007) A human computer interface using SSVEP-based BCI technology. In: Schmorrow DD, Reeves LM (eds) Foundations of augmented cognition, lecture notes in computer science, vol 4565. Springer, Berlin, Heidelberg, pp 113–119, Chap 13 Kelly SP, Lalor EC, Finucane C, McDarby G, Reilly RB (2005) Visual spatial attention control in an independent brain-computer interface. IEEE Trans Bio-Medical Eng 52(9):1588–1596 Klimesch W (1999) EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis. Brain Res Rev 29(2–3):169–195 Lang PJ, Greenwald MK, Bradley MM, Hamm AO (1993) Looking at pictures: Affective, facial, visceral, and behavioral reactions. Psychophysiology 30(3):261–273 McFarland DJ, McCane LM, David SV, Wolpaw JR (1997) Spatial filter selection for EEG-based communication. Electroencephalogr Clin Neurophysiol 103(3):386–394 Miller G, Lutzenberger W, Elbert T (1991) The linked-reference issue in EEG and ERP recording. J Psychophysiol 5:273 Moore N (2005) The neurotherapy of anxiety disorders. J Adult Develop 12(2):147–154 Morgan ST, Hansen JC, Hillyard SA (1996) Selective attention to stimulus location modulates the steady-state visual evoked potential. Proc Nat Acad Sci USA 93(10):4770–4774 Mühl C, Gürkök H, Plass-Oude Bos D, Thurlings ME, Scherffig L, Duvinage M, Elbakyan AA, Kang S, Poel M, Heylen D (2010) Bacteria Hunt: a multimodal, multiparadigm BCI game. In: Proceedings of the 5th international summer workshop on multimodal interfaces (eNTERFACE’09), Genova, Italy, pp 41–62 Mulholland T, Goodman D, Boudrot R (1983) Attention and regulation of EEG alpha-attenuation responses. Appl Psychophysiol Biofeedback 8(4):585–600 Müller MM, Picton TW, Valdes-Sosa P, Riera J, Teder-Sälejärvi WA, Hillyard SA (1998) Effects of spatial selective attention on the steady-state visual evoked potential in the 20–28 Hz range. Brain Res Cogn Brain Res 6(4):249–261 Müller-Putz G, Scherer R, Brauneis C, Pfurtscheller G (2005) Steady-state visual evoked potential (SSVEP)-based communication: impact of harmonic frequency components. J Neural Eng 2(4):123–130 Nijholt A, Tan D, Pfurtscheller G, Brunner C, Millán JDR, Allison B, Graimann B, Popescu F, Blankertz B, Müller KR (2008) Brain-computer interfacing for intelligent systems. IEEE Intell Syst, pp 76–83 Nijholt A, Reuderink B, Plass-Oude Bos D (2009) Turning shortcomings into challenges: brain-computer interfaces for games. In: Intelligent technologies for interactive entertainment, pp 153–168 Nowlis DP, Kamiya J (1970) The control of electroencephalographic alpha rhythms through auditory feedback and the associated mental activity. Psychophysiology 6(4):476–484 Palva S, Palva J (2007) New vistas for α-frequency band oscillations. Trends Neurosci 30(4):150–158 Pfurtscheller G, Lopes da Silva FH (1999) Event-related EEG/MEG synchronization and desynchronization: basic principles. Clin Neurophysiol 110(11):1842–1857 Plass-Oude Bos D, Reuderink B, Laar B, Gürkök H, Mühl C, Poel M, Nijholt A, Heylen D (2010) Brain-computer interfacing and games. In: Tan DS, Nijholt A (eds) Brain-computer interfaces. Springer, London, pp 149–178, Chap 10 Regan D (1989) Human brain electrophysiology: Evoked potentials and evoked magnetic fields in science and medicine. Appleton & Lange, East Norwalk Reuderink B (2008) Games and brain-computer interfaces: the state of the art. Tech rep, Human-Media Interaction, University of Twente, The Netherlands Reuderink B (2009a) golemml: Python machine learning library for EEG processing. http://code.google.com/p/golemml Reuderink B (2009b) psychicml: Python signal processing library for EEG processing. http://code.google.com/p/psychicml Rice KM, Blanchard EB, Purcell M (1993) Biofeedback treatments of generalized anxiety disorder: preliminary results. Appl Psychophysiol Biofeedback 18(2):93–105 Scherer R, Schloegl A, Lee F, Bischof H, Janša J, Pfurtscheller G (2007) The self-paced Graz brain-computer interface: methods and applications. Comput Intell Neurosci Schlögl A, Brunner C (2008) Biosig: A free and open source software library for BCI research. Computer 41(10):44–50 Schlögl A, Keinrath C, Zimmermann D, Scherer R, Leeb R, Pfurtscheller G (2007) A fully automated correction method of EOG artifacts in EEG recordings. Clin Neurophysiol 118(1):98–104 Schürmann M, Başar E (2001) Functional aspects of alpha oscillations in the EEG. Int J Psychophysiol 39(2–3):151–158 Shaw JC (1996) Intention as a component of the alpha-rhythm response to mental activity. Int J Psychophysiol 24(1–2):7–23 Skidmore T, Hill H (1991) The evoked potential human-computer interface. Proc Ann Int Conf IEEE Eng Med Biol Soc 13(1):407–408 Sokhadze TM, Cannon RL, Trudeau DL (2008) EEG biofeedback as a treatment for substance use disorders: review, rating of efficacy and recommendations for further research. J Neurother: Invest Neuromodulation Neurofeedback Appl Neurosci 12(1):5–43 Sterman M, Egner T (2006) Foundation and practice of neurofeedback for the treatment of epilepsy. Appl Psychophysiol Biofeedback 31(1):21–35 Thurlings ME, Brouwer AM, van Erp JBF, Werkhoven PJ (2009) SSVEPs for BCI? The effect of stimulus eccentricity on SSVEPs, abstract presented at the 39th Annual Meeting of the Society for Neuroscience Thurlings ME, Erp JBF, Brouwer AM, Werkhoven PJ (2010) EEG-based navigation from a human factors perspective. In: Tan DS, Nijholt A (eds) Brain-computer interfaces. Springer, London, pp 71–86, Chap 5 Ward A, Murray-Ward M (1999) Assessment in the classroom. Wadsworth, Belmont Welch P (1967) The use of fast Fourier transform for the estimation of power spectra: a method based on time averaging over short modified periodograms. IEEE Trans Audio Electroacoust 15(2):70–73 Zander TO, Kothe C, Jatzev S, Gaertner M (2010) Enhancing human-computer interaction with input from active and passive brain-computer interfaces. In: Tan DS, Nijholt A (eds) Brain-computer interfaces. Springer, London, pp 181–199, Chap 11