There are few EEG studies on finger movement directions because ocular artifacts also convey directional information, which makes it hard to separate the contribution of EEG from that of the ocular artifacts. To overcome this issue, we designed an experiment in which EEG’s temporal dynamics and spatial information are evaluated together to improve the performance of brain-computer interface (BCI) for classifying finger movement directions. Six volunteers participated in the study. We examined their EEG using decoding analyses. Independent components (ICs) that represented brain-source signals successfully classified the directions of the finger movements with higher rates than chance level. The weight analyses of the classifiers revealed that maximal performance of the classification was recorded at the latencies prior to the onset of finger movements. The weight analyses also revealed the relevant cortical areas including the right lingual, left posterior cingulate, left inferior temporal gyrus, and right precuneus, which indicated the involvement of the visuospatial processing. We concluded that combining spatial distribution and temporal dynamics of the scalp EEG may improve BCI performance.
KeywordsElectroencephalographyIndependent Component AnalysisFinger Movement Decoding Brain-Computer InterfaceOccipital Lobe
Balasubramanian, S., Garcia-cossio, E., Birbaumer, N., Burdet, E. and Ramos-murguialday, A. (2018) Is EMG a Viable Alternative to BCI for Detecting Movement Intention in Severe Stroke? IEEE Transactions on Biomedical Engineering, 65, 2790-2797. https://doi.org/10.1109/TBME.2018.2817688
Shain, W., et al. (2003) Controlling Cellular Reactive Responses around Neural Prosthetic Devices Using Peripheral and Local Intervention Strategies. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 11, 186-188. https://doi.org/10.1109/TNSRE.2003.814800
Gruenwald, J., Znobishchev, A., Kapeller, C., Kamada, K., Scharinger, J. and Guger, C. (2019) Time-Variant Linear Discriminant Analysis Improves Hand Gesture and Finger Movement Decoding for Invasive Brain-Computer Interfaces. Frontiers in Neuroscience, 13, 901. https://doi.org/10.3389/fnins.2019.00901
Salari, E., Freudenburg, Z.V., Branco, M.P., Aarnoutse, E.J., Vansteensel, M.J. and Ramsey, N.F. (2019) Classification of Articulator Movements and Movement Direction from Sensorimotor Cortex Activity. Scientific Reports, 9, Article No. 14165. https://doi.org/10.1038/s41598-019-50834-5
Pan, G., et al. (2018) Rapid Decoding of Hand Gestures in Electrocorticography Using Recurrent Neural Networks. Frontiers in Neuroscience, 12, 555. https://doi.org/10.3389/fnins.2018.00555
Berlot, E., Prichard, G., O’Reilly, J., Ejaz, N. and Diedrichsen, J. (2019) Ipsilateral Finger Representations in the Sensorimotor Cortex Are Driven by Active Movement Processes, Not Passive Sensory Input. Journal of Neurophysiology, 121, 418-426. https://doi.org/10.1152/jn.00439.2018
McFarland, D.J., Sarnacki, W.A. and Wolpaw, J.R. (2010) Electroencephalographic (EEG) Control of Three-Dimensional Movement. Journal of Neural Engineering, 7, Article ID: 036007. https://doi.org/10.1088/1741-2560/7/3/036007
Jung, T.-P., Makeig, S., Westerfield, M., Townsend, J., Courchesne, E. and Sejnowski, T.J. (2000) Removal of Eye Activity Artifacts from Visual Event-Related Potentials in Normal and Clinical Subjects. Clinical Neurophysiology, 111, 1745-1758. https://doi.org/10.1016/S1388-2457(00)00386-2
Nauhaus, I., Benucci, A., Carandini, M. and Ringach, D.L. (2008) Neuronal Selectivity and Local Map Structure in Visual Cortex. Neuron, 57, 673-679. https://doi.org/10.1016/j.neuron.2008.01.020
Nakata, H., Domoto, R., Mizuguchi, N., Sakamoto, K. and Kanosue, K. (2019) Negative BOLD Responses during Hand and Foot Movements: An fMRI Study. PLoS ONE, 14, e0215736. https://doi.org/10.1371/journal.pone.0215736
Asemi, A., Ramaseshan, K., Burgess, A., Diwadkar, V.A. and Bressler, S.L. (2015) Dorsal Anterior Cingulate Cortex Modulates Supplementary Motor Area in Coordinated Unimanual Motor Behavior. Frontiers in Human Neuroscience, 9, 309. https://doi.org/10.3389/fnhum.2015.00309
Astafiev, S.V., Stanley, C.M., Shulman, G.L. and Corbetta, M. (2004) Extrastriate Body Area in Human Occipital Cortex Responds to the Performance of Motor Actions. Nature Neuroscience, 7, 542-548. https://doi.org/10.1038/nn1241
Jung, T.P., et al. (2000) Removing Electroencephalographic Artifacts by Blind Source Separation. Psychophysiology, 37, 163-178. https://doi.org/10.1111/1469-8986.3720163
Tanaka, H., Miyakoshi, M. and Makeig, S. (2018) Dynamics of Directional Tuning and Reference Frames in Humans: A High-Density EEG Study. Scientific Reports, 8, Article No. 8205. https://doi.org/10.1038/s41598-018-26609-9
Wang, Y. and Makeig, S. (2009) Predicting Intended Movement Direction Using EEG from Human Posterior Parietal Cortex. International Conference on Foundations of Augmented Cognition, San Diego, 19-24 July 2009, 437-446. https://doi.org/10.1007/978-3-642-02812-0_52
Delorme, A., Palmer, J., Onton, J., Oostenveld, R. and Makeig, S. (2012) Independent EEG Sources Are Dipolar. PLoS ONE, 7, e30135. https://doi.org/10.1371/journal.pone.0030135
Jawad Khan, M., Hong, M.J. and Hong, K.S. (2014) Decoding of Four Movement Directions Using Hybrid NIRS-EEG Brain-Computer Interface. Frontiers in Human Neuroscience, 8, Article 244. https://doi.org/10.3389/fnhum.2014.00244
Kakei, S., Hoffman, D.S. and Strick, P.L. (2003) Sensorimotor Transformations in Cortical Motor Areas. Neuroscience Research, 46, 1-10. https://doi.org/10.1016/S0168-0102(03)00031-2
Yoshimura, N., Tsuda, H., Kawase, T., Kambara, H. and Koike, Y. (2017) Decoding Finger Movement in Humans Using Synergy of EEG Cortical Current Signals. Scientific Reports, 7, Article No. 11382. https://doi.org/10.1038/s41598-017-09770-5
Palmer, J., Kreutz-Delgado, K. and Makeig, S. (2011) AMICA: An Adaptive Mixture of Independent Component Analyzers with Shared Components. Tech. Report, Swartz Center for Computational Neuroscience, San Diego, 1-15. http://dsp.ucsd.edu/~kreutz/Publications/palmer2011AMICA.pdf
Onton, J. and Makeig, S. (2006) Information-Based Modeling of Event-Related Brain Dynamics. Progress in Brain Research, 159, 99-120. https://doi.org/10.1016/S0079-6123(06)59007-7
Pion-Tonachini, L., Kreutz-Delgado, K. and Makeig, S. (2019) ICLabel: An Automated Electroencephalographic Independent Component Classifier, Dataset, and Website. Neuroimage, 198, 181-197. https://doi.org/10.1016/j.neuroimage.2019.05.026
Winkler, I., Haufe, S. and Tangermann, M. (2011) Automatic Classification of Artifactual ICA-Components for Artifact Removal in EEG Signals. Behavioral and Brain Functions, 7, 30. https://doi.org/10.1186/1744-9081-7-30
Miyakoshi, M., Kanayama, N., Iidaka, T. and Ohira, H. (2010) EEG Evidence of Face-Specific Visual Self-Representation. Neuroimage, 50, 1666-1675. https://doi.org/10.1016/j.neuroimage.2010.01.030
Yamashita, O., Sato, M., Yoshioka, T., Tong, F. and Kamitani, Y. (2008) Sparse Estimation Automatically Selects Voxels Relevant for the Decoding of fMRI Activity Patterns. Neuroimage, 42, 1414-1429. https://doi.org/10.1016/j.neuroimage.2008.05.050
Sivagnanam, S., et al. (2013) Introducing the Neuroscience Gateway. CEUR Workshop Proceedings, Zurich, Switzerland, 3-5 June 2013, 993. http://ceur-ws.org/Vol-993/paper10.pdf.
Yoshimura, N., et al. (2014) Dissociable Neural Representations of Wrist Motor Coordinate Frames in Human Motor Cortices. Neuroimage, 97, 53-61. https://doi.org/10.1016/j.neuroimage.2014.04.046
Rolls, E.T., Huang, C.C., Lin, C.P., Feng, J. and Joliot, M. (2020) Automated Anatomical Labelling Atlas 3. Neuroimage, 206, Article ID: 116189. https://doi.org/10.1016/j.neuroimage.2019.116189
Mennes, M., Wouters, H., Vanrumste, B., Lagae, L. and Stiers, P. (2010) Validation of ICA as a Tool to Remove Eye Movement Artifacts from EEG/ERP. Psychophysiology, 47, 1142-1150. https://doi.org/10.1111/j.1469-8986.2010.01015.x
Waberski, T.D., Gobbelé, R., Lamberty, K., Buchner, H., Marshall, J.C. and Fink, G.R. (2008) Timing of Visuo-Spatial Information Processing: Electrical Source Imaging Related to Line Bisection Judgements. Neuropsychologia, 46, 1201-1210. https://doi.org/10.1016/j.neuropsychologia.2007.10.024
Fortin, A., Ptito, A., Faubert, J. and Ptito, M. (2002) Cortical Areas Mediating Stereopsis in the Human Brain: A PET Study. Neuroreport, 13, 895-898. https://doi.org/10.1097/00001756-200205070-00032
Mechelh, A., Humphreys, G.W., Mayall, K., Olson, A. and Price, C.J. (2000) Differential Effects of Word Length and Visual Contrast in the Fusiform and Lingual Gyri during Reading. Proceedings of the Royal Society B: Biological Sciences, 267, 1909-1913. https://doi.org/10.1098/rspb.2000.1229
Shetht, B.R. and Young, R. (2016) Two Visual Pathways in Primates Based on Sampling of Space: Exploitation and Exploration of Visual Information. Frontiers in Integrative Neuroscience, 10, 37. https://doi.org/10.3389/fnint.2016.00037
Stark, A. and Zohary, E. (2008) Parietal Mapping of Visuomotor Transformations during Human Tool Grasping. Cerebral Cortex, 18, 2358-2368. https://doi.org/10.1093/cercor/bhm260
Wenderoth, N., Debaere, F., Sunaert, S. and Swinnen, S.P. (2005) The Role of Anterior Cingulate Cortex and Precuneus in the Coordination of Motor Behaviour. European Journal of Neuroscience, 22, 235-246. https://doi.org/10.1111/j.1460-9568.2005.04176.x
Schubert, T., von Cramon, D.Y., Niendorf, T., Pollmann, S. and Bublak, P. (1998) Cortical Areas and the Control of Self-Determined Finger Movements: An fMRI Study. Neuroreport, 9, 3171-3176. https://doi.org/10.1097/00001756-199810050-00009
Bubb, E.J., Metzler-Baddeley, C. and Aggleton, J.P. (2018) The Cingulum Bundle: Anatomy, Function, and Dysfunction. Neuroscience & Biobehavioral Reviews, 92, 104-127. https://doi.org/10.1016/j.neubiorev.2018.05.008
Sturm, W., et al. (2006) Spatial Attention: More than Intrinsic Alerting? Experimental Brain Research, 171, 16-25. https://doi.org/10.1007/s00221-005-0253-1
Weilke, F., et al. (2001) Time-Resolved fMRI of Activation Patterns in M1 and SMA during Complex Voluntary Movement. Journal of Neurophysiology, 85, 1858-1863. https://doi.org/10.1152/jn.2001.85.5.1858
Nguyen, V.T., Breakspear, M. and Cunnington, R. (2014) Reciprocal Interactions of the SMA and Cingulate Cortex Sustain Premovement Activity for Voluntary Actions. Journal of Neuroscience, 34, 16397-16407. https://doi.org/10.1523/JNEUROSCI.2571-14.2014
Carey, L.M., Abbott, D.F., Egan, G.F. and Donnan, G.A. (2008) Reproducible Activation in BA2, 1 and 3b Associated with Texture Discrimination in Healthy Volunteers over Time. Neuroimage, 39, 40-51. https://doi.org/10.1016/j.neuroimage.2007.08.026
Toxopeus, C.M., de Jong, B.M., Valsan, G., Conway, B.A., Leenders, K.L. and Maurits, N.M. (2011) Direction of Movement Is Encoded in the Human Primary Motor Cortex. PLoS ONE, 6, e27838. https://doi.org/10.1371/journal.pone.0027838
Kakei, S., Hoffman, D.S. and Strick, P.L. (1999) Muscle and Movement Representations in the Primary Motor Cortex. Science, 285, 2136-2139. https://doi.org/10.1126/science.285.5436.2136
Cheney, P.D., Fetz, E.E. and Palmer, S.S. (1985) Patterns of Facilitation and Suppression of Antagonist Forelimb Muscles from Motor Cortex Sites in the Awake Monkey. Journal of Neurophysiology, 53, 805-820. https://doi.org/10.1152/jn.1985.53.3.805
Vermetten, E., Charney, D.S. and Bremner, J.D. (2002) Anxiety. In: Encyclopedia of the Human Brain, Vol. 1, Elsevier, Amsterdam, 159-180. https://doi.org/10.1016/B0-12-227210-2/00028-5
Nunez, P.L. and Srinivasan, R. (2009) Electric Fields of the Brain: The Neurophysics of EEG. https://www.doi.org/10.1093/acprof:oso/9780195050387.001.0001