Centre for Bioelectric Interfaces

Scientific results:

1. The Laboratory has designed a bidirectional sensorimotor neural interface that combines decoding of the activity of the motor cortex into the kinematics of motion of a virtual palm with stimulation of the sensory cortex that provide tactile sensitivity to the virtual palm. To decode the electrocorticographic activity, we created a new compact convolutional neural network, whose parameters account for the mechanisms of emergence and registration of ECoG signals, which ensures the interpretability of the produced decision rule. Feedback from the virtual prosthesis was transmitted via direct electric stimulation of the  zone of representation of the index finger in the sensory cortex discovered using the meteorology of solving the inverse problem of magnetoencephalography.
2. We have formulated requirements for describing experiments in the paradigm of neurofeedback and found that reducing the delay leads to an increase in the speed of training and longer preservation of the effect of training in this paradigm, which explicitly implements the principle of bidirectionality during interaction with the brain. A low-latency neurofeedback technology has been proposed and patented.
3. Our researchers have designed a new biomimetic algorithm for the automated detection of interictal activity in patients suffering with epilepsy (Kleeva et al., 2022),. It is applicable both to EEG and to MEG data.  In close cooperation with clinical partners we have developed a technology for passive speech cortex mapping that allows to minimize the possibility of seizures in such patients during surgical intervention. While analyzing the results of mapping of ten patients with the use of the developed real-time software, we found a high degree of concordance of the results of passive and stimulus-driven mapping, which is currently the gold standard. As a natural continuation of this project, we have developed a methodology for decoding speech from stereo-EEG data and demonstrated it on two patients.  
4. The Laboratory has conducted a preliminary MEG research that demonstrate the dynamic nature of viscero-cortical interaction.  Using multimodal registration of parameters of the activity of the central and autonomic nervous system, we found two various strategies of meditation in experienced meditators.
5. In September 2022, the commercial enterprise «BraInstaRT» LLC was created following the results of the START competition of the Foundation for Assistance to Small Innovative Enterprises in Science and Technology. The objective of the project: «Development of software implementing the principle of instant neurofeedback relying on fast mathematical methods of evaluation of the parameters of rhythmic brain activity». The principle relies on the developments of the center in low-latency  neurofeedback (patent No. 207767) and Patent for a useful model No. 207767 U1. Application No. 2021125071. Date of inscription into the Registry of useful models of the Russian Federation  on 15 November 2021.      

Implemented results of research:

• A system for the control and sensitization of bionic prosthesis. Bidirectional neural interfaces and algorithms for decoding the activity of the brain that are able to preserve working capacity while simultaneously maintaining physical simulation. We developed algorithmic foundations for building bidirectional motor invasive neural interfaces. We demonstrated the possibility of decoding the kinematics of a limb against the background of electrical stimulation used for prosthesis sensitization. Such prostheses with tactile feedback, which implement a bidirectional neural interface and an information exchange channel, qualitatively increase the efficiency of the solution, increase the feeling of agency and significantly accelerate the process of learning to use the prosthesis. At the core of the decoding algorithm lies a compact, physiologically determined neural network, which ensures a high generalization capability and warrant interpretability of the decision rule  in the process of training over a small training data set.
• The developed solutions have been tested in a virtual environment on a model problem of collecting fragile objects. The closure of the tactile feedback loop provides twice more successful completion of the task of capturing and gathering fragile Christmas balls (a variation of the egg task), as well as significantly reduced the time of its completion and increased the sense of naturalness.
• A software and hardware complex, algorithms and experimental paradigms for passive speech mapping.
  A system has been designed for passive intraoperative mapping of speech zones of the cerebral cortex. Unlike existing counterparts, our systems allows to halve the time necessary for the procedure. Instead of electric stimulation, our methodology implies the registration of activity of the cerebral cortex using a grid of ECoG  electrodes while the awakened patient performs a speech task. The absence of stimulation minimizes the possibility of an intraoperative seizure. Specially designed software is compatible with a wide range of electroencephalographs and performs the presentation of images, registration of synchronized multi-channel ECoG and speech audio signal, computation of the parameters of the statistical correlation between the parameters of the speech signal and the brain activity registered by each of the sensors. Information on the degree of the relationship is displayed in real time in the form of statistical maps illustrating the accumulated degree of relationship between signals from individual sensors and the speech signal. Therefore an intraoperative monitoring doctor can now dynamically track the variability of the indicators of the functional significance of the cerebral cortex and stop the procedure as a necessary degree of confidence is accumulated.
• Unlike the only other system present at the market, our approach does not require brain electric activity data at rest, which allowed to achieve at least a halving of the duration of intraoperative mapping of  the irreparable speech cortex.
• ELOQ, a cross-platform application for Android and iOS. An application for intraoperative and extraoperative demonstration of stimulus material (images) with individual settings. The program allows to exclude images that the patient cannot name or names with errors during the initial demonstration of the universal set of images. For repeated research, the edited set of images is presented in a random order. Does not store personal data. Allows to map speech zones, standardize the use of neurolinguistic  methodologies, compile individual treatment and neurorehabilitation plans. Intended for neurophysiologists.
• «BraInstaRT» LLC, created in September 2022 as a result of the START competition of the Foundation for Assistance to Small Innovative Enterprises in Science and Technology. The objective of the project is «Development of software implementing the principle of instant neurofeedback (iNeurofeedback) relying on fast mathematical methods of the assessment of the parameters of rhythmic brain activity». 

Education and retraining of personnel:

• Employees of the center have developed a number of education programs that were implemented at HSE University in 2018–2022.
• Internships at the Center for Bioelectric Interfaces of HSE University: 2.

Organizational and structural changes:

The Laboratory of Invasive Interfaces as a structural division of the Center of Bioelectric Interfaces of HSE University has performed the following works since 2018 at the A. I. Yevdokimov Moscow State University of Medicine and Dentistry of the Ministry of Health of the Russian Federation.

• The work of the Laboratory is aimed at obtaining experimental data on the localization of speech and functional zones of the cerebral cortex, testing and implementing methods for ECoG data analysis to localize  the irreparable speech cortex.

In 2022, the Laboratory of Medical neural interfaces and Artificial Intelligence started collaborating with the Artificial Intelligence Research Institute – AIRI (airi.net) and the Federal Center for Brain and Neurotechnology of the Federal Medical-Biological Agency on the following topics.

• Testing of methods of passive speech mapping, developing minimally invasive systems for speech prosthesis; technologies of minimally invasive neurofeedback, methods of non-invasive diagnostics of patients; post-stroke rehabilitation, conducting pilot research to create new non-invasive neuroimaging technologies.

In collaboration with the Institute for Cognitive Neuroscience of HSE University, the Center for Bioelectric Interfaces participates in the creation of the Unique Scientific Facility «Implementation of measures and completing work to enhance the Automated system for non-invasive stimulation of the brain with the capability of synchronous registration of biocurrents of the brain and eye movement tracking, to ensure the comprehensive development of the research infrastructure, increase the level of its accessibility and improve the efficiency of its use». As part of the program for the development of the material and technological infrastructure «Development of infrastructure for research activities (centers for the collective use of unique scientific facilities)» of the state program «Scientific and technological development of the Russian Federation». 

Collaborations:

Over the course of its existence, the Center for Bioelectric Interfaces has built stable partnerships with leading Russian and foreign experts, research institutions budgetary and commercial organizations.

• University of California, Los Angeles (USA), University of Melbourne (Australia),  Center for Neurocognitive Research (MEG–center) (Russia), Institute of Higher Nervous Activity and Neurophysiology of the Russian Academy of Sciences (Russia), N. N. Semenov Federal Research Center of Chemical Physics of the Russian Academy of Sciences (Russia), A. I. Yevdokimov Moscow State University of Medicine and Dentistry  (Russia), University of Hamburg (Germany).

Russian and foreign partners:

• A. I. Yevdokimov Moscow State University of Medicine and Dentistry of the Ministry of Health of the Russian Federation: obtaining experimental data on the localization of speech and functional zones of the cerebral cortex, implementing the technology of passive speech mapping.
• A. L. Polenov Russian Neurosurgical Research Institute (branch of the V. A. Almazov National Medical Research Center of the Ministry of Health of the Russian Federation: obtaining experimental data on the localization of speech and functional zones of the cerebral cortex, testing and implementation of methodologies for the analysis of ECoG  data to localize the irreparable cerebral cortex.
• Federal Center for Brain and Neurotechnology of the Federal Medical-Biological Agency of Russia: testing of methods of passive speech mapping, development of minimally invasive systems for speech prosthetics; technologies for low-latency neurofeedback, methods of non-invasive diagnostics of patients; post-stroke rehabilitation, conducting pilot research to create new non-invasive neuroimaging technologist.
• Moscow State University: academic experience exchange, research and practice consulting.
• Samara State Medical University of the Ministry of Health of the Russian Federation: 2020–2022 «Development of technologies for interactive monitoring and stimulation of the bioelectric activity of the cerebral cortex to solve problems of personalized selection of methods and means of motor rehabilitation accounting for objective control of individual features of cerebral cortex neuroplasticity». We have developed software and hardware complexes to conduct exploratory research of factor affecting restoration of motor function in post-stroke patients. The methods have been tested on several patients. Joint development of efficient neurorehabilitation approaches relying on individual features of the patient, their pathology.
• Institute of Higher Nervous Activity and Neurophysiology of the Russian Academy of Sciences: exchange of research experience, research and practice consulting.
• N. I. Lobachevkiy Nizhniy Novgorod State University: exchange of research experience , research and practice consulting.
• N. N. Semenov Federal Research Center of Chemical Physics of the Russian Academy of Sciences: research and development. Extrasurgical registration of the subthalamic nucleus activity for the research of motion control in patients with the Parkinson’s disease.
• Center for Neurocognitive Research (MEG–center), Moscow State University of Psychology and Education: magnetoencephalography research.
• Artificial Intelligence Research Institute – AIRI: development of a software and hardware  complex for low-latency feedback relying on EEG.
• «Huawei Technologies» LLC: development and implementation of a technology for speech recognition on the basis of brain activity data.
• Education Support Foundation «NOOSFERA»: research of electrophysiological processes in children with special needs. Developing a system for stimulus presentation to modernize diagnostic processes, usage of EEG in the education process; Usage of neuroimaging as part of neuropsychological diagnostics; Usage of a non-invasive device for the neuroimaging of cognitive processes. Testing of intermediate and final results on the basis of the subordinate institution «Children’s development and socialization center «NEIROSFERA».
• Lebedev Physical Institute of the Russian Academy of Sciences: creation of the detector for the magnetic encephalograph, information exchange, consulting, methodological support.
• «Neuroassistive Technologies» LLC: consulting, methodological support.
• «ExoAtlet» LLC: development and implementation of software, the locomotor function of the exoskeleton using an ideomotor brain–computer interface. Consulting, methodological support.
• JSV «gtec», Germany: scientific consulting, methodological support, development of software and hardware complexes.
• «Mitsar» LLC: development and implementation of a wireless technology for the implementation of a brain–computer interface. Scientific consulting.
• «Medical computer systems» LLC: scientific consulting, creating modifications of devices for EEG registration.