We use cookies.
By using the site, you agree to our Privacy Policy.

Contract number
14.641.31.0003
075-15-2021-624
Time span of the project
2018-2022

As of 01.11.2022

17
Number of staff members
25
scientific publications
8
Objects of intellectual property
General information

Name of the project: Bidirectional electrocorticographic brain-computer interfaces for control, stimulation and communications


Goals and objectives

Research directions: Bidirectional brain-computer communications with somatosensor feedback using electrostimmulation or sensory substitution, creation of neurointerfaces and biological prosthetics.

Project objective: Development of an information technology of bidirectional communications with the human brain electrocorticographic interface in combination with modern methods of processing of multi-dimensional data ans somatosensory feedback by stimulation or sensory replacement.

The practical value of the study

Scientific results:

  1. The Laboratory has designed a bidirectional sensorimotor neural interface that combines decoding of the activity of the motor cortex into the kinematics of motion of a virtual palm with stimulation of the sensory cortex that provide tactile sensitivity to the virtual palm. To decode the electrocorticographic activity, we created a new compact convolutional neural network, whose parameters account for the mechanisms of emergence and registration of ECoG signals, which ensures the interpretability of the produced decision rule. Feedback from the virtual prosthesis was transmitted via direct electric stimulation of the  zone of representation of the index finger in the sensory cortex discovered using the meteorology of solving the inverse problem of magnetoencephalography.
  2. We have formulated requirements for describing experiments in the paradigm of neurofeedback and found that reducing the delay leads to an increase in the speed of training and longer preservation of the effect of training in this paradigm, which explicitly implements the principle of bidirectionality during interaction with the brain. A low-latency neurofeedback technology has been proposed and patented.
  3. Our researchers have designed a new biomimetic algorithm for the automated detection of interictal activity in patients suffering with epilepsy (Kleeva et al., 2022),. It is applicable both to EEG and to MEG data.  In close cooperation with clinical partners we have developed a technology for passive speech cortex mapping that allows to minimize the possibility of seizures in such patients during surgical intervention. While analyzing the results of mapping of ten patients with the use of the developed real-time software, we found a high degree of concordance of the results of passive and stimulus-driven mapping, which is currently the gold standard. As a natural continuation of this project, we have developed a methodology for decoding speech from stereo-EEG data and demonstrated it on two patients.  
  4. The Laboratory has conducted a preliminary MEG research that demonstrate the dynamic nature of viscero-cortical interaction.  Using multimodal registration of parameters of the activity of the central and autonomic nervous system, we found two various strategies of meditation in experienced meditators.
  5. In September 2022, the commercial enterprise «BraInstaRT» LLC was created following the results of the START competition of the Foundation for Assistance to Small Innovative Enterprises in Science and Technology. The objective of the project: «Development of software implementing the principle of instant neurofeedback relying on fast mathematical methods of evaluation of the parameters of rhythmic brain activity». The principle relies on the developments of the center in low-latency  neurofeedback (patent No. 207767) and Patent for a useful model No. 207767 U1. Application No. 2021125071. Date of inscription into the Registry of useful models of the Russian Federation  on 15 November 2021.      

Implemented results of research:

  • A system for the control and sensitization of bionic prosthesis. Bidirectional neural interfaces and algorithms for decoding the activity of the brain that are able to preserve working capacity while simultaneously maintaining physical simulation. We developed algorithmic foundations for building bidirectional motor invasive neural interfaces. We demonstrated the possibility of decoding the kinematics of a limb against the background of electrical stimulation used for prosthesis sensitization. Such prostheses with tactile feedback, which implement a bidirectional neural interface and an information exchange channel, qualitatively increase the efficiency of the solution, increase the feeling of agency and significantly accelerate the process of learning to use the prosthesis. At the core of the decoding algorithm lies a compact, physiologically determined neural network, which ensures a high generalization capability and warrant interpretability of the decision rule  in the process of training over a small training data set.
  • The developed solutions have been tested in a virtual environment on a model problem of collecting fragile objects. The closure of the tactile feedback loop provides twice more successful completion of the task of capturing and gathering fragile Christmas balls (a variation of the egg task), as well as significantly reduced the time of its completion and increased the sense of naturalness.
  • A software and hardware complex, algorithms and experimental paradigms for passive speech mapping.
    A system has been designed for passive intraoperative mapping of speech zones of the cerebral cortex. Unlike existing counterparts, our systems allows to halve the time necessary for the procedure. Instead of electric stimulation, our methodology implies the registration of activity of the cerebral cortex using a grid of ECoG  electrodes while the awakened patient performs a speech task. The absence of stimulation minimizes the possibility of an intraoperative seizure. Specially designed software is compatible with a wide range of electroencephalographs and performs the presentation of images, registration of synchronized multi-channel ECoG and speech audio signal, computation of the parameters of the statistical correlation between the parameters of the speech signal and the brain activity registered by each of the sensors. Information on the degree of the relationship is displayed in real time in the form of statistical maps illustrating the accumulated degree of relationship between signals from individual sensors and the speech signal. Therefore an intraoperative monitoring doctor can now dynamically track the variability of the indicators of the functional significance of the cerebral cortex and stop the procedure as a necessary degree of confidence is accumulated.
  • Unlike the only other system present at the market, our approach does not require brain electric activity data at rest, which allowed to achieve at least a halving of the duration of intraoperative mapping of  the irreparable speech cortex.
  • ELOQ, a cross-platform application for Android and iOS. An application for intraoperative and extraoperative demonstration of stimulus material (images) with individual settings. The program allows to exclude images that the patient cannot name or names with errors during the initial demonstration of the universal set of images. For repeated research, the edited set of images is presented in a random order. Does not store personal data. Allows to map speech zones, standardize the use of neurolinguistic  methodologies, compile individual treatment and neurorehabilitation plans. Intended for neurophysiologists.
  • «BraInstaRT» LLC, created in September 2022 as a result of the START competition of the Foundation for Assistance to Small Innovative Enterprises in Science and Technology. The objective of the project is «Development of software implementing the principle of instant neurofeedback (iNeurofeedback) relying on fast mathematical methods of the assessment of the parameters of rhythmic brain activity». 

Education and retraining of personnel:

  • Employees of the center have developed a number of education programs that were implemented at HSE University in 2018–2022.
  • Internships at the Center for Bioelectric Interfaces of HSE University: 2.

Organizational and structural changes:

The Laboratory of Invasive Interfaces as a structural division of the Center of Bioelectric Interfaces of HSE University has performed the following works since 2018 at the A. I. Yevdokimov Moscow State University of Medicine and Dentistry of the Ministry of Health of the Russian Federation.

  • The work of the Laboratory is aimed at obtaining experimental data on the localization of speech and functional zones of the cerebral cortex, testing and implementing methods for ECoG data analysis to localize  the irreparable speech cortex.

In 2022, the Laboratory of Medical neural interfaces and Artificial Intelligence started collaborating with the Artificial Intelligence Research Institute – AIRI (airi.net) and the Federal Center for Brain and Neurotechnology of the Federal Medical-Biological Agency on the following topics.

  • Testing of methods of passive speech mapping, developing minimally invasive systems for speech prosthesis; technologies of minimally invasive neurofeedback, methods of non-invasive diagnostics of patients; post-stroke rehabilitation, conducting pilot research to create new non-invasive neuroimaging technologies.

In collaboration with the Institute for Cognitive Neuroscience of HSE University, the Center for Bioelectric Interfaces participates in the creation of the Unique Scientific Facility «Implementation of measures and completing work to enhance the Automated system for non-invasive stimulation of the brain with the capability of synchronous registration of biocurrents of the brain and eye movement tracking, to ensure the comprehensive development of the research infrastructure, increase the level of its accessibility and improve the efficiency of its use». As part of the program for the development of the material and technological infrastructure «Development of infrastructure for research activities (centers for the collective use of unique scientific facilities)» of the state program «Scientific and technological development of the Russian Federation». 

Collaborations:

Over the course of its existence, the Center for Bioelectric Interfaces has built stable partnerships with leading Russian and foreign experts, research institutions budgetary and commercial organizations.

  • University of California, Los Angeles (USA), University of Melbourne (Australia),  Center for Neurocognitive Research (MEG–center) (Russia), Institute of Higher Nervous Activity and Neurophysiology of the Russian Academy of Sciences (Russia), N. N. Semenov Federal Research Center of Chemical Physics of the Russian Academy of Sciences (Russia), A. I. Yevdokimov Moscow State University of Medicine and Dentistry  (Russia), University of Hamburg (Germany).

Russian and foreign partners:

  • A. I. Yevdokimov Moscow State University of Medicine and Dentistry of the Ministry of Health of the Russian Federation: obtaining experimental data on the localization of speech and functional zones of the cerebral cortex, implementing the technology of passive speech mapping.
  • A. L. Polenov Russian Neurosurgical Research Institute (branch of the V. A. Almazov National Medical Research Center of the Ministry of Health of the Russian Federation: obtaining experimental data on the localization of speech and functional zones of the cerebral cortex, testing and implementation of methodologies for the analysis of ECoG  data to localize the irreparable cerebral cortex.
  • Federal Center for Brain and Neurotechnology of the Federal Medical-Biological Agency of Russia: testing of methods of passive speech mapping, development of minimally invasive systems for speech prosthetics; technologies for low-latency neurofeedback, methods of non-invasive diagnostics of patients; post-stroke rehabilitation, conducting pilot research to create new non-invasive neuroimaging technologist.
  • Moscow State University: academic experience exchange, research and practice consulting.
  • Samara State Medical University of the Ministry of Health of the Russian Federation: 2020–2022 «Development of technologies for interactive monitoring and stimulation of the bioelectric activity of the cerebral cortex to solve problems of personalized selection of methods and means of motor rehabilitation accounting for objective control of individual features of cerebral cortex neuroplasticity». We have developed software and hardware complexes to conduct exploratory research of factor affecting restoration of motor function in post-stroke patients. The methods have been tested on several patients. Joint development of efficient neurorehabilitation approaches relying on individual features of the patient, their pathology.
  • Institute of Higher Nervous Activity and Neurophysiology of the Russian Academy of Sciences: exchange of research experience, research and practice consulting.
  • N. I. Lobachevkiy Nizhniy Novgorod State University: exchange of research experience , research and practice consulting.
  • N. N. Semenov Federal Research Center of Chemical Physics of the Russian Academy of Sciences: research and development. Extrasurgical registration of the subthalamic nucleus activity for the research of motion control in patients with the Parkinson’s disease.
  • Center for Neurocognitive Research (MEG–center), Moscow State University of Psychology and Education: magnetoencephalography research.
  • Artificial Intelligence Research Institute – AIRI: development of a software and hardware  complex for low-latency feedback relying on EEG.
  • «Huawei Technologies» LLC: development and implementation of a technology for speech recognition on the basis of brain activity data.
  • Education Support Foundation «NOOSFERA»: research of electrophysiological processes in children with special needs. Developing a system for stimulus presentation to modernize diagnostic processes, usage of EEG in the education process; Usage of neuroimaging as part of neuropsychological diagnostics; Usage of a non-invasive device for the neuroimaging of cognitive processes. Testing of intermediate and final results on the basis of the subordinate institution «Children’s development and socialization center «NEIROSFERA».
  • Lebedev Physical Institute of the Russian Academy of Sciences: creation of the detector for the magnetic encephalograph, information exchange, consulting, methodological support.
  • «Neuroassistive Technologies» LLC: consulting, methodological support.
  • «ExoAtlet» LLC: development and implementation of software, the locomotor function of the exoskeleton using an ideomotor brain–computer interface. Consulting, methodological support.
  • JSV «gtec», Germany: scientific consulting, methodological support, development of software and hardware complexes.
  • «Mitsar» LLC: development and implementation of a wireless technology for the implementation of a brain–computer interface. Scientific consulting.
  • «Medical computer systems» LLC: scientific consulting, creating modifications of devices for EEG registration.

Hide Show full
smetanin, n., volkova, k., zabodaev, s., lebedev, m. a., & ossadtchi, a.
NFBLab—A Versatile Software for Neurofeedback and Brain-Computer Interface Research // Frontiers in neuroinformatics, 2018. 12, 100. doi.org/10.3389/fninf.2018.00100 3.
volkova, k., lebedev, m. a., kaplan, a., & ossadtchi, a.
Decoding Movement From Electrocorticographic Activity: A Review // Frontiers in Neuroinformatics. 2019. 13. doi.org/10.3389/fninf.2019.00074
lebedev, m. a., ossadtchi, a., mill, n. a., urpí, n. a., cervera, m. r., & nicolelis, m. a.
Analysis of neuronal ensemble activity reveals the pitfalls and shortcomings of rotation dynamics // Scientific Reports, 2019. 9 (1), 1-14. doi.org/10.1038/s41598-019-54760-4
m. v. sinkin, a. e. osadchiy, m. a. lebedev, k. v. volkova, m. s. kondratova, i. s. trifonov, v. v. krylov
High resolution passive speech mapping in dominant hemisphere glioma surgery // Russian Journal of Neurosurgery 2019 n.3, v. 21, 12-18 doi.org/10.17650/1683-3295-2019-21-3-37-43
tomas ros, stefanie enriquez-geppert, vadim zotev, alexey ossadtchi, mikhail a. lebedev, et al.
Consensus on the reporting and experimental design of clinical and cognitive-behavioural neurofeedback studies // Brain 2020, Vol. 143. No. 3. P. 1-12 doi.org/10.1093/brain/awaa009
nikolai smetanin, anastasia belinskaya, mikhail lebedev and alexei ossadtchi
Digital filters for low-latency quantification of brain rhythms in real-time / Journal of Neural Engineering 2020, 29.07.20, 2. doi.org/10.1088/1741-2552/ab890f
anastasiia belinskaia, nikolai smetanin, mikhail lebedev and alexei ossadtchi
Short-delay neurofeedback facilitates training of the parietal alpha rhythm // Journal of Neural Engineering 2020, 16.12.20, doi.org/10.1088/1741-2552/abc8d7
aleksandra kuznetsova, yulia nurislamova, alexei ossadtchi
Modified covariance beamformer for solving MEG inverse problem in the environment with correlated sources // Neuroimage. 2021, 228, March. doi.org/10.1016/j.neuroimage.2020.117677
petrosyan, a., voskoboinikov, a., sukhinin, d., makarova, a., skalnaya, a., arkhipova, n., sinkin, m. & ossadtchi, a.
Speech decoding from a small set of spatially segregated minimally invasive intracranial EEG electrodes with a compact and interpretable neural network // Journal of Neural Engineering, 2022, In Press.
kleeva d., soghoyan g., komoltsev i., sinkin m., ossadtchi a.
Fast parametric curve matching (FPCM) for automatic spike detection // Journal of Neural Engineering. 2022. Vol. 19. No. 3. Article 036003. doi.org/10.1088/1741-2552/ac682a
патент 2 713 110 заявка: 2018141556, 27.11.2018 https://www1.fips.ru/registers-doc-view/fips_servlet?db=rupat&rn=7269&docnumber=2713110& typefile=html
Способ оценки различий мощности осцилляторных компонент сигналов электроэнцефалограммы в психофизиологических состояниях на основе квантильного анализа Сметанин Н. М. Осадчий А. Е., Волкова К. В., Булгакова В. О. Заграничнова Д. В.
патент 2 704 391 заявка 2018147064, 2018.12.27. https://yandex.ru/patents/doc/ru2704391c1_20191028
Способ управления атомарным магнитометрическим датчиком при работе в составе многоканальной диагностической системы Осадчий А.Е., Вершовский А.К.
номер регистрации (свидетельства): 2020610832 номер и дата поступления заявки: 2019667717 31.12.2019 https://www1.fips.ru/registers-doc-view/fips_servlet
Программный комплекс для проведения экспериментов в парадигме активного касания с тактильной и прямой кортикальной стимуляцией. Программа для электронно вычислительных машин (ПР) Осадчий А.Е., Булгакова В.О., Лебедев М.А., Володина М.А., Кондратова М.С., Воскобойников А.М.
номер регистрации (свидетельства): 2020611123 номер и дата поступления заявки: 2019667708 31.12.2019 https://www1.fips.ru/registers-doc-view/fips_servlet
Пассивное картирование речевой функции по электро- кортикографическим измерениям активности мозга. Программа для электронно-вычислительных машин (ПР) Осадчий А.Е., Булгакова В.О., Лебедев М.А., Володина М.А., Кондратова М.С., Волкова К.В.
заявка на изобретение: 2020 137 694, 17.11.2020 приоритет pct: ru.
Способ высокоточной реконструкции активности нейрональных источников коры головного мозга в условиях присутствия выраженной корреляции между источника Осадчий А.Е., Клеева Д.Ф., Кузнецова А.А., Нурисламова Ю.М.
патент на полезную модель № 207767 u1. заявка № 2021125071. дата государственной регистрации в государственном реестре полезных моделей рф 15.11.2021г.
Полезная модель Устройство низколатентной нейрообратной связи Осадчий А.Е., Белинская А.А., Сметанин Н.М., Аксиотис В.А., Тумялис А.В.
свидетельство о государственной регистрации программы для эвм № 2021680608. дата государственной регистрации в реестре программ для эвм 13.12.2021г.
Программа для ЭВМ. Экспресс расчет индекса попарной функциональной связности нейрональных источников по энцефалограмме. Осадчий А.Е.
программа для эвм заявка № 2022616920 от 14.04.2022
Приложение для создания индивидуального адаптированного теста с целью локализации речевой зоны коры головного мозга. Осадчий А.Е., Володина М.А., Лебедев М.А.
Other laboratories and scientists
Hosting organization
Field of studies
City
Invited researcher
Time span of the project
Laboratory «Hybrid modeling and optimization methods in complex systems»

Siberian federal University - (SibFU)

Computer and information sciences

Krasnoyarsk

Stanimirović Predrag Stefan

Serbia

2022-2024

Laboratory «Research of ultra-low-latency network technologies with ultra-high density based on the extensive use of artificial intelligence for 6G networks»

The Bonch-Bruevich Saint Petersburg State University of Telecommunications

Computer and information sciences

St. Petersburg

Abd El-Latif Ahmed Abdelrahim

Egypt

2022-2024

Laboratory for Non-linear and Microwave Photonics

Ulyanovsk State University - (USU)

Computer and information sciences

Ulyanovsk

Taylor James Roy

United Kingdom, Ireland

2021-2023