Brain computer interface enables real-time mental speaking

 Apr 17, 2025

 Leave a message

 

A study published on the 31st in the journal Nature Neuroscience in the UK reported a new brain computer interface technology that can convert speech activity in the brain into audible vocabulary in real time, allowing real-time thoughts to "speak". This technology can help individuals with aphasia regain their ability to communicate fluently in real-time.

The current speech oriented brain computer interfaces generally experience a delay of several seconds between an individual's silent attempt to speak and the computer's audible output, making it difficult to achieve smooth and clear communication. This can cause communication barriers and difficulties between the listener and the speaker.

Researchers from the University of California, San Francisco and UC Berkeley have developed a silent brain computer interface and implanted it into the brain of a 47 year old woman with quadriplegia (paralysis of limbs and trunk) who has been unable to speak or produce sound for 18 years after a stroke.

The researchers asked her to speak complete sentences containing 1024 unique words with her mind in her brain, and trained a deep learning neural network with her brain activity, which was recorded using electrodes implanted in the patient's speech sensory motor cortex.

Subsequently, the researchers used the model to decode online speech at an increasing rate of 80 milliseconds, synchronized with the subject's vocal intention, and then used the model trained on the subject's pre injury speech segments to generate audio that simulated her voice. This brain computer interface can also be extended to vocabulary that the subject has not been exposed to during training, and researchers have found that the device can operate smoothly and continuously.

Researchers say that although further research is still needed on more subjects, the device is expected to enable aphasia patients to speak more naturally and fluently in real-time, which can improve their quality of life.

Previously, we have also reported on multiple brain computer interface technologies that convert human brain activity into language. These technologies allow people trapped within language walls to regain their dignity and have the possibility of real-time communication and interaction. This time, scientists have invented a "mind translator" that allows subjects who have lost their language ability to speak - the device reads their consciousness and translates it into understandable language, and the decoding time can be synchronized with the subject's vocal intention. By simulating the patient's previous voice, the machine can also reproduce her tone. The use of brainwave communication has become a reality, and in the future, it may help more language barrier patients rebuild natural dialogue.

Send Inquiry
Send Inquiry
Hangzhou Demo Medical Technology Co., Ltd is a professional medical products designer, manufacturer and exporter in China.