New AI technique converts brain activity into words
Scientists have developed a groundbreaking technique called ‘mind captioning’. Using this method, they can convert brain activity into descriptive sentences, effectively making it possible to translate a person’s thoughts. This non-invasive method employs brain imaging and artificial intelligence (AI) to interpret what someone visualises with remarkable accuracy.
Researchers have long been able to predict what someone is seeing or hearing based on their brain activity. However, deciphering the brain’s interpretation of more complex content, such as videos or abstract shapes, has proven more difficult. Previous methods often captured only keywords, not the full context of a perception.
The new technique developed by Tomoyasu Horikawa and his team at NTT Communication Science Laboratories tackles this problem. First, they trained an AI model on the text captions of more than 2,000 videos, with each caption converted into a unique digital ‘meaning signature’. Next, a separate AI tool was trained to identify patterns of brain activity that corresponded to each meaning signature as participants watched the videos.
This brain decoder can now analyse new brain scans and predict the associated meaning signature. Finally, an AI text generator uses this signature to produce a sentence that closely matches the decoded meaning. Not only does this technique help us understand how the brain represents the world, but it also holds significant promise for helping people with communication challenges express themselves more effectively.
Business AM
Subscribers 0
Fans 0
Followers 0
Followers