KIT‘s Tanja Schultz has reconstructed spoken sentences from brain activity patterns.
Speech is produced in the cerebral cortex. Associated brain waves can be recorded with surface electrodes. Schultz reconstructed basic units, words, and complete sentences from brain waves, and generated corresponding text.
This was achieved by a combination of advanced signal processing and automatic speech recognition. Speech was continuously decoded and transformed into a textual representation. Cortical information was combined with linguistic knowledge and machine learning algorithms to extract the most likely word sequence. Brain-to-Text is currently based on audible speech. The goal is to be able to recognize speech from thought alone.
WEARABLE TECH + DIGITAL HEALTH NYC 2015 – JUNE 30 @ NEW YORK ACADEMY OF SCIENCES. REGISTER HERE.