A Wireless Brain-Machine Interface for Real-Time Speech Synthesis

DSpace/Manakin Repository

A Wireless Brain-Machine Interface for Real-Time Speech Synthesis

Show simple item record

dc.contributor.author Brumberg, Jonathan S.
dc.contributor.author Nieto-Castanon, Alfonso
dc.contributor.author Tourville, Jason A.
dc.contributor.author Panko, Mikhail
dc.contributor.author Law, Robert
dc.contributor.author Siebert, Steven A.
dc.contributor.author Bartels, Jess L.
dc.contributor.author Andreasen, Dinal S.
dc.contributor.author Ehirim, Princewill
dc.contributor.author Kennedy, Philip R.
dc.contributor.author Guenther, Frank H.
dc.contributor.author Wright, E. Joseph
dc.contributor.author Mao, Hui
dc.date.accessioned 2011-02-24T20:54:54Z
dc.date.issued 2009
dc.identifier.citation Guenther, Frank H., Jonathan S. Brumberg, E. Joseph Wright, Alfonso Nieto-Castanon, Jason A. Tourville, Mikhail Panko, Robert Law, et al. 2009. A wireless brain-machine interface for real-time speech synthesis. PLoS ONE 4(12). en_US
dc.identifier.issn 1932-6203 en_US
dc.identifier.uri http://nrs.harvard.edu/urn-3:HUL.InstRepos:4731680
dc.description.abstract Background: Brain-machine interfaces (BMIs) involving electrodes implanted into the human cerebral cortex have recently been developed in an attempt to restore function to profoundly paralyzed individuals. Current BMIs for restoring communication can provide important capabilities via a typing process, but unfortunately they are only capable of slow communication rates. In the current study we use a novel approach to speech restoration in which we decode continuous auditory parameters for a real-time speech synthesizer from neuronal activity in motor cortex during attempted speech. Methodology/Principal Findings: Neural signals recorded by a Neurotrophic Electrode implanted in a speech-related region of the left precentral gyrus of a human volunteer suffering from locked-in syndrome, characterized by near-total paralysis with spared cognition, were transmitted wirelessly across the scalp and used to drive a speech synthesizer. A Kalman filter-based decoder translated the neural signals generated during attempted speech into continuous parameters for controlling a synthesizer that provided immediate (within 50 ms) auditory feedback of the decoded sound. Accuracy of the volunteer's vowel productions with the synthesizer improved quickly with practice, with a 25% improvement in average hit rate (from 45% to 70%) and 46% decrease in average endpoint error from the first to the last block of a three-vowel task. Conclusions/Significance: Our results support the feasibility of neural prostheses that may have the potential to provide near-conversational synthetic speech output for individuals with severely impaired speech motor control. They also provide an initial glimpse into the functional properties of neurons in speech motor cortical areas. en_US
dc.language.iso en_US en_US
dc.publisher Public Library of Science en_US
dc.relation.isversionof doi:10.1371/journal.pone.0008218 en_US
dc.relation.hasversion http://www.ncbi.nlm.nih.gov/pmc/articles/PMC2784218/pdf/ en_US
dash.license LAA
dc.subject neuroscience en_US
dc.subject motor systems en_US
dc.subject neurological disorders en_US
dc.subject movement disorder en_US
dc.title A Wireless Brain-Machine Interface for Real-Time Speech Synthesis en_US
dc.type Journal Article en_US
dc.description.version Version of Record en_US
dc.relation.journal PLoS ONE en_US
dash.depositing.author Guenther, Frank H.
dc.date.available 2011-02-24T20:54:54Z
dash.affiliation.other HMS^Health Sciences and Technology en_US

Files in this item

Files Size Format View
2784218.pdf 1.871Mb PDF View/Open

This item appears in the following Collection(s)

Show simple item record

 
 

Search DASH


Advanced Search
 
 

Submitters