search

UMD     This Site





Ganesh Sivaraman and Carol Espy-Wilson

Ganesh Sivaraman and Carol Espy-Wilson

 

A paper by Professor Carol Espy-Wilson (ECE/ISR) and her former student Ganesh Sivaraman (EE Ph.D. 2017), aims to improve speech inversion, the process of mapping acoustic signals into articulatory parameters. "Unsupervised speaker adaptation for speaker independent acoustic to articulatory speech inversion" has just been published in the Journal of the Acoustical Society of America (Vol.146, No.1).

Speech inversion is the process of mapping acoustic signals into articulatory parameters. Much work needs to be done in developing a robust speech inversion system, but if it could be made significantly more accurate, such a system could make a real impact on improving speech accent conversion, speech therapy, language learning, automatic speech recognition, and detection of depression from speech.

Differences among speakers typically makes speech inversion even harder. Normalizing these differences is essential to effectively using multi-speaker articulatory data for training a speaker-independent speech inversion system. It is essential to develop speech inversion systems that are speaker independent and can accurately estimate articulatory features for any speaker.

Espy-Wilson and Sivaraman aim to minimize speaker variability in the acoustic space attributed to vocal tract length differences between speakers for performing acoustic-to-articulatory inversion. Their goal is to normalize acoustic data from multiple speakers towards the acoustic space of a target speaker.

The researchers explored a vocal tract length normalization (VTLN) technique that could transform the acoustic features of different speakers to a target speaker acoustic space, minimizing speaker-specific details. The speaker-normalized features were then used to train a deep, feed-forward, neural-network-based speech inversion system.

The paper shows that data from multiple speakers can be normalized and combined to create better speaker-independent speech inversion systems. This approach can be extended to combine data from different articulatory datasets to create a single improved speech inversion system.

Sivaraman currently is a research scientist at Pindrop in Atlanta. Pindrop develops solutions for people and companies to authenticate each other via voice interactions, to increase security, identity, and trust for call centers and Internet of Things devices.



Related Articles:
Espy-Wilson is PI for NSF project to improve 'speech inversion' tool
New research uses reverberations for better automatic speech recognition
Espy-Wilson Honored at UMD’s First to ADVANCE Celebration
Espy-Wilson Delivers Keynote Address for Stanford’s WISE Inspirations Network
Espy-Wilson Featured in MIT’s Tech Review
Piya Pal delivers plenary talk at IEEE Underwater Acoustic Signal Processing Workshop
OmniSpeech to Demonstrate Technology at 2014 CES International

July 25, 2019


«Previous Story  

 

 

Current Headlines

Remembering Rance Cleaveland (1961-2024)

Dinesh Manocha Inducted into IEEE VGTC Virtual Reality Academy

ECE Ph.D. Student Ayooluwa (“Ayo”) Ajiboye Recognized at APEC 2024

Balachandran, Cameron, Yu Receive 2024 MURI Award

UMD, Booz Allen Hamilton Announce Collaboration with MMEC

New Research Suggests Gossip “Not Always a Bad Thing”

Ingestible Capsule Technology Research on Front Cover of Journal

Governor’s Cabinet Meeting Features Peek into Southern Maryland Research and Collaboration

Celebrating the Impact of Black Maryland Engineers and Leaders

Six Clark School Faculty Receive 2024 DURIP Awards

 
 
Back to top  
Home Clark School Home UMD Home