Observatorio de I+D+i UPM

Memorias de investigación
Research Publications in journals:
Emotion transplantation through adaptation in HMM-based speech synthesis
Year:2015
Research Areas
  • Electronic technology and of the communications,
  • Electric engineers, electronic and automatic (eil)
Information
Abstract
2015AbstractThis paper proposes an emotion transplantation method capable of modifying a synthetic speech model through the use ofCSMAPLR adaptation in order to incorporate emotional information learned from a different speaker model while maintaining theidentity of the original speaker as much as possible. The proposed method relies on learning both emotional and speaker identityinformation by means of their adaptation function from an average voice model, and combining them into a single cascade transformcapable of imbuing the desired emotion into the target speaker. This method is then applied to the task of transplanting four emotions(anger, happiness, sadness and surprise) into 3 male speakers and 3 female speakers and evaluated in a number of perceptual tests.The results of the evaluations show how the perceived naturalness for emotional text significantly favors the use of the proposedtransplanted emotional speech synthesis when compared to traditional neutral speech synthesis, evidenced by a big increase inthe perceived emotional strength of the synthesized utterances at a slight cost in speech quality. A final evaluation with a roboticlaboratory assistant application shows how by using emotional speech we can significantly increase the students? satisfaction withthe dialog system, proving how the proposed emotion transplantation system provides benefits in real applications.© 2015 Elsevier Ltd. All rights reserved.
International
Si
JCR
Si
Title
Computer Speech And Language
ISBN
0885-2308
Impact factor JCR
1,753
Impact info
Volume
34
10.1016/j.csl.2015.03.008
Journal number
1
From page
292
To page
307
Month
SIN MES
Ranking
Journal Rank in Category 47/123
Participants
  • Autor: Jaime Lorenzo Trueba (UPM)
  • Autor: Roberto Barra Chicote (UPM)
  • Autor: Ruben San Segundo Hernandez (UPM)
  • Autor: Javier Ferreiros Lopez (UPM)
  • Autor: Junichi Yamagishi (CSTR, University of Edinburgh, Informatics Forum)
  • Autor: Juan Manuel Montero Martinez (UPM)
Research Group, Departaments and Institutes related
  • Creador: Grupo de Investigación: Grupo de Tecnología del Habla
S2i 2020 Observatorio de investigación @ UPM con la colaboración del Consejo Social UPM
Cofinanciación del MINECO en el marco del Programa INNCIDE 2011 (OTR-2011-0236)
Cofinanciación del MINECO en el marco del Programa INNPACTO (IPT-020000-2010-22)