Memorias de investigación
Capítulo de libro:
Towards Cross-lingual Emotion Transplantation
Año:2014

Áreas de investigación
  • Tecnología electrónica y de las comunicaciones,
  • Ingeniería eléctrica, electrónica y automática

Datos
Descripción
In this paper we introduce the idea of cross-lingual emotion transplantation. The aim is to lean the nuances of emotional speech in a source language for which we have enough data to adapt an acceptable quality emotional model by means of CSMAPLR adaptation, and then convert the adaptation function so it can be applied to a target language in a different target speaker while maintaining the speaker identity but adding emotional information. The conversion between languages is done at state level by measuring the KLD distance between the Gaussian distributions of all the states and linking the closest ones. Finally, as the cross-lingual transplantation of spectral emotions (mainly anger) was found out to introduce significant amounts of spectral noise, we show the results of applying three different techniques related to adaptation parameters that can be used to reduce the noise. The results are measured in an objective fashion by means of a bi-dimensional PCA projection of the KLD distances between the considered models (neutral models of both languages, reference emotion for both languages and transplanted emotional model for the target language).
Internacional
Si
DOI
Edición del Libro
Editorial del Libro
Springer
ISBN
978-3-319-13622-6
Serie
Título del Libro
Advances in Speech and Language Technologies for Iberian Languages Lecture Notes in Computer Science Volume 8854
Desde página
199
Hasta página
208

Esta actividad pertenece a memorias de investigación

Participantes
  • Autor: Jaime Lorenzo Trueba UPM
  • Autor: Roberto Barra Chicote UPM
  • Autor: Junichi Yamagishi National Institute of Informatics, Tokyo, Japan
  • Autor: Juan Manuel Montero Martinez UPM

Grupos de investigación, Departamentos, Centros e Institutos de I+D+i relacionados
  • Creador: Grupo de Investigación: Grupo de Tecnología del Habla
  • Departamento: Ingeniería Electrónica