Observatorio de I+D+i UPM

Memorias de investigación
Research Publications in journals:
LSESpeak: A spoken language generator for Deaf people
Year:2013
Research Areas
  • Electronic technology and of the communications,
  • Electric engineers, electronic and automatic (eil)
Information
Abstract
This paper describes the development of LSESpeak, a spoken Spanish generator for Deaf people. This system integrates two main tools: a sign language into speech translation system and an SMS (Short Message Service) into speech translation system. The first tool is made up of three modules: an advanced visual interface (where a deaf person can specify a sequence of signs), a language translator (for generating the sequence of words in Spanish), and finally, an emotional text to speech (TTS) converter to generate spoken Spanish. The visual interface allows a sign sequence to be defined using several utilities. The emotional TTS converter is based on Hidden Semi-Markov Models (HSMMs) permitting voice gender, type of emotion, and emotional strength to be controlled. The second tool is made up of an SMS message editor, a language translator and the same emotional text to speech converter. Both translation tools use a phrase-based translation strategy where translation and target language models are trained from parallel corpora. In the experiments carried out to evaluate the translation performance, the sign languagespeech translation system reported a 96.45 BLEU and the SMS-speech system a 44.36 BLEU in a specific domain: the renewal of the Identity Document and Driving License. In the evaluation of the emotional TTS, it is important to highlight the improvement in the naturalness thanks to the morpho-syntactic features, and the high flexibility provided by HSMMs when generating different emotional strengths.
International
Si
JCR
Si
Title
EXPERT SYSTEMS WITH APPLICATIONS
ISBN
0957-4174
Impact factor JCR
2,203
Impact info
Volume
40
10.1016/j.eswa.2012.08.062
Journal number
40
From page
1283
To page
1295
Month
SIN MES
Ranking
13/78
Participants
  • Autor: Veronica Lopez Ludeña (UPM)
  • Autor: Roberto Barra Chicote (UPM)
  • Autor: Syaheerah Binti Lebai Lutfi (UPM)
  • Autor: Juan Manuel Montero Martinez (UPM)
  • Autor: Ruben San Segundo Hernandez (UPM)
Research Group, Departaments and Institutes related
  • Creador: Grupo de Investigación: Grupo de Tecnología del Habla
  • Departamento: Ingeniería Electrónica
S2i 2020 Observatorio de investigación @ UPM con la colaboración del Consejo Social UPM
Cofinanciación del MINECO en el marco del Programa INNCIDE 2011 (OTR-2011-0236)
Cofinanciación del MINECO en el marco del Programa INNPACTO (IPT-020000-2010-22)