Observatorio de I+D+i UPM

Memorias de investigación
Research Publications in journals:
Spoken Spanish Generation from Sign Language
Year:2010
Research Areas
  • Electronic technology and of the communications,
  • Electric engineers, electronic and automatic (eil)
Information
Abstract
This paper describes the development of a Spoken Spanish generator from sign-writing. The sign language considered was the Spanish sign language (LSE: Lengua de Signos Española). This system consists of an advanced visual interface (where a deaf person can specify a sequence of signs in signwriting), a language translator (for generating the sequence of words in Spanish), and finally, a text to speech converter. The visual interface allows a sign sequence to be defined using several sign-writing alternatives. The paper details the process for designing the visual interface proposing solutions for HCI-specific challenges when working with the Deaf (i.e. important difficulties in writing Spanish or limited sign coverage for describing abstract or conceptual ideas). Three strategies were developed and combined for language translation to implement the final version of the language translator module. The summative evaluation, carried out with Deaf from Madrid and Toledo, includes objective measurements from the system and subjective information from questionnaires. The paper also describes the first Spanish-LSE parallel corpus for language processing research focused on specific domains. This corpus includes more than 4000 Spanish sentences translated into LSE. These sentences focused on two restricted domains: the renewal of the identity document and driver¿s license. This corpus also contains all sign descriptions in several sign-writing specifications generated with a new version of the eSign Editor. This new version includes a grapheme to phoneme system for Spanish and a SEA-HamNoSys converter.
International
Si
JCR
Si
Title
INTERACTING WITH COMPUTERS
ISBN
0953-5438
Impact factor JCR
1,698
Impact info
Volume
22
10.1016/j.intcom.2009.11.011
Journal number
2
From page
123
To page
139
Month
MARZO
Ranking
Participants
  • Autor: Ruben San Segundo Hernandez (UPM)
  • Participante: D. Sánchez (Fundación CNSE, Confederación Estatal de Personas Sordas, Spain)
  • Autor: Jose Manuel Pardo Muñoz (UPM)
  • Participante: A. GARCIA (Fundación CNSE, Confederación Estatal de Personas Sordas, Spain)
  • Autor: Javier Ferreiros Lopez (UPM)
  • Participante: VALENTIN SAMA ROJO (Departamento de Ingeniería Electrónica, ETSI Telecomunicación, Universidad Politécnica de Madrid, Madrid, Spain)
  • Autor: Roberto Barra Chicote (UPM)
  • Autor: Juan Manuel Lucas Cuesta (UPM)
Research Group, Departaments and Institutes related
  • Creador: Grupo de Investigación: Grupo de Tecnología del Habla
  • Departamento: Ingeniería Electrónica
S2i 2020 Observatorio de investigación @ UPM con la colaboración del Consejo Social UPM
Cofinanciación del MINECO en el marco del Programa INNCIDE 2011 (OTR-2011-0236)
Cofinanciación del MINECO en el marco del Programa INNPACTO (IPT-020000-2010-22)