Observatorio de I+D+i UPM

Memorias de investigación
Communications at congresses:
Language Identification based on n-gram Frequency Ranking
Year:2007
Research Areas
  • Artificial intelligence,
  • Electronics engineering
Information
Abstract
We present a novel approach for language identification based on a text categorization technique, namely an n-gram frequency ranking. We use a Parallel phone recognizer, the same as in PPRLM, but instead of the language model, we create a ranking with the most frequent n-grams, keeping only a fraction of them. Then we compute the distance between the input sentence ranking and each language ranking, based on the difference in relative positions for each n-gram. The objective of this ranking is to be able to model reliably a longer span than PPRLM, namely 5-gram instead of trigram, because this ranking will need less training data for a reliable estimation. We demonstrate that this approach overcomes PPRLM (6% relative improvement) due to the inclusion of 4- gram and 5-gram in the classifier. We present two alternatives: ranking with absolute values for the number of occurrences and ranking with discriminative values (11% relative improvement).
International
Si
Congress
8th Annual Conference of the Internacional Speech Communication Association (Interspeech 2007)
960
Place
Antwerp, Belgium
Reviewers
Si
ISBN/ISSN
ISSN 1990-9772
Start Date
27/08/2007
End Date
31/08/2007
From page
To page
Participants
  • Autor: Luis Fernando D'Haro Enriquez (UPM)
  • Autor: Fernando Fernandez Martinez (UPM)
  • Autor: Javier Ferreiros Lopez (UPM)
  • Autor: Javier Macias Guarasa (UPM)
  • Autor: Ricardo de Cordoba Herralde (UPM)
Research Group, Departaments and Institutes related
  • Creador: Grupo de Investigación: Grupo de tecnología del habla
  • Departamento: Ingeniería Electrónica
S2i 2020 Observatorio de investigación @ UPM con la colaboración del Consejo Social UPM
Cofinanciación del MINECO en el marco del Programa INNCIDE 2011 (OTR-2011-0236)
Cofinanciación del MINECO en el marco del Programa INNPACTO (IPT-020000-2010-22)