Accent identification by combining deep neural networks and recurrent neural networks trained on long and short term features

Yishan Jiao, Ming Tu, Visar Berisha, Julie Liss

Research output: Contribution to journalArticle

12 Scopus citations

Abstract

Automatic identification of foreign accents is valuable for many speech systems, such as speech recognition, speaker identification, voice conversion, etc. The INTERSPEECH 2016 Native Language Sub-Challenge is to identify the native languages of non-native English speakers from eleven countries. Since differences in accent are due to both prosodic and articulation characteristics, a combination of long-term and short-term training is proposed in this paper. Each speech sample is processed into multiple speech segments with equal length. For each segment, deep neural networks (DNNs) are used to train on long-term statistical features, while recurrent neural networks (RNNs) are used to train on short-term acoustic features. The result for each speech sample is calculated by linearly fusing the results from the two sets of networks on all segments. The performance of the proposed system greatly surpasses the provided baseline system. Moreover, by fusing the results with the baseline system, the performance can be further improved.

Original languageEnglish (US)
Pages (from-to)2388-2392
Number of pages5
JournalUnknown Journal
Volume08-12-September-2016
DOIs
StatePublished - 2016

Keywords

  • Accent identification
  • Articulation
  • Deep neural networks
  • Prosody

ASJC Scopus subject areas

  • Language and Linguistics
  • Human-Computer Interaction
  • Signal Processing
  • Software
  • Modeling and Simulation

Fingerprint Dive into the research topics of 'Accent identification by combining deep neural networks and recurrent neural networks trained on long and short term features'. Together they form a unique fingerprint.

  • Cite this