Article

Phoneme-Lattice to Phoneme-Sequence Matching Algorithm Based on Dynamic Programming

Authors:

Xavier Anguera,

Ittai ArtziAuthors Info & Claims

IberSPEECH 2014: Proceedings of the Second International Conference on Advances in Speech and Language Technologies for Iberian Languages - Volume 8854

Pages 99 - 108

https://doi.org/10.1007/978-3-319-13623-3_11

Published: 19 November 2014 Publication History

Abstract

A novel phoneme-lattice to phoneme-sequence matching algorithm based on dynamic programming is presented in this paper. Phoneme lattices have been shown to be a good choice to encode in a compact way alternative decoding hypotheses from a speech recognition system. These are typically used for the spoken term detection and keyword-spotting tasks, where a phoneme sequence query is matched to a reference lattice. Most current approaches suffer from a lack of flexibility whenever a match allowing phoneme insertions, deletions and substitutions is to be found. We introduce a matching approach based on dynamic programming, originally proposed for Minimum Bayes decoding on speech recognition systems. The original algorithm is extended in several ways. First, a self-trained phoneme confusion matrix for phoneme comparison is applied as phoneme penalties. Also, posterior probabilities are computed per arc, instead of likelihoods and an acoustic matching distance is combined with the edit distance at every arc. Finally, total matching scores are normalized based on the length of the optimum alignment path. The resulting algorithm is compared to a state-of-the-art phoneme-lattice-to-string matching algorithm showing relative precision improvements over 20% relative on an isolated word retrieval task.

References

[1]

Szöke, I., Schwarz, P., Matjka, P., Karafit, M.: Comparison of keyword spotting approaches for informal continuous speech. In: Proceedings Eurospeech 2005

[2]

Young, S.J., Brown, M., Foote, J.T., Jones, G.J., Sparck Jones, K.: Acoustic indexing for multimedia retrieval and browsing. In: IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 1997, vol. 1, pp. 199---202. IEEE 1997

Digital Library

[3]

Nambiar, U., Faruquie, T., Subramaniam, L.V., Negi, S., Ramakrishnan, G.: Discovering customer intent in real-time for streamlining service desk conversations. In: Proceedings of the 20th ACM International Conference on Information and Knowledge Management, CIKM 2011, pp. 1383---1388. ACM, New York 2011, http://doi.acm.org/10.1145/2063576.2063776

Digital Library

[4]

Chelba, C., Acero, A.: Position specific posterior lattices for indexing speech. In: Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics, ACL 2005, pp. 443---450. Association for Computational Linguistics, Stroudsburg 2005, http://dx.doi.org/10.3115/1219840.1219895

Digital Library

[5]

Foote, J.T., Faate, J.T., Brown, M., Jones, G., Young, S., Jones, K.S., Yaung, J.S.J.: Video mail retrieval by voice: Towards intelligent retrieval and browsing of multimedia documents 1995

[6]

Foote, J.T., Jones, G.J.F., Jones, K.S., Young, S.J.: Talker-independent keyword spotting for information retrieval 1995

[7]

James, D.A., Young, S.J.: A fast lattice-based approach to vocabulary independent wordspotting. In: IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 1994, vol. 1, pp. I---377. IEEE 1994

[8]

Wilpon, J., Rabiner, L., Lee, C.-H., Goldman, E.: Automatic recognition of keywords in unconstrained speech using hidden markov models. IEEE Transactions on Acoustics, Speech and Signal Processing 3811, 1870---1878 1990

[9]

Knill, K.M., Young, S.: Fast implementation methods for viterbi-based word-spotting. In: Proc. ICASSP, pp. 522---525 1996

Digital Library

[10]

Price, P., Fisher, W., Bernstein, J., Pallett, D.: The darpa 1000-word resource management database for continuous speech recognition. In: International Conference on Acoustics, Speech, and Signal Processing, ICASSP 1988, vol. 1, pp. 651---654 April 1988

[11]

Thambiratnam, K., Sridharan, S.: Dynamic match phone-lattice searches for very fast and accurate unrestricted vocabulary keyword spotting. In: Proc. ICASSP, vol. 5, pp. 465---468 2005

[12]

Young, S., Woodland, P.C., Byrne, W.J.: Htk version 3.4.1: User, reference and programmer manual September 1993

[13]

Audhkhasi, K., Verma, A.: Keyword search using modified minimum edit distance measure. In: IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2007, vol. 4, pp. IV---929---IV---932 April 2007

[14]

Wang, D.: Out of vocabulary spoken term detection. PhD thesis, Institute for Communicating and Collaborative Systems, School of Informatics, University of Edinburgh 2010

[15]

Xu, H., Povey, D., Mangu, L., Zhu, J.: Minimum bayes risk decoding and system combination based on a recursion for edit distance. Computer Speech and Language 254, 802---828 2011, http://www.sciencedirect.com/science/article/pii/S0885230811000192

Digital Library

[16]

Carlin, M.A., Thomas, S., Jansen, A., Hermansky, H.: Rapid evaluation of speech representations for spoken term discovery. In: INTERSPEECH, pp. 821---824 2011

[17]

Levenshtein, V.I.: Binary codes capable of correcting deletions, insertions and reversals. Soviet Physics Doklady 10, 707 1966

[18]

Povey, D., Ghoshal, A., Boulianne, G., Burget, L., Glembek, O., Goel, N., Hannemann, M., Motlicek, P., Qian, Y., Schwarz, P., Silovsky, J., Stemmer, G., Vesely, K.: The kaldi speech recognition toolkit. In: IEEE 2011 Workshop on Automatic Speech Recognition and Understanding, vol. 22, pp. 2---3. IEEE Signal Processing Society December 2011, iEEE Catalog No.: CFP11SRW-USB

Cited By

Tabibian SAkbari ANasersharif B(2019)Improved dynamic match phone lattice search for Persian spoken term detection system in online and offline applicationsInternational Journal of Speech Technology10.1007/s10772-019-09594-w22:1(205-217)Online publication date: 1-Mar-2019
https://dl.acm.org/doi/10.1007/s10772-019-09594-w

Recommendations

Automatic syllable-based phoneme recognition using ESTER corpus
ISCGAV'07: Proceedings of the 7th WSEAS International Conference on Signal Processing, Computational Geometry & Artificial Vision

This paper presents an evaluation of speaker-independent continuous phoneme recognition systems on the French speech database ESTER. The tested systems are syllable-based phoneme recognizers, i.e. they use syllables as basic units together with syllabic ...
Phoneme and tonal accent recognition for Thai speech
Highlights
► Phoneme recognition with soft phoneme segmentation procedure for Thai speech. ► Recognition system classifies phonemes using discrete hidden Markov models. ► MFPLP is better than MFCC as features in phoneme ...
Abstract
In this paper, we investigate the application of a phoneme recognition system with a soft phoneme segmentation procedure for Thai speech. In addition, we propose a new method to classify the tonal accent of a syllable. The recognition ...
Effect of aging on speech features and phoneme recognition: a study on Bengali voicing vowels

The article studies age related variations of speech characteristics of two age groups, in the Bengali language. The study considers 60 speakers in the each age groups, 60---80 years and 20---40 years, respectively. We have considered different voice ...

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings

IberSPEECH 2014: Proceedings of the Second International Conference on Advances in Speech and Language Technologies for Iberian Languages - Volume 8854

November 2014

288 pages

ISBN:9783319136226

Editors:
Juan Navarro Mesa
ETSIT, Las Palmas de Gran Canaria, Spain
,
Alfonso Ortega
University of Zaragoza, Spain
,
António Teixeira
Dep. of Electronics, Telecommunications and Informatics Engineering, University of Aveiro, Portugal
,
Eduardo Hernández Pérez
ETSIT, Las Palmas de Gran Canaria, Spain
,
Pedro Quintana Morales
ETSIT, Las Palmas de Gran Canaria, Spain
,
Antonio Ravelo García
ETSIT, Las Palmas de Gran Canaria, Spain
,
Iván Guerra Moreno
ETSIT, Las Palmas de Gran Canaria, Spain
,
Doroteo Toledano
ATVS Biometric Recognition Group,, Universidad Autónoma de Madrid, Spain

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 19 November 2014

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Tabibian SAkbari ANasersharif B(2019)Improved dynamic match phone lattice search for Persian spoken term detection system in online and offline applicationsInternational Journal of Speech Technology10.1007/s10772-019-09594-w22:1(205-217)Online publication date: 1-Mar-2019
https://dl.acm.org/doi/10.1007/s10772-019-09594-w

View Options

View options

Media

Figures

Other

Tables

View Table of Contents