research-article

Some Relations Among Stochastic Finite State Networks Used in Automatic Speech Recognition

Author:

F. CasacubertaAuthors Info & Claims

IEEE Transactions on Pattern Analysis and Machine Intelligence, Volume 12, Issue 7

Pages 691 - 695

https://doi.org/10.1109/34.56212

Published: 01 July 1990 Publication History

Abstract

In the literature on automatic speech recognition, the popular hidden Markov models (HMMs), left-to-right hidden Markov models (LRHMMs), Markov source models (MSMs), and stochastic regular grammars (SRGs) are often proposed as equivalent models. However, no formal relations seem to have been established among these models to date. A study of these relations within the framework of formal language theory is presented. The main conclusion is that not all of these models are equivalent, except certain types of hidden Markov models with observation probability distribution in the transitions, and stochastic regular grammar.

References

[1]

{1} L. Bahl, F. Jelinek, and R. Mercer, "A maximum likelihood approach to continuous speech recognition," IEEE Trans. Parrern Anal. Machine Intell., vol. PAMI-5, no. 2, pp. 179-190, 1983.

Digital Library

[2]

{2} F. Jelinek, "Continuous speech recognition by statistical methods," Proc. IEEE, vol. 64, no. 4, pp. 532-556, 1976.

[3]

{3} L. Rabiner and B. Juang, "Introduction to hidden Markov models," IEEE ASSP Mag., pp. 4-16, Jan. 1986.

[4]

{4} J. Baker, "The Dragon system-An overview," IEEE Trans. Acoust., Speech, Signal Processing, vol. ASSP-23, no. 1, pp. 24-29, 1975.

[5]

{5} L. Rabiner, S. Levinson, and M. Sondhi, "On the application of vector quantification and HMM's to speaker independent, isolated word recognition," Bell Syst. Tech. J., vol. 62, no. 4, pp. 1075-1105, 1983.

[6]

{6} S. Levinson, L. Rabiner, and M. Sondhi, "An introduction to the application of the theory of probabilistic functions of a Markov process to automatic speech recognition," Bell Syst. Tech. J., vol. 62, no. 4, pp. 1035-1074, 1983.

[7]

{7} S. Levinson, "Structural methods in automatic speech recognition," Proc. IEEE, vol. 73, no. 11, pp. 1625-1650, 1985.

[8]

{8} L. Rabiner, "Mathematical foundations of hidden Markov models," in Recent Advances in Automatic Speech Understanding and Dialog, H. Niemann, Ed. (NATO ASI Series). New York: Springer, 1988.

[9]

{9} A. Salomaa, Formal Languages. New York: Academic, 1973.

[10]

{10} R. Kashyap, "Syntactic decision rules for recognition of spoken words and phrases using stochastic automaton," IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-1, no. 2, pp. 154-163, 1979.

Digital Library

[11]

{11} R. Schwarth et al., "Acoustic-phonetic decoding of speech," in Recent Advances in Speech Understanding and Dialog Systems, H. Niemann, Ed. New York: Springer, 1988.

[12]

{12} H. Cerf-Danon et al., "Speech recognition experiments with 10000 word dictionary, " in Pattern Recognition and Applications, P. Devijver and J. Kittler, Eds. New York: Springer, 1987.

[13]

{13} K. Fu, Syntactic Pattern Recognition and Applications. Englewood Cliffs, NJ: Prentice-Hall, 1982.

[14]

{14} R. Gonzalez and M. Thomason, Syntactic Pattern Recognition: An Introduction. Reading, MA: Addison-Wesley, 1978.

[15]

{15} L. Miclet, Structural Methods in Pattern Recognition. North Oxford Academic, 1986.

[16]

{16} N. Abramson, Information Theory and Coding. New York: MCGraw-Hill, 1966.

[17]

{17} C. Wetherell, "Probabilistic languages: A review and some open questions," Comput. Surveys, vol. 12, no. 4, pp. 361-379, 1980.

Digital Library

[18]

{18} H. Rulot and E. Vidal, "An efficient algorithm for the inference of circuit-free automata, " in Proc. NATO Advanced Research Workshop Syntactic Pattern Recognition, Ferrate et al., Eds. New York: Springer, 1988.

[19]

{19} S. Levinson, "A unified theory of composite pattern analysis for automatic speech recognition," in Computer Speech Processing, F. Fallside and W. Woods, Eds. Englewood Cliffs, NJ: Prentice-Hall, 1985.

[20]

{20} S. Levinson, "Some experiments with a linguistic processor for continuous speech recognition," IEEE Trans. Acoust., Speech, Signal Processing , vol. ASSP-31, no. 6, pp. 1549-1556, 1983.

[21]

{21} A. Derouault and B. Merialdo, "Natural language modeling for phoneme to text transcription," IEEE Trans. Pattern Anal. Machine Intell. , vol. PAMI-8, no. 6, pp. 742-749, 1986.

Digital Library

[22]

{22} S. Nakagawa and M. Jilan, "Syllable-based connected spoken word recognition by two pass O(n) DP matching and hidden Markov model, " in Proc. ICASSP86, 1986, pp. 21.14.1-21.14.4.

[23]

{23} B. Merialdo, "Phonetic recognition using HMM's and maximum mutual information training, " in Proc. ICASSP88, 1988, pp. 111-114.

[24]

{24} P. F. Brown, "The acoustic-modeling problem in automatic speech recognition," IBM Res. Center, Yorktown Heights, NY, Res. Rep. RC-12750, May 1987.

[25]

{25} E. S. Santos, "Realizations of fuzzy languages by probabilistic maxproduct and max-min automata," Inform. Sci., vol. 8, pp. 39-53, 1975.

[26]

{26} K. F. Lee, "Large-vocabulary speaker-independent continuous speech recognition: The SPHNIX systems," Carnegie-Mellon Univ., Tech. Rep. CMU-CS-88-148, 1988.

Cited By

Vidal EThollard Fde la Higuera CCasacuberta FCarrasco R(2005)Probabilistic Finite-State Machines-Part IIIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2005.14827:7(1026-1039)Online publication date: 1-Jul-2005
https://dl.acm.org/doi/10.1109/TPAMI.2005.148
Vidal EThollard Fde la Higuera CCasacuberta FCarrasco R(2005)Probabilistic Finite-State Machines-Part IIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2005.14727:7(1013-1025)Online publication date: 1-Jul-2005
https://dl.acm.org/doi/10.1109/TPAMI.2005.147
de la Higuera C(2005)A bibliographical study of grammatical inferencePattern Recognition10.1016/j.patcog.2005.01.00338:9(1332-1348)Online publication date: 1-Sep-2005
https://dl.acm.org/doi/10.1016/j.patcog.2005.01.003
Show More Cited By

Index Terms

Some Relations Among Stochastic Finite State Networks Used in Automatic Speech Recognition

Recommendations

Using prosody to improve automatic speech recognition

In this paper acoustic processing and modelling of the supra-segmental characteristics of speech is addressed, with the aim of incorporating advanced syntactic and semantic level processing of spoken language for speech recognition/understanding tasks. ...
Psycho-acoustics inspired automatic speech recognition
Abstract
Understanding the human spoken language recognition process is still a far scientific goal. Nowadays, commercial automatic speech recognisers (ASRs) achieve high performance at recognising clean speech, but their approaches are poorly ...
Highlights
- We propose a novel Automatic Speech Recognizer inspired by psycho-acoustic studies.
Phoneme and tonal accent recognition for Thai speech
Highlights
► Phoneme recognition with soft phoneme segmentation procedure for Thai speech. ► Recognition system classifies phonemes using discrete hidden Markov models. ► MFPLP is better than MFCC as features in phoneme ...
Abstract
In this paper, we investigate the application of a phoneme recognition system with a soft phoneme segmentation procedure for Thai speech. In addition, we propose a new method to classify the tonal accent of a syllable. The recognition ...

Comments

Information & Contributors

Information

Published In

cover image IEEE Transactions on Pattern Analysis and Machine Intelligence

IEEE Transactions on Pattern Analysis and Machine Intelligence Volume 12, Issue 7

July 1990

116 pages

ISSN:0162-8828

Editor:
Steven L. Tanimoto

Issue’s Table of Contents

Copyright © Copyright © 1990 IEEE. All Rights Reserved.

Publisher

IEEE Computer Society

United States

Publication History

Published: 01 July 1990

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Vidal EThollard Fde la Higuera CCasacuberta FCarrasco R(2005)Probabilistic Finite-State Machines-Part IIIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2005.14827:7(1026-1039)Online publication date: 1-Jul-2005
https://dl.acm.org/doi/10.1109/TPAMI.2005.148
Vidal EThollard Fde la Higuera CCasacuberta FCarrasco R(2005)Probabilistic Finite-State Machines-Part IIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2005.14727:7(1013-1025)Online publication date: 1-Jul-2005
https://dl.acm.org/doi/10.1109/TPAMI.2005.147
de la Higuera C(2005)A bibliographical study of grammatical inferencePattern Recognition10.1016/j.patcog.2005.01.00338:9(1332-1348)Online publication date: 1-Sep-2005
https://dl.acm.org/doi/10.1016/j.patcog.2005.01.003
Dupont PDenis FEsposito Y(2005)Links between probabilistic automata and hidden Markov modelsPattern Recognition10.1016/j.patcog.2004.03.02038:9(1349-1371)Online publication date: 1-Sep-2005
https://dl.acm.org/doi/10.1016/j.patcog.2004.03.020
Bréhélin L(2005)Clustering gene expression series with prior knowledgeProceedings of the 5th International conference on Algorithms in Bioinformatics10.1007/11557067_3(27-38)Online publication date: 3-Oct-2005
https://dl.acm.org/doi/10.1007/11557067_3
Denis FEsposito Y(2003)Residual languages and probabilistic automataProceedings of the 30th international conference on Automata, languages and programming10.5555/1759210.1759256(452-463)Online publication date: 30-Jun-2003
https://dl.acm.org/doi/10.5555/1759210.1759256
Bréhélin LGascuel OCaraux G(2001)Hidden Markov Models with Patterns to Learn Boolean Vector Sequences and Application to the Built-In Self-Test for Integrated CircuitsIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/34.95511223:9(997-1008)Online publication date: 1-Sep-2001
https://dl.acm.org/doi/10.1109/34.955112
Picó DCasacuberta F(2001)Some Statistical-Estimation Methods for Stochastic Finite-State TransducersMachine Language10.1023/A:101088011395644:1-2(121-141)Online publication date: 1-Jul-2001
https://dl.acm.org/doi/10.1023/A%3A1010880113956

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents