Article

Automatic classification of speech and music using neural networks

Authors:

M. Kashif Saeed Khan,

Wasfi G. Al-Khatib,

Muhammad MoinuddinAuthors Info & Claims

MMDB '04: Proceedings of the 2nd ACM international workshop on Multimedia databases

Pages 94 - 99

https://doi.org/10.1145/1032604.1032620

Published: 13 November 2004 Publication History

Abstract

The importance of automatic discrimination between speech signals and music signals has evolved as a research topic over recent years. The need to classify audio into categories such as speech or music is an important aspect of many multimedia document retrieval systems. Several approaches have been previously used to discriminate between speech and music data. In this paper, we propose the use of the mean and variance of the discrete wavelet transform in addition to other features that have been used previously for audio classification. We have used Multi-Layer Perceptron (MLP) Neural Networks as a classifier. Our initial tests have shown encouraging results that indicate the viability of our approach.

References

[1]

Carey, M. J., Parris, E. S. and Lloyd-Thomas, H., A Comparison of Features for Speech, Music Discrimination. In Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP 99), Vol. 1, 1999.

Digital Library

[2]

Chou, W. and Gu, L., Robust Singing Detection In Speech/Music Discriminator Design. In Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP 01), Vol. 2, 2001.

Digital Library

[3]

El-Maleh, K., Klein, M., Petrucci, G. and Kabal, P., Speech/Music Discrimination For Multimedia Applications. In Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP 00), Vol. 6, 2000.

Digital Library

[4]

Harb, H. and Chen, L., Robust Speech Music Discrimination Using Spectrum's First Order Statistics And Neural Networks. In Proceedings of the Seventh International Symposium on Signal Processing and Its Applications, Vol. 2, 2003.

[5]

Harb, H., Chen, L. and Auloge, J. Y., Speech/Music/Silence and Gender Detection Algorithm. In Proceedings of the 7th International Conference on Distributed Multimedia Systems (DMS 01), 2001.

[6]

Haykin, S., Neural Networks: A Comprehensive Foundation. Prentice Hall, 1999.

Digital Library

[7]

Karneback, S., Discrimination between speech and music based on a low frequency modulation feature. In Proceedings of the European Conference on Speech Communication and Technology, 2001.

[8]

Panagiotakis, C. and Tziritas, G., A Speech/Music Discriminator Based On RMS And Zero-Crossings. IEEE Transactions on Multimedia, 2004.

Digital Library

[9]

Parris, E. S., Carey, M. J. and Lloyd-Thomas, H., Feature Fusion For Music Detection. In Proceedings of the European Conference on Speech Communication and Technology, 1999.

[10]

Pinquier, J., Rouas, J. -L. and André-Obrecht, R., A Fusion Study in Speech/Music Classification. In Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP 03), Vol. 2, 2003.

[11]

Pinquier, J., Rouas, J.-L. and André-Obrecht, R., Robust Speech / Music Classification in Audio Documents. In Proceedings of the International Conference on Spoken Language Processing (ICSLP 02), Vol. 3, 2002.

[12]

Pinquier, J., Sénac, C. and André-Obrecht, R., Speech and Music Classification in Audio Documents. In Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP 02), Vol. 4, 2002.

[13]

Saad, E. M., El-Adawy, M. I., Abu-El-Wafa, M. E. and Wahba, A. A., A Multifeature Speech/Music Discrimination System. In Proceedings of the Canadian Conference on Electrical and Computer Engineering (CCECE 02), Vol. 2, 2002.

[14]

Saunders, J., Real-Time Discrimination of Broadcast Speech/Music. In Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP 96), Vol. 2, 1996.

Digital Library

[15]

Scheirer, E. and Slaney, M., Construction and Evaluation of A Robust Multifeatures Speech/Music Discriminator. In Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP 97), Vol. 2, 1997.

Digital Library

[16]

Wang, W. Q., Gao, W. and Ying, D. W., A Fast and Robust Speech/Music Discrimination Approach. In Proceedings of the International Conference on Information, Communications and Signal Processing, 2003.

Cited By

Zajmi LAhmed FJaharadak A(2018)Concepts, Methods, and Performances of Particle Swarm Optimization, Backpropagation, and Neural NetworksApplied Computational Intelligence and Soft Computing10.1155/2018/95472122018Online publication date: 3-Sep-2018
https://dl.acm.org/doi/10.1155/2018/9547212
Yang WTu WZheng JZhang XYang YSong Y(2018)An RNN-Based Speech-Music Discrimination Used for Hybrid Audio CoderMultiMedia Modeling10.1007/978-3-319-73603-7_7(81-92)Online publication date: 13-Jan-2018
https://doi.org/10.1007/978-3-319-73603-7_7
Chakrabarty SRoy SDe D(2017)Time-Slot Based Intelligent Music Recommender in Indian MusicIntelligent Analysis of Multimedia Information10.4018/978-1-5225-0498-6.ch012(319-351)Online publication date: 2017
https://doi.org/10.4018/978-1-5225-0498-6.ch012
Show More Cited By

Index Terms

Automatic classification of speech and music using neural networks
1. Hardware
  1. Communication hardware, interfaces and storage
    1. Signal processing systems
  2. Robustness
    1. Hardware reliability
      1. Signal integrity and noise analysis
2. Information systems
  1. Information retrieval
    1. Document representation
    2. Search engine architectures and scalability
      1. Search engine indexing

Recommendations

Machine-learning based classification of speech and music

The need to classify audio into categories such as speech or music is an important aspect of many multimedia document retrieval systems. In this paper, we investigate audio features that have not been previously used in music-speech classification, such ...
Speech and music pitch trajectory classification using recurrent neural networks for monaural speech segregation
Abstract
In this paper, we propose speech/music pitch classification based on recurrent neural network (RNN) for monaural speech segregation from music interferences. The speech segregation methods in this paper exploit sub-band masking to construct ...
Multi-class pattern classification using neural networks

Multi-class pattern classification has many applications including text document classification, speech recognition, object recognition, etc. Multi-class pattern classification using neural networks is not a trivial extension from two-class neural ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MMDB '04: Proceedings of the 2nd ACM international workshop on Multimedia databases

November 2004

118 pages

ISBN:1581139756

DOI:10.1145/1032604

Program Chairs:
Shu-Ching Chen
Florida International University
,
Mei-Ling Shyu
University of Miami

Copyright © 2004 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 November 2004

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

CIKM04

Sponsor:

CIKM04: Conference on Information and Knowledge Management

November 13, 2004

DC, Washington, USA

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
1,544
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 04 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Zajmi LAhmed FJaharadak A(2018)Concepts, Methods, and Performances of Particle Swarm Optimization, Backpropagation, and Neural NetworksApplied Computational Intelligence and Soft Computing10.1155/2018/95472122018Online publication date: 3-Sep-2018
https://dl.acm.org/doi/10.1155/2018/9547212
Yang WTu WZheng JZhang XYang YSong Y(2018)An RNN-Based Speech-Music Discrimination Used for Hybrid Audio CoderMultiMedia Modeling10.1007/978-3-319-73603-7_7(81-92)Online publication date: 13-Jan-2018
https://doi.org/10.1007/978-3-319-73603-7_7
Chakrabarty SRoy SDe D(2017)Time-Slot Based Intelligent Music Recommender in Indian MusicIntelligent Analysis of Multimedia Information10.4018/978-1-5225-0498-6.ch012(319-351)Online publication date: 2017
https://doi.org/10.4018/978-1-5225-0498-6.ch012
Alías FSocoró JSevillano X(2016)A Review of Physical and Perceptual Feature Extraction Techniques for Speech, Music and Environmental SoundsApplied Sciences10.3390/app60501436:5(143)Online publication date: 12-May-2016
https://doi.org/10.3390/app6050143
Moein S(2014)ANN Optimization Experiments for ClassificationMedical Diagnosis Using Artificial Neural Networks10.4018/978-1-4666-6146-2.ch014(200-212)Online publication date: 2014
https://doi.org/10.4018/978-1-4666-6146-2.ch014
Moein S(2014)Optimization AlgorithmsMedical Diagnosis Using Artificial Neural Networks10.4018/978-1-4666-6146-2.ch013(182-199)Online publication date: 2014
https://doi.org/10.4018/978-1-4666-6146-2.ch013
Didiot EIllina IFohr DMella O(2010)A wavelet-based parameterization for speech/music discriminationComputer Speech and Language10.1016/j.csl.2009.05.00324:2(341-357)Online publication date: 1-Apr-2010
https://dl.acm.org/doi/10.1016/j.csl.2009.05.003
Ntalampiras SFakotakis N(2008)Speech/Music Discrimination Based on Discrete Wavelet TransformProceedings of the 5th Hellenic conference on Artificial Intelligence: Theories, Models and Applications10.1007/978-3-540-87881-0_19(205-211)Online publication date: 2-Oct-2008
https://dl.acm.org/doi/10.1007/978-3-540-87881-0_19
Freeman CDony RAreibi S(2007)Audio Environment Classication for Hearing Aids using Artificial Neural Networks with Windowed Input2007 IEEE Symposium on Computational Intelligence in Image and Signal Processing10.1109/CIISP.2007.369314(183-188)Online publication date: Apr-2007
https://doi.org/10.1109/CIISP.2007.369314

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents