Article

A statistical approach to retrieval under user-dependent uncertainty in query-by-humming systems

Authors:

Shrikanth S. Narayanan,

Elaine ChewAuthors Info & Claims

MIR '04: Proceedings of the 6th ACM SIGMM international workshop on Multimedia information retrieval

Pages 113 - 118

https://doi.org/10.1145/1026711.1026731

Published: 15 October 2004 Publication History

Abstract

Robustly addressing uncertainty in query formulation and search is one of the most challenging problems in multimedia information retrieval (MIR) systems. In this paper, a statistical approach to the problem of retrieval under the effect of uncertainty in Query by Humming (QBH) systems is presented. Direct transcription of audio to pitch and duration symbols is performed. From the transcribed data vector, finger prints that carry a fixed length of information from characteristic local points of the hummed melody are extracted. Instead of employing the humming input as a whole, extracted characteristic information packages are used for search through the database. The distance for each finger print to the original melodies in the database is calculated and converted to probabilistic similarity measures. Melodies with the highest similarity measures are returned to the user as the most likely query result. This algorithm is tested with manually annotated data comprising 250 humming samples in conjunction with a database of 200 pre-processed midi files. Retrieval accuracy of 94 percent is demonstrated for the samples of subjects that have some musical training/background compared to 72 percent accuracy achieved for the samples of non-trained subjects. Results also show that extracting finger prints with respect to characteristic local points of the hummed tune is an effective and robust way for search and retrieval under the effect of uncertainty

References

[1]

Shih H.-H., Narayanan, S. S. and Kuo, C.-C. J. An HMM-based approach to humming transcription. In Proceedings of IEEE International Conference on Multimedia and Expo (ICME2002), August 2002.

[2]

Shih H.-H., Narayanan, S. S. and Kuo, C.-C. J. Multidimensional Humming Transcription Using Hidden Markov Models for Query by Humming Systems. In Proceedings of IEEE International conference on Acoustics Speech and Signal Processing, 2003

[3]

Unal, E., Narayanan, S. S., Shih, H.-H., Chew, E., Kuo, C.-C. J. Creating data resources for designing user-centric front-ends for Query by Humming systems. In Proceedings of 5th ACM Multimedia Information Retrieval Conference'03, (Berkeley CA, November, 2003)

Digital Library

[4]

Bamberger, J. Turning Music Theory on its Ear. International Journal of Computers for Mathematical Learning Vol.1, No.1, 1996

[5]

Desain, P, Honing, H. The formation of rhythmic categories and metric priming. Music Perception, 2003, Vol 32, pp 341--365

[6]

Ghias, A., Logan, J., Chamberlin, D. and Smith B.C. Query by humming: musical information retrieval in an aoudio database. In Proceedings of ACM Multimedia Conferenece'95 (San Francisco, California, November 1995)

Digital Library

[7]

McNab, R. J., Smith, L. A., Witten, I.H., C.L. Henderson, C.L., and Cunningham, S.J Towards the digital music library: Tune retrieval from acoustic input. In Proceedings of Digital Libraries Conference 1996.

Digital Library

[8]

McNab, R. J., Smith, L. A., Witten, I.H., Henderson, C.L. Tune Retrieval in multimedia library. Multimedia Tools and Applications, vol.10, 2000.

Digital Library

[9]

Blackburn, S. and DeRoure, D. A tool for content based navigation of music. In Proceedings of ACM Multimedia 98, 1998, pp. 361--368

Digital Library

[10]

Rolland, P.Y., Raskins, G., and Ganascia, J.G. Music content-based retrieval: an overview of melodiscov approach and systems. In Proceedings of ACM Multimedia 99 (November 1999)

Digital Library

[11]

Shih, H.-H., Zhang, T. and Kuo, C.-C. J. Real-time retrieval of song from music database with query-by-humming. In Proceedings of ISMIP (1999), 251--57.

[12]

Chen B. and Roger Jang, J.-S. Query by Singing. In Proceedings of 11th IPPR Conference on Computer Vision, Graphics and Image Processing (Taiwan, 1998).

[13]

Lu, L., You, H., and Zhang, H.-J. A new approach to query by humming in music retrieval. In Proceedings of IEEE International Conference on Multimedia and Expo (2001)

[14]

Haus, G. and Pollstri, E. An Audio Front End for Query-by-Humming Systems. In Proceedings of ISMIR 2001(Bloomington, Indiana, October 2001)

[15]

Zhu, Y. and Shasha, D. Warping Indexes with Envelope Transforms for Query-by-Humming. In Proceedings of ACM SIGMOD 2003 (San Diego, CA, June 2003)

Digital Library

[16]

Huron, D. Tone and Voice: A Derivation of the Rules of Voice-leading from Perceptual Principles. Music Perception, Vol. 19, No. 1 (2001) pp. 1--64.

[17]

Rossing, T. D., Science of Sound, 3rd ed. (with F. Richard Moore, Paul A. Wheeler), Addison-Wesley, San Francisco, 2002

[18]

Capleton., B. Perfect Pitch http://www.amarilli.co.uk/piano/perfectp.asp

Cited By

Nagavi TBhajantri N(2015)Fast query by humming system based on complex multiscale music entropy and CMMEB Kd treeInternational Journal of Grid and Utility Computing10.1504/IJGUC.2015.0706786:3/4(159-169)Online publication date: 1-Jul-2015
https://dl.acm.org/doi/10.1504/IJGUC.2015.070678
Kaczmarek A(2014)Information Retrieval with the Use of Music Clustering by Directions AlgorithmNew Trends in Networking, Computing, E-learning, Systems Sciences, and Engineering10.1007/978-3-319-06764-3_22(171-177)Online publication date: 8-Nov-2014
https://doi.org/10.1007/978-3-319-06764-3_22
Wang HLiu JHutchings BBetz V(2013)An FPGA based parallel architecture for music melody matchingProceedings of the ACM/SIGDA international symposium on Field programmable gate arrays10.1145/2435264.2435305(235-244)Online publication date: 11-Feb-2013
https://dl.acm.org/doi/10.1145/2435264.2435305
Show More Cited By

Index Terms

A statistical approach to retrieval under user-dependent uncertainty in query-by-humming systems
1. Information systems
  1. Information retrieval

Recommendations

Query by Humming for Song Identification Using Voice Isolation
Advances and Trends in Artificial Intelligence. From Theory to Practice
Abstract
There are some methods for searching in large music databases, like searching by song name or artist name. However, in some cases these methods are not enough. For instance, a person might not remember the name of a song, but might remember its ...
Challenging Uncertainty in Query by Humming Systems: A Fingerprinting Approach

Robust data retrieval in the presence of uncertainty is a challenging problem in multimedia information retrieval. In query-by-humming (QBH) systems, uncertainty can arise in query formulation due to user-dependent variability, such as incorrectly ...
Statistical humming recognition and theme finder for query by humming systems

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MIR '04: Proceedings of the 6th ACM SIGMM international workshop on Multimedia information retrieval

October 2004

334 pages

ISBN:1581139403

DOI:10.1145/1026711

General Chairs:
Michael S. Lew
LIACS Media Lab, The Netherlands
,
Nicu Sebe
University of Amsterdam, The Netherlands
,
Chabane Djeraba
LIFL, France

Copyright © 2004 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 October 2004

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

MM04

Sponsor:

MM04: 2004 12th Annual ACM International Conference on Multimedia

October 15 - 16, 2004

NY, New York, USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
522
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 27 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Nagavi TBhajantri N(2015)Fast query by humming system based on complex multiscale music entropy and CMMEB Kd treeInternational Journal of Grid and Utility Computing10.1504/IJGUC.2015.0706786:3/4(159-169)Online publication date: 1-Jul-2015
https://dl.acm.org/doi/10.1504/IJGUC.2015.070678
Kaczmarek A(2014)Information Retrieval with the Use of Music Clustering by Directions AlgorithmNew Trends in Networking, Computing, E-learning, Systems Sciences, and Engineering10.1007/978-3-319-06764-3_22(171-177)Online publication date: 8-Nov-2014
https://doi.org/10.1007/978-3-319-06764-3_22
Wang HLiu JHutchings BBetz V(2013)An FPGA based parallel architecture for music melody matchingProceedings of the ACM/SIGDA international symposium on Field programmable gate arrays10.1145/2435264.2435305(235-244)Online publication date: 11-Feb-2013
https://dl.acm.org/doi/10.1145/2435264.2435305
Myung JKim KPark JKoo MKim J(2013)Two‐pass search strategy using accumulated band energy histogram for HMM‐based identification of perceptually identical musicInternational Journal of Imaging Systems and Technology10.1002/ima.2204323:2(127-132)Online publication date: 21-May-2013
https://doi.org/10.1002/ima.22043
Kim KLim MKim J(2009)Music copyright protection system using fuzzy similarity measure for music phoneme segmentationProceedings of the 18th international conference on Fuzzy Systems10.5555/1717561.1717589(159-164)Online publication date: 20-Aug-2009
https://dl.acm.org/doi/10.5555/1717561.1717589
Kim KLim MKim J(2009)Music copyright protection system using fuzzy similarity measure for music phoneme segmentation2009 IEEE International Conference on Fuzzy Systems10.1109/FUZZY.2009.5277274(159-164)Online publication date: Aug-2009
https://doi.org/10.1109/FUZZY.2009.5277274
Unal EChew EGeorgiou PNarayanan S(2008)Challenging Uncertainty in Query by Humming SystemsIEEE Transactions on Audio, Speech, and Language Processing10.1109/TASL.2007.91237316:2(359-371)Online publication date: 1-Feb-2008
https://dl.acm.org/doi/10.1109/TASL.2007.912373
Little DRaffensperger DPardo B(2008)User Specific Training of a Music Search EngineMachine Learning for Multimodal Interaction10.1007/978-3-540-78155-4_7(72-83)Online publication date: 2008
https://doi.org/10.1007/978-3-540-78155-4_7
Little DRaffensperger DPardo B(2007)User specific training of a music search engineProceedings of the 4th international conference on Machine learning for multimodal interaction10.5555/1787422.1787432(72-83)Online publication date: 28-Jun-2007
https://dl.acm.org/doi/10.5555/1787422.1787432
Tenbergen B(2007)Similarity clustering of music files according to user preferenceProceedings of the artificial intelligence 6th Mexican international conference on Advances in artificial intelligence10.5555/1775967.1775987(182-192)Online publication date: 4-Nov-2007
https://dl.acm.org/doi/10.5555/1775967.1775987
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten