Article

Vision-based guitarist fingering tracking using a Bayesian classifier and particle filters

Authors:

Chutisant Kerdvibulvech,

Hideo SaitoAuthors Info & Claims

PSIVT'07: Proceedings of the 2nd Pacific Rim conference on Advances in image and video technology

Pages 625 - 638

Published: 17 December 2007 Publication History

Abstract

This paper presents a vision-based method for tracking guitar fingerings played by guitar players from stereo cameras. We propose a novel framework for colored finger markers tracking by integrating a Bayesian classifier into particle filters, with the advantages of performing automatic track initialization and recovering from tracking failures in a dynamic background. ARTag (Augmented Reality Tag) is utilized to calculate the projection matrix as an online process which allow guitar to be moved while playing. By using online adaptation of color probabilities, it is also able to cope with illumination changes.

References

[1]

Maki-Patola, T., Laitinen, J., Kanerva, A., Takala, T.: Experiments with Virtual Reality Instruments. In: Fifth International Conference on New Interfaces for Musical Expression, Vancouver, Canada, pp. 11-16 (2005).

Digital Library

Google Scholar

[2]

Liarokapis, F.: Augmented Reality Scenarios for Guitar Learning. In: Third International Conference on Eurographics UK Theory and Practice of Computer Graphics, Canterbury, UK, pp. 163-170 (2005).

Google Scholar

[3]

Motokawa, Y., Saito, H.: Support System for Guitar Playing using Augmented Reality Display. In: Fifth IEEE and ACM International Symposium on Mixed and Augmented Reality, ISMAR 2006, pp. 243-244. IEEE Computer Society Press, Los Alamitos (2006).

Digital Library

Google Scholar

[4]

Fiala, M.: Artag, a Fiducial Marker System Using Digital Techniques. In: IEEE International Conference on Computer Vision and Pattern Recognition, CVPR 2005, vol. 1, pp. 590-596. IEEE Computer Society Press, Los Alamitos (2005).

Digital Library

Google Scholar

[5]

Isard, M., Blake, A.: Condensation - conditional density propagation for visual tracking. International Journal on Computer Vision, IJCV 1998 29(1), 5-28 (1998).

Digital Library

Google Scholar

[6]

Argyros, A.A., Lourakis, M.I.A.: Tracking Skin-colored Objects in Real-time. Invited Contribution to the Cutting Edge Robotics Book, ISBN 3-86611-038-3, Advanced Robotic Systems International (2005).

Google Scholar

[7]

Argyros, A.A., Lourakis, M.I.A.: Tracking Multiple Colored Blobs with a Moving Camera. In: IEEE International Conference on Computer Vision and Pattern Recognition, CVPR 2005, San Diego, CA, vol. 2(2), p. 1178 (2005).

Digital Library

Google Scholar

[8]

Kerdvibulvech, C., Saito, H.: Real-Time Guitar Chord Estimation by Stereo Cameras for Supporting Guitarists. In: Tenth International Workshop on Advanced Image Technology, IWAIT 2007, Bangkok, Thailand, pp. 256-261 (2007).

Google Scholar

[9]

Cakmakci, O., Berard, F.: An Augmented Reality Based Learning Assistant for Electric Bass Guitar. In: Tenth International Conference on Human-Computer Interaction, HCI 2003, Rome, Italy (2003).

Google Scholar

[10]

Kato, H., Billinghurst, M.: Marker Tracking and HMD Calibration for a Videobased Augmented Reality Conferencing System. In: Second IEEE and ACM International Workshop on Augmented Reality, pp. 85-94. IEEE Computer Society Press, Los Alamitos (1999).

Digital Library

Google Scholar

[11]

Burns, A.M., Wanderley, M.M.: Visual Methods for the Retrieval of Guitarist Fingering. In: Sixth International Conference on New Interfaces for Musical Expression, Paris, France, pp. 196-199 (2006).

Digital Library

Google Scholar

[12]

Yang, M.H., Kriegman, D.J., Ahuja, N.: Detecting Faces in Images: A Survey. IEEE Transactions on Pattern Analysis and Machine Intelligence 24, 34-58 (2002).

Digital Library

Google Scholar

[13]

Forsyth, D.A., Ponce, J.: Computer Vision: A Modern Approach. Prentice Hall, Upper Saddle River, NJ (2003).

Digital Library

Google Scholar

[14]

Jack, K.: Video Demystified. Elsevier Science, UK (2004).

Google Scholar

Cited By

View all

Li BLiu XDinesh KDuan ZSharma G(2019)Creating a Multitrack Classical Music Performance Dataset for Multimodal Music AnalysisIEEE Transactions on Multimedia10.1109/TMM.2018.285609021:2(522-535)Online publication date: 1-Feb-2019
https://dl.acm.org/doi/10.1109/TMM.2018.2856090
Sukumar PGopinath KTripathi SJoshi A(2013)Vision-based typing interface for chording input with keystroke detection using kalman filterProceedings of the 11th Asia Pacific Conference on Computer Human Interaction10.1145/2525194.2525298(310-317)Online publication date: 24-Sep-2013
https://dl.acm.org/doi/10.1145/2525194.2525298
Abeβer J(2012)Automatic String Detection for Bass Guitar and Electric GuitarRevised Selected Papers of the 9th International Symposium on From Sounds to Music and Emotions - Volume 790010.1007/978-3-642-41248-6_18(333-352)Online publication date: 19-Jun-2012
https://dl.acm.org/doi/10.1007/978-3-642-41248-6_18
Show More Cited By

Recommendations

Vision-Based Guitarist Fingering Tracking Using a Bayesian Classifier and Particle Filters
Advances in Image and Video Technology
Abstract
This paper presents a vision-based method for tracking guitar fingerings played by guitar players from stereo cameras. We propose a novel framework for colored finger markers tracking by integrating a Bayesian classifier into particle filters, ...
Multi-object tracking by mutual supervision of CNN and particle filter
Abstract
In the multi-object tracking process, a long-term tracking algorithm for traffic scene based on deep learning is proposed to handle several challenging problems, such as the complex variation of background illumination, change of pixel due to ...
Robust Object Tracking Using Particle Filters and Multi-region Mean Shift
PCM '09: Proceedings of the 10th Pacific Rim Conference on Multimedia: Advances in Multimedia Information Processing

In this paper, we introduce a novel algorithm which builds upon the combined anisotropic mean-shift and particle filter framework. The anisotropic mean-shift [4] with 5 degrees of freedom, is extended to work on a partition of the object into concentric ...

Comments

Information & Contributors

Information

Published In

PSIVT'07: Proceedings of the 2nd Pacific Rim conference on Advances in image and video technology

December 2007

960 pages

ISBN:354077128X

Editors:
Domingo Mery
Pontificia Universidad Católica de Chile, Department of Computer Science, Santiago, Chile
,
Luis Rueda
Universidad de Concepción, Department of Computer Science, Concepción, Chile

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 17 December 2007

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
10
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 28 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Li BLiu XDinesh KDuan ZSharma G(2019)Creating a Multitrack Classical Music Performance Dataset for Multimodal Music AnalysisIEEE Transactions on Multimedia10.1109/TMM.2018.285609021:2(522-535)Online publication date: 1-Feb-2019
https://dl.acm.org/doi/10.1109/TMM.2018.2856090
Sukumar PGopinath KTripathi SJoshi A(2013)Vision-based typing interface for chording input with keystroke detection using kalman filterProceedings of the 11th Asia Pacific Conference on Computer Human Interaction10.1145/2525194.2525298(310-317)Online publication date: 24-Sep-2013
https://dl.acm.org/doi/10.1145/2525194.2525298
Abeβer J(2012)Automatic String Detection for Bass Guitar and Electric GuitarRevised Selected Papers of the 9th International Symposium on From Sounds to Music and Emotions - Volume 790010.1007/978-3-642-41248-6_18(333-352)Online publication date: 19-Jun-2012
https://dl.acm.org/doi/10.1007/978-3-642-41248-6_18
Löchtefeld MGehring SJung RKrüger A(2011)Using mobile projection to support guitar learningProceedings of the 11th international conference on Smart graphics10.5555/2032567.2032580(103-114)Online publication date: 18-Jul-2011
https://dl.acm.org/doi/10.5555/2032567.2032580
Löchtefeld MGehring SJung RKrüger ATan DBegole BKellogg W(2011)guitARCHI '11 Extended Abstracts on Human Factors in Computing Systems10.1145/1979742.1979789(1447-1452)Online publication date: 7-May-2011
https://dl.acm.org/doi/10.1145/1979742.1979789

Abstract

References

Cited By

Recommendations