abstract

guitAR: supporting guitar learning through mobile projection

Authors:

Markus Löchtefeld,

Sven Gehring,

Ralf Jung,

Antonio KrügerAuthors Info & Claims

CHI EA '11: CHI '11 Extended Abstracts on Human Factors in Computing Systems

Pages 1447 - 1452

https://doi.org/10.1145/1979742.1979789

Published: 07 May 2011 Publication History

Get Access

Abstract

The guitar is one of the most widespread instruments amongst autodidacts, but even though a huge amount of learning material exists, it is still hard to learn especially without a guitar teacher. In this paper we propose an Augmented Reality application called guitAR that assists guitar students mastering their instrument using a projector phone. With the projector phone mounted at the headstock of the guitar, the fret board and the strings of the guitar are in the field of projection of the phone. By projecting instructions directly onto the strings of the guitar the user is easily able to realize where the fingers have to be placed on the fretboard (fingering) to play a certain chord or a tone sequence correctly.

References

[1]

Burns, A. and Wanderley, M. Visual methods for the retrieval of guitarist fingering. In Proceedings of the 2006 conference on New interfaces for musical expression (NIME '06). IRCAM, Centre Pompidou, Paris, France, France (2006)

Digital Library

Google Scholar

[2]

Cakmakci, O. and Berard, F. An Augmented Reality Based Learning Assistant for Electric Bass Guitar. In: Tenth International Conference on Human-Computer Interaction, HCI 2003, Rome, Italy (2003)

Google Scholar

[3]

Johnson, R., van der Linden, J. and Rogers, Y. MusicJacket: the efficacy of real-time vibrotactile feedback for learning to play the violin. In Proceedings of the 28th of the international conference extended abstracts on Human factors in computing systems (CHI EA '10). ACM, New York, NY, USA (2010)

Digital Library

Google Scholar

[4]

Kerdvibulvech, C. and Saito, H., Vision-based guitarist fingering tracking using a Bayesian classifier and particle filters. In Proceedings of the 2nd Pacific Rim conference on Advances in image and video technology (PSIVT'07), Springer-Verlag, Berlin (2007)

Digital Library

Google Scholar

[5]

Liarokapis, F. Augmented Reality Scenarios for Guitar Learning. In: Third International Conference on Eurographics UK Theory and Practice of Computer Graphics, Canterbury, UK (2005)

Google Scholar

[6]

Mistry, P., Maes, P. and Chang, L. WUW - wear Ur world: a wearable gestural interface. In Proceedings of the 27th international conference extended abstracts on Human factors in computing systems (CHI '09). ACM, New York, NY (2009)

Digital Library

Google Scholar

[7]

Motokawa, Y. and Saito, H. Support system for guitar playing using augmented reality display. In Proceedings of the 5th IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR '06). IEEE Computer Society, Washington, DC, USA (2006)

Digital Library

Google Scholar

[8]

Raskar, R., Beardsley, P., van Baar, J., Wang, Y., Dietz, P., Lee, J., Leigh, D. and Willwacher, T. RFIG lamps: interacting with a self-describing world via photosensing wireless tags and projectors. In ACM SIGGRAPH 2005 Courses (SIGGRAPH '05) ACM, New York, NY, USA (2005)

Digital Library

Google Scholar

[9]

Rosenthal, S., Kane, S. K., Wobbrock, J. O. and Avrahami, D. Augmenting on-screen instructions with micro-projected guides: when it works, and when it fails. In Proceedings of the 12th ACM international conference on Ubiquitous computing (Ubicomp '10). ACM, New York, NY, USA (2010)

Digital Library

Google Scholar

[10]

Schöning, J., Rohs, M., Kratz, S., Löchtefeld, M. and Krüger, A. Map torchlight: a mobile augmented reality camera projector unit. In Proceedings of the 27th international conference extended abstracts on Human factors in computing systems (CHI '09). ACM, New York, NY, USA (2009)

Digital Library

Google Scholar

Cited By

View all

Liscio CBrown D(2025)Helping Popular Musicians Learn by Ear: Analyzing Video Lessons to Inform the Design of Memory-Oriented Human-Recording InteractionsProceedings of the Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3689050.3704953(1-13)Online publication date: 4-Mar-2025
https://dl.acm.org/doi/10.1145/3689050.3704953
Kosch TWeiß ADeja JShrestha SHoppe MMatviienko AMarky K(2024)Intelligent Music Interfaces: When Interactive Assistance and Adaptive Augmentation Meet Musical InstrumentsProceedings of the Augmented Humans International Conference 202410.1145/3652920.3653039(327-330)Online publication date: 4-Apr-2024
https://dl.acm.org/doi/10.1145/3652920.3653039
Zhao WWang SZhao YWei JLiang YLin JTang Y(2024)A study on attention-based fine-grained image recognition: Towards musical instrument performing hand shape assessmentEngineering Applications of Artificial Intelligence10.1016/j.engappai.2023.107512129(107512)Online publication date: Mar-2024
https://doi.org/10.1016/j.engappai.2023.107512
Show More Cited By

Index Terms

guitAR: supporting guitar learning through mobile projection
1. Human-centered computing

Recommendations

Real-time Recognition of Guitar Performance Using Two Sensor Groups for Interactive Lesson
TEI '18: Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction

The accurate recognition of guitarist performance is challenging compared with other instruments because a guitar player typically plays several notes at once and uses both hands in different ways. In this paper, we propose a sensor-based guitar that ...
Using mobile projection to support guitar learning
SG'11: Proceedings of the 11th international conference on Smart graphics

The guitar is one of the most widespread instruments amongst autodidacts, but even though a huge amount of learning material exists, it is still hard to learn especially without a guitar teacher. In this paper we propose an Augmented Reality concept ...
Guitar man: (an implementation of a rhythm game cooperative musical performance system with actual musical instruments)
SIGGRAPH Asia '08: ACM SIGGRAPH ASIA 2008 educators programme

This study proposes a method for learning musical instruments using computer graphics. The conventional musical instrument learning systems have been considered as simple game controllers or simple score processors. This study produced an education ...

Comments

Information & Contributors

Information

Published In

CHI EA '11: CHI '11 Extended Abstracts on Human Factors in Computing Systems

May 2011

2554 pages

ISBN:9781450302685

DOI:10.1145/1979742

General Chair:
Desney Tan
Microsoft Research
,
Program Chairs:
Bo Begole
PARC
,
Wendy A. Kellogg
IBM Research

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Abstract

Conference

CHI '11

Sponsor:

SIGCHI

CHI '11: CHI Conference on Human Factors in Computing Systems

May 7 - 12, 2011

BC, Vancouver, Canada

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

30
Total Citations
View Citations
984
Total Downloads

Downloads (Last 12 months)51
Downloads (Last 6 weeks)4

Reflects downloads up to 28 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Liscio CBrown D(2025)Helping Popular Musicians Learn by Ear: Analyzing Video Lessons to Inform the Design of Memory-Oriented Human-Recording InteractionsProceedings of the Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3689050.3704953(1-13)Online publication date: 4-Mar-2025
https://dl.acm.org/doi/10.1145/3689050.3704953
Kosch TWeiß ADeja JShrestha SHoppe MMatviienko AMarky K(2024)Intelligent Music Interfaces: When Interactive Assistance and Adaptive Augmentation Meet Musical InstrumentsProceedings of the Augmented Humans International Conference 202410.1145/3652920.3653039(327-330)Online publication date: 4-Apr-2024
https://dl.acm.org/doi/10.1145/3652920.3653039
Zhao WWang SZhao YWei JLiang YLin JTang Y(2024)A study on attention-based fine-grained image recognition: Towards musical instrument performing hand shape assessmentEngineering Applications of Artificial Intelligence10.1016/j.engappai.2023.107512129(107512)Online publication date: Mar-2024
https://doi.org/10.1016/j.engappai.2023.107512
Peretti SCaruso FPino MGiancola MD’Amico SDi Mascio T(2024)The CrazySquare project for music learning in Italian school-age pre-adolescents: integrating technology into educational practiceJournal of Computers in Education10.1007/s40692-024-00320-3Online publication date: 30-Apr-2024
https://doi.org/10.1007/s40692-024-00320-3
Deja JEska BShrestha SHoppe MKarolus JKosch TMatviienko AWeiß AMarky KWard JMcGill MMarky K(2023)Intelligent Music Interfaces: When Interactive Assistance and Augmentation Meet Musical InstrumentsProceedings of the Augmented Humans International Conference 202310.1145/3582700.3582731(379-383)Online publication date: 12-Mar-2023
https://dl.acm.org/doi/10.1145/3582700.3582731
Karolus JSylupp JSchmidt AWoźniak P(2023)EyePiano: Leveraging Gaze For Reflective Piano LearningProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596065(1209-1223)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596065
Gosling GCatovic IBangash GMacCormick DZaman L(2023)A Comparison of Interfaces for Learning How to Play a Mixed Reality Handpan2023 IEEE Gaming, Entertainment, and Media Conference (GEM)10.1109/GEM59776.2023.10390457(1-6)Online publication date: 19-Nov-2023
https://doi.org/10.1109/GEM59776.2023.10390457
Zhao WWang SZhao YWei JLi TZhang R(2023)Self-designed hierarchical network based hand shape intelligent recognition and evaluation for Chinese zither performingDisplays10.1016/j.displa.2022.10229176(102291)Online publication date: Jan-2023
https://doi.org/10.1016/j.displa.2022.102291
Monarca ITentori MCibrian F(2023)Understanding the musical interaction of children with autism spectrum disorder using elastic displayPersonal and Ubiquitous Computing10.1007/s00779-022-01703-y27:5(1843-1860)Online publication date: 3-Feb-2023
https://doi.org/10.1007/s00779-022-01703-y
Michałko ACampo ANijs LLeman MVan Dyck E(2022)Toward a meaningful technology for instrumental music education: Teachers’ voiceFrontiers in Education10.3389/feduc.2022.10270427Online publication date: 28-Oct-2022
https://doi.org/10.3389/feduc.2022.1027042
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Real-time Recognition of Guitar Performance Using Two Sensor Groups for Interactive Lesson

Using mobile projection to support guitar learning

Guitar man: (an implementation of a rhythm game cooperative musical performance system with actual musical instruments)

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Upcoming Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations