research-article

Soloist: Generating Mixed-Initiative Tutorials from Existing Guitar Instructional Videos Through Audio Processing

Authors:

Tovi GrossmanAuthors Info & Claims

CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

Article No.: 98, Pages 1 - 14

https://doi.org/10.1145/3411764.3445162

Published: 07 May 2021 Publication History

Abstract

Learning musical instruments using online instructional videos has become increasingly prevalent. However, pre-recorded videos lack the instantaneous feedback and personal tailoring that human tutors provide. In addition, existing video navigations are not optimized for instrument learning, making the learning experience encumbered. Guided by our formative interviews with guitar players and prior literature, we designed Soloist, a mixed-initiative learning framework that automatically generates customizable curriculums from off-the-shelf guitar video lessons. Soloist takes raw videos as input and leverages deep-learning based audio processing to extract musical information. This back-end processing is used to provide an interactive visualization to support effective video navigation and real-time feedback on the user's performance, creating a guided learning experience. We demonstrate the capabilities and specific use-cases of Soloist within the domain of learning electric guitar solos using instructional YouTube videos. A remote user study, conducted to gather feedback from guitar players, shows encouraging results as the users unanimously preferred learning with Soloist over unconverted instructional videos.

Supplementary Material

VTT File (3411764.3445162_videofigurecaptions.vtt)

Download
6.06 KB

VTT File (3411764.3445162_videopreviewcaptions.vtt)

Download
.78 KB

MP4 File (3411764.3445162_videofigure.mp4)

Supplemental video

Download
30.37 MB

MP4 File (3411764.3445162_videopreview.mp4)

Preview video

Download
5.66 MB

References

[1]

C. Ailie Fraser, Tricia J. Ngoon, Mira Dontcheva, and Scott Klemmer. 2019. Replay: Contextually presenting learning videos across software applications. Conference on Human Factors in Computing Systems - Proceedings: 1–13. https://doi.org/10.1145/3290605.3300527.

Digital Library

[2]

Fraser Anderson, Tovi Grossman, Justin Matejka, and George Fitzmaurice. 2013. YouMove: enhancing movement training with an augmented reality mirror. UIST ’13: Proceedings of the 26th annual ACM symposium on User interface software and technology: 311–320. Retrieved from http://dl.acm.org/citation.cfm?doid=2501988.2502045

Digital Library

[3]

Shoko Araki, Francesco Nesta, Emmanuel Vincent, Zbyněk Koldovský, Guido Nolte, Andreas Ziehe, and Alexis Benichoux. 2012. The 2011 Signal Separation Evaluation Campaign (SiSEC2011): - Audio source separation. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 7191 LNCS: 414–422. https://doi.org/10.1007/978-3-642-28551-6_51.

Digital Library

[4]

Nikola Banovic, Tovi Grossman, Justin Matejka, and George Fitzmaurice. 2012. Waken: Reverse engineering usage information and interface structure from software videos. UIST’12 - Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology: 83–92.

Digital Library

[5]

Laura Barreto, Paul Taele, and Tracy Anne Hammond. 2016. A Stylus-Driven Intelligent Tutoring System for Music Education Instruction. In Revolutionizing Education with Digital Ink. 141–161.

[6]

Amy E Battles, James W Owens, Fort Collins, James S Voss, Fort Collins, and Dan L Dalton. 1999. VIDEO THUMBNAIL. 2, 12.

[7]

Rachel M. Bittner, Brian McFee, Justin Salamon, Peter Li, and Juan P. Bello. 2017. Deep salience representations for F0 estimation in polyphonic music. Proceedings of the 18th International Society for Music Information Retrieval Conference, ISMIR 2017: 63–70.

[8]

Jaime R Carbonell. 1970. AI in CAI: An Artificial-Intelligence Approach. MM, 4.

[9]

Minsuk Chang, Anh Truong, Oliver Wang, Maneesh Agrawala, and Juho Kim. 2019. How to Design Voice Based Navigation for How-To Videos. 1–11. https://doi.org/10.1145/3290605.3300931.

Digital Library

[10]

Alain de Cheveigné and Hideki Kawahara. 2002. YIN, a fundamental frequency estimator for speech and music. The Journal of the Acoustical Society of America 111, 4: 1917–1930. https://doi.org/10.1121/1.1458024.

[11]

Pei Yu Chi, Sally Ahn, Amanda Ren, Mira Dontcheva, Wilmot Li, and Björn Hartmann. 2012. MixT: Automatic generation of step-by-step mixed media tutorials. UIST’12 - Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology: 93–102.

Digital Library

[12]

Pei Yu Chi, Joyce Liu, Jason Linder, Mira Dontcheva, Wilmot Li, and Björn Hartmann. 2013. DemoCut: Generating concise instructional videos for physical demonstrations. UIST 2013 - Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology: 141–150. https://doi.org/10.1145/2501988.2502052.

Digital Library

[13]

Ryan Daniel. 2001. Self-assessment in performance. 215–226.

[14]

Roger B. Dannenberg, Marta Sanchez, Annabelle Joseph, Peter Capell, Robert Joseph, and Ronald Saul. 1990. A computer‐based multi‐media tutor for beginning piano students. Interface 19, 2–3: 155–173. https://doi.org/10.1080/09298219008570563.

[15]

Vsevolod Eremenko, Alia Morsi, Jyoti Narang, and Xavier Serra. Performance Assessment Technologies for the Support of Musical Instrument Learning.

[16]

K. Anders Ericsson, Ralf T. Krampe, and Clemens Tesch-Römer. 1993. The role of deliberate practice in the acquisition of expert performance. Psychological Review 100, 3: 363–406. https://doi.org/10.1037/0033-295x.100.3.363.

[17]

Chris Fournier. 2013. Evaluating text segmentation using boundary edit distance. ACL 2013 - 51st Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference 1: 1702–1712.

[18]

C. Ailie Fraser, Joy O. Kim, Hijung Valentina Shin, Joel Brandt, and Mira Dontcheva. 2020. Temporal Segmentation of Creative Live Streams. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems - CHI ’20: 1–12.

Digital Library

[19]

Jort F. Gemmeke, Daniel P.W. Ellis, Dylan Freedman, Aren Jansen, Wade Lawrence, R. Channing Moore, Manoj Plakal, and Marvin Ritter. 2017. Audio Set: An ontology and human-labeled dataset for audio events. ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings: 776–780. https://doi.org/10.1109/ICASSP.2017.7952261.

Digital Library

[20]

Anthony Glise. 1997. Classical guitar pedagogy: A handbook for teachers.

[21]

Arthur C. Graesser, Patrick Chipman, Brian C. Haynes, and Andrew Olney. 2005. Auto tutor: An intelligent tutoring system with mixed-initiative dialogue. IEEE Transactions on Education 48, 4: 612–618. https://doi.org/10.1109/TE.2005.856149.

Digital Library

[22]

Arthur C. Graesser, Shulan Lu, George Tanner Jackson, Heather Hite Mitchell, Mathew Ventura, Andrew Olney, and Max M. Louwerse. 2004. AutoTutor: A tutor with dialogue in natural language. Behavior Research Methods, Instruments, and Computers 36, 2: 180–192. https://doi.org/10.3758/BF03195563.

[23]

Tovi Grossman and George Fitzmaurice. 2010. ToolClips: An investigation of contextual video assistance for functionality understanding. Conference on Human Factors in Computing Systems - Proceedings 3: 1515–1524. https://doi.org/10.1145/1753326.1753552.

Digital Library

[24]

Tovi Grossman, Justin Matejka, and George Fitzmaurice. 2010. Chronicle: Capture, exploration, and playback of document workflow histories. UIST 2010 - 23rd ACM Symposium on User Interface Software and Technology: 143–152. https://doi.org/10.1145/1866029.1866054.

Digital Library

[25]

Ankit Gupta, Dieter Fox, Brian Curless, and Michael Cohen. 2012. DuploTrack: A real-time system for authoring and guiding duplo block assembly. UIST’12 - Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology: 389–401.

Digital Library

[26]

Shawn Hershey, Sourish Chaudhuri, Daniel P.W. Ellis, Jort F. Gemmeke, Aren Jansen, R. Channing Moore, Manoj Plakal, Devin Platt, Rif A. Saurous, Bryan Seybold, Malcolm Slaney, Ron J. Weiss, and Kevin Wilson. 2017. CNN architectures for large-scale audio classification. ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings: 131–135. https://doi.org/10.1109/ICASSP.2017.7952132.

Digital Library

[27]

Michael P Hewitt. 2001. The Effects of Modeling, Self-Evaluation, and Self-Listening on Junior High Instrumentalists’ Music Performance and Practice Attitude. Journal of Research in Music Education 49, 4: 307–322.

[28]

Rose M.G. Johnson, Janet Van Der Linden, and Yvonne Rogers. 2010. MusicJacket: The efficacy of real-time vibrotactile feedback for learning to play the violin. Conference on Human Factors in Computing Systems - Proceedings: 3475–3480. https://doi.org/10.1145/1753846.1754004.

Digital Library

[29]

Justin Matejka, Tovi Grossman, and George Fitzmaurice. 2011. Ambient Help. CHI 2011 Conference proceedings: ACM SIGCHI Conference on Human Factors in Computing Systems: 2751–2760.

[30]

Justin Salamon; Christopher Jacoby; Juan Pablo Bello. 2014. Urban Sound Datasets. MM ’14 Proceedings of the 22nd ACM international conference on Multimedia, 3: 1041–1044. https://doi.org/10.1145/2647868.2655045.

Digital Library

[31]

Jakob Karolus, Hendrik Schuff, Thomas Kosch, Paweł W. Wozniak, and Albrecht Schmidt. 2018. EMGuitar: Assisting guitar playing with electromyography. DIS 2018 - Proceedings of the 2018 Designing Interactive Systems Conference, June: 651–656. https://doi.org/10.1145/3196709.3196803.

Digital Library

[32]

Jong Wook Kim, Justin Salamon, Peter Li, and Juan Pablo Bello. 2018. Crepe: A Convolutional Representation for Pitch Estimation. ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings 2018-April: 161–165. https://doi.org/10.1109/ICASSP.2018.8461329.

Digital Library

[33]

Juho Kim, Philip J. Guo, Carrie J. Cai, Shang Wen Li, Krzysztof Z. Gajos, and Robert C. Miller. 2014. Data-driven interaction techniques for improving navigation of educational videos. UIST 2014 - Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology: 563–572. https://doi.org/10.1145/2642918.2647389.

Digital Library

[34]

Juho Kim, Phu Nguyen, Sarah Weir, Philip J. Guo, Robert C. Miller, and Krzysztof Z. Gajos. 2014. Crowdsourcing step-by-step information extraction to enhance existing how-to videos. Conference on Human Factors in Computing Systems - Proceedings: 4017–4026. https://doi.org/10.1145/2556288.2556986.

Digital Library

[35]

Kenneth R Koedinger, John R Anderson, William H Hadley, Mary A Mark, Kenneth R Koedinger, John R Anderson, William H Hadley, Mary A Mark, Intelligent Tutoring, Kenneth R Koedinger, John R Anderson, William H Hadley, and Mary A Mark. 2007. Intelligent Tutoring Goes To School in the Big City To cite this version: HAL Id: hal-00197383 Intelligent Tutoring Goes To School in the Big City.

[36]

Florian Krebs, Sebastian Böck, and Gerhard Widmer. 2015. An efficient state-space model for joint tempo and meter tracking. Proceedings of the 16th International Society for Music Information Retrieval Conference, ISMIR 2015: 72–78.

[37]

Nathan B. Kruse, Kari Veblen. 2012. Music teaching and learning online: Considering youtube instructional videos. Journal of Music, Technology and Education 2012.

[38]

Balasaravanan Thoravi Kumaravel, Cuong Nguyen, Stephen DiVerdi, and Björn Hartmann. 2019. TutoriVR: A video-based tutorial system for design applications in virtual reality. Conference on Human Factors in Computing Systems - Proceedings: 1–12. https://doi.org/10.1145/3290605.3300514.

Digital Library

[39]

Ben Lafreniere, Tovi Grossman, Justin Matejka, and George Fitzmaurice. 2014. Investigating the feasibility of extracting tool demonstrations from in-situ video content. Conference on Human Factors in Computing Systems - Proceedings: 4007–4016. https://doi.org/10.1145/2556288.2557142.

Digital Library

[40]

Boulanger-Lewandowski, Nicolas, Yoshua Bengio, and Pascal Vincent. "Audio Chord Recognition with Recurrent Neural Networks." ISMIR. 2013.

[41]

Jen Yu Liu and Yi Hsuan Yang. 2019. Dilated convolution with dilated GRU for music source separation. IJCAI International Joint Conference on Artificial Intelligence 2019-Augus: 4718–4724. https://doi.org/10.24963/ijcai.2019/655.

[42]

Markus Löchtefeld, Antonio Krüger, Sven Gehring, and Ralf Jung. 2011. GuitAR - Supporting guitar learning through mobile projection. Conference on Human Factors in Computing Systems - Proceedings: 1447–1452. https://doi.org/10.1145/1979742.1979789.

Digital Library

[43]

Juan Pablo Martinez-Avila, Chris Greenhalgh, Adrian Hazzard, Steve Benford, and Alan Chamberlain. 2019. Encumbered interaction: A study of musicians preparing to perform. Conference on Human Factors in Computing Systems - Proceedings: 1–13. https://doi.org/10.1145/3290605.3300706.

Digital Library

[44]

Shunya Ariga Masataka Goto, Koji Yatani. 2017. Strummer: An Interactive Guitar Chord Practice System. In In Proceedings of IEEE International Conference on Multimedia and Expo (ICME ’17), IEEE, 1057–1062.

[45]

Justin Matejka, Tovi Grossman, and George Fitzmaurice. 2012. Swift: Reducing the effects of latency in online video scrubbing. Conference on Human Factors in Computing Systems - Proceedings: 637–646. https://doi.org/10.1145/2207676.2207766.

Digital Library

[46]

Justin Matejka, Tovi Grossman, and George Fitzmaurice. 2013. Swifter: Improved online video scrubbing. Conference on Human Factors in Computing Systems - Proceedings: 1159–1168. https://doi.org/10.1145/2470654.2466149.

Digital Library

[47]

Matthias Mauch and Simon Dixon. 2014. PYIN: A FUNDAMENTAL FREQUENCY ESTIMATOR USING PROBABILISTIC THRESHOLD DISTRIBUTIONS Matthias Mauch and Simon Dixon Queen Mary University of London, Centre for Digital Music, Mile End Road, London. Conference, Ieee International Processing, Signal 1, 1: 659–663.

[48]

Fiona Fui-Hoon Nah, Qing Zeng, Venkata Rajasekhar Telaprolu, Abhishek Padmanabhuni Ayyappa, Brenda Eschenbrenner. 2014. Gamification of Education: A Review of Literature - HCI in Business. Springer 8527: 401–409. https://doi.org/10.1007/978-3-319-07293-7.

[49]

Cuong Nguyen and Feng Liu. 2015. Making software tutorial video responsive. Conference on Human Factors in Computing Systems - Proceedings 2015-April: 1565–1568. https://doi.org/10.1145/2702123.2702209.

Digital Library

[50]

Alexey Ozerov, Pierrick Philippe, Frédéric Bimbot, Rémi Gribonval, Alexey Ozerov, Pierrick Philippe, Frédéric Bimbot, and Rémi Gribonval. 2011. Adaptation of Bayesian models for single channel source separation in popular songs To cite this version: Adaptation of Bayesian Models for Single-Channel Source Separation and its Application to Voice / Music Separation in Popular Songs.

[51]

Amy Pavel, Colorado Reed, Björn Hartmann, and Maneesh Agrawala. 2014. Video digests: A browsable, skimmable format for informational lecture videos. UIST 2014 - Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology: 573–582. https://doi.org/10.1145/2642918.2647400.

Digital Library

[52]

Gary S Plano. 2004. The effects of the Cognitive Tutor Algebra on student attitudes and achievement in a 9th-grade algebra course. ProQuest Dissertations and Theses: 147. Retrieved from http://login.proxy.library.vanderbilt.edu/login?

[53]

Suporn Pongnumkul, Mira Dontcheva, Wilmot Li, Jue Wang, Lubomir Bourdev, Shai Avidan, and Michael F. Cohen. 2011. Pause-and-play: Automatically linking screencast video tutorials with applications. UIST’11 - Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, October: 135–144. https://doi.org/10.1145/2047196.2047213.

Digital Library

[54]

John Ratcliff and David Metzener. Pattern Matching: The Gestalt Approach. Dr. Dobb's Journal, 46.

[55]

Manuel Moussallam Romain Hennequin, Anis Khlif, Felix Voituret. 2015. Spleeter: A Fast And State-of-the Art Music Source Separation Tool With Pre-trained Models. Late-Breaking/Demo ISMIR 2019: 4–5.

[56]

Quentin Roy, Futian Zhang, and Daniel Vogel. 2019. Automation accuracy is good, but high controllability may be better. Conference on Human Factors in Computing Systems - Proceedings: 1–8. https://doi.org/10.1145/3290605.3300750.

Digital Library

[57]

Steve Rubin, Floraine Berthouzoz, Gautham J. Mysore, Wilmot Li, and Maneesh Agrawala. 2012. UnderScore: Musical underlays for audio stories. UIST’12 - Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology: 359–366.

Digital Library

[58]

Zhengshan Shi and Gautham J. Mysore. 2018. LoopMaker: Automatic creation of music loops from pre-recorded music. Conference on Human Factors in Computing Systems - Proceedings 2018-April: 1–6. https://doi.org/10.1145/3173574.3174028.

Digital Library

[59]

Siddharth Sigtia, Emmanouil Benetos, and Simon DIxon. 2016. An end-to-end neural network for polyphonic piano music transcription. IEEE/ACM Transactions on Audio Speech and Language Processing 24, 5: 927–939. https://doi.org/10.1109/TASLP.2016.2533858.

Digital Library

[60]

R. A. Sottilare, A. Graesser, X. Hu, and H. Holden. 2013. Design Recommendations for Intelligent Tutoring Systems: Volume 1-Learner Modeling.

[61]

Paul Taele, Laura Barreto, and Tracy Hammond. 2015. Maestoso: An intelligent educational sketching tool for learning music theory. Proceedings of the National Conference on Artificial Intelligence 5: 3999–4005.

[62]

Kurt VanLehn. 2006. The Behavior of tutoring systems. International Journal of Artificial Intelligence in Education 16, 3: 227–265.

Digital Library

[63]

Roumen Vesselinov and John Grego. 2012. Duolingo Effectiveness Study. City University of New York, USA, December 2012: 1–25. Retrieved from http://static.duolingo.com/s3/DuolingoReport_Final.pdf

[64]

Jennifer A. Whitaker, Evelyn K. Orman, and Cornelia Yarbrough. 2014. Characteristics of “Music Education” Videos Posted on YouTube. Update: Applications of Research in Music Education 33, 1: 49–56. https://doi.org/10.1177/8755123314540662.

[65]

Randi Williams, Hae Won Park, and Cynthia Breazeal. 2019. A is for Artificial Intelligence Robots. 1–11.

[66]

Blake Williford, Matthew Runyon, Wayne Li, Georgia Tech, Julie Linsey, Georgia Tech, and Tracy Hammond. 2020. Exploring the Potential of an Intelligent Tutoring System for Sketching Fundamentals. 1–13.

[67]

Beste F. Yuksel, Kurt B. Oleson, Lane Harrison, Evan M. Peck, Daniel Afergan, Remco Chang, and Robert J.K. Jacob. 2016. Learn piano with BACh: An adaptive learning interface that adjusts task difficulty based on brain state. Conference on Human Factors in Computing Systems - Proceedings: 5372–5384. https://doi.org/10.1145/2858036.2858388.

Digital Library

[68]

Katie Zhukov. 2009. Effective Practising: A Research Perspective. Australian Journal of Music Education 1: 3–12. Retrieved from http://eric.ed.gov/ERICWebPortal/recordDetail?accno=EJ912405.

[69]

Berklee Online - Master's and Bachelor's Music Degrees, Certificates, and Courses. Retrieved May 2, 2020 from https://online.berklee.edu/.

[70]

Fender Play Online Guitar Lessons - Learn How to Play Guitar. https://www.fender.com/play.

[71]

Online STEAM Courses From Top Universities | Kadenze. https://www.kadenze.com/.

[72]

Coursera | Build Skills with Online Courses from Top Institutions. https://www.coursera.org/.

[73]

Yousician. https://yousician.com/.

[74]

Logic Pro X - Apple. https://www.apple.com/logic-pro/.

[75]

Music production with Live and Push | Ableton. https://www.ableton.com/en/.

[76]

Rocksmith. https://rocksmith.ubisoft.com/rocksmith/en-us/home/.

[77]

Guitar Hero. https://www.guitarhero.com/.

[78]

Capo. https://supermegaultragroovy.com/products/capo/.

[79]

YouLoop: Loop & Slow Down YouTube videos • Repeat YouTube Videos. https://youloop.io.

[80]

LoopTube: Repeat YouTube Videos. https://looptube.io/.

Cited By

Nghiem CBousseau ASypesteyn MHoftijzer JAgrawala MTsandilas T(2024)STIVi: Turning Perspective Sketching Videos into Interactive TutorialsProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670969(1-13)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670969
Chen YMorariu VTruong ALiu Z(2024)TutoAI: a cross-domain framework for AI-assisted mixed-media tutorial creation on physical tasksProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642443(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642443
Cao JPeng XLiang FTong X(2024)"Voices Help Correlate Signs and Words": Analyzing Deaf and Hard-of-Hearing (DHH) TikTokers’ Content, Practices, and PitfallsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642413(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642413
Show More Cited By

Index Terms

Soloist: Generating Mixed-Initiative Tutorials from Existing Guitar Instructional Videos Through Audio Processing

Index terms have been assigned to the content through auto-classification.

Recommendations

Precise pitch profile feature extraction from musical audio for key detection

The majority of pieces of music, including classical and popular music,are composed using music scales, such as keys. The key or the scale information of a piece provides important clues on its high level musical content, like harmonic and melodic ...
Tempo and beat tracking for audio signals with music genre classification

Most people follow the music to hum or the rhythm to tap sometimes. We may get different meanings of a music style if it is explained or felt by different people. Therefore we cannot obtain a very explicit answer if there is no music notation. Tempo and ...
B-box Mixer: An Interactive UI for Generating B-box Music
MM '15: Proceedings of the 23rd ACM international conference on Multimedia

B-box is a form of vocal percussion that imitates rhythms in various types of sound, especially musical instruments. As b-box becoming popular, more and more people want to learn b-box and make their own b-box music. However, not everyone has the talent ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

May 2021

10862 pages

ISBN:9781450380966

DOI:10.1145/3411764

General Chairs:
Yoshifumi Kitamura
Tohoku University, Japan
,
Aaron Quigley
University of New South Wales, Australia
,
Program Chairs:
Katherine Isbister
University of California Santa Cruz, USA
,
Takeo Igarashi
The University of Tokyo, Japan
,
Publications Chairs:
Pernille Bjørn
University of Copenhagen, Denmark
,
Steven Drucker
Microsoft Research, USA

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

National Sciences and Engineering Research Council of Canada (NSERC)

Conference

CHI '21

Sponsor:

SIGCHI

CHI '21: CHI Conference on Human Factors in Computing Systems

May 8 - 13, 2021

Yokohama, Japan

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
842
Total Downloads

Downloads (Last 12 months)169
Downloads (Last 6 weeks)9

Reflects downloads up to 06 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Nghiem CBousseau ASypesteyn MHoftijzer JAgrawala MTsandilas T(2024)STIVi: Turning Perspective Sketching Videos into Interactive TutorialsProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670969(1-13)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670969
Chen YMorariu VTruong ALiu Z(2024)TutoAI: a cross-domain framework for AI-assisted mixed-media tutorial creation on physical tasksProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642443(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642443
Cao JPeng XLiang FTong X(2024)"Voices Help Correlate Signs and Words": Analyzing Deaf and Hard-of-Hearing (DHH) TikTokers’ Content, Practices, and PitfallsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642413(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642413
Ram AXiao HZhao SFu C(2023)VidAdapterProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36109287:3(1-19)Online publication date: 27-Sep-2023
https://dl.acm.org/doi/10.1145/3610928
Feng SChen CXing Z(2023)Video2Action: Reducing Human Interactions in Action Annotation of App Tutorial VideosProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606778(1-15)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606778
Fender AWitzig DMöbus MHolz C(2023)PressurePick: Muscle Tension Estimation for Guitar Players Using Unobtrusive Pressure SensingProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606742(1-11)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606742
Wang B(2023)Democratizing Content Creation and Consumption through Human-AI Copilot SystemsAdjunct Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586182.3616707(1-4)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586182.3616707
Skreinig LKalkofen DStanescu AMohr PHeyen FMori SSedlmair MSchmalstieg DPlopski A(2023)guitARhero: Interactive Augmented Reality Guitar TutorialsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.332026629:11(4676-4685)Online publication date: 29-Sep-2023
https://dl.acm.org/doi/10.1109/TVCG.2023.3320266
Martinez Avila JHazzard AGreenhalgh CBenford SMcPherson A(2023)The Stretchy Strap: supporting encumbered interaction with guitarsJournal of New Music Research10.1080/09298215.2023.227483252:1(19-40)Online publication date: 10-Nov-2023
https://doi.org/10.1080/09298215.2023.2274832
Turchet LZanotto CPauwels J(2023)“Give me happy pop songs in C major and with a fast tempo”International Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103007173:COnline publication date: 1-May-2023
https://dl.acm.org/doi/10.1016/j.ijhcs.2023.103007
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten