poster

Juggling 4.0: Learning Complex Motor Skills with Augmented Reality Through the Example of Juggling

Authors:

Benjamin Meyer,

Pascal Gruppe,

Bastian Cornelsen,

Tim Claudius Stratmann,

Uwe Gruenefeld,

Susanne BollAuthors Info & Claims

UIST '18 Adjunct: Adjunct Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology

Pages 54 - 56

https://doi.org/10.1145/3266037.3266099

Published: 11 October 2018 Publication History

Get Access

Abstract

Learning new motor skills is a problem that people are constantly confronted with (e.g. to learn a new kind of sport). In our work, we investigate to which extent the learning process of a motor sequence can be optimized with the help of Augmented Reality as a technical assistant. Therefore, we propose an approach that divides the problem into three tasks: (1) the tracking of the necessary movements, (2) the creation of a model that calculates possible deviations and (3) the implementation of a visual feedback system. To evaluate our approach, we implemented the idea by using infrared depth sensors and an Augmented Reality head-mounted device (HoloLens). Our results show that the system can give an efficient assistance for the correct height of a throw with one ball. Furthermore, it provides a basis for the support of a complete juggling sequence.

Supplementary Material

suppl.mov (upp1073.jpg)

Supplemental video

Download
45.92 KB

References

[1]

Randy S Haluck and Thomas M Krummel. 2000. Computers and virtual reality for surgical education in the 21st century. Archives of surgery 135, 7 (2000), 786--792.

Google Scholar

[2]

Amy Henderson, Nicol Korner-Bitensky, and Mindy Levin. 2007. Virtual Reality in Stroke Rehabilitation: A Systematic Review of its Effectiveness for Upper Limb Motor Recovery. Topics in Stroke Rehabilitation 14, 2 (2007), 52--61. 17517575.

Crossref

Google Scholar

[3]

Rotem Lammfromm and Daniel Gopher. 2011. Transfer of Skill from a Virtual Reality Trainer to Real Juggling. BIO Web of Conferences 1 (2011), 00054.

Crossref

Google Scholar

[4]

Mindy F Levin, Patrice L Weiss, and Emily A Keshner. 2015. Emergence of virtual reality as a tool for upper limb rehabilitation: incorporation of motor control and motor learning principles. Physical therapy 95, 3 (2015), 415--425.

Google Scholar

[5]

Jack Sklansky. 1982. Finding the convex hull of a simple polygon. Pattern Recognition Letters 1, 2 (1982), 79--83.

Digital Library

Google Scholar

[6]

Satoshi Suzuki and others. 1985. Topological structural analysis of digitized binary images by border following. Computer vision, graphics, and image processing 30, 1 (1985), 32--46

Google Scholar

Cited By

View all

Matsumoto TWu ELiao CKoike H(2024)ARpenSki: Augmenting Ski Training with Direct and Indirect Postural Visualization2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00024(1-9)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VR58804.2024.00024
Diller FScheuermann GWiebel A(2024)Visual Cue Based Corrective Feedback for Motor Skill Training in Mixed Reality: A SurveyIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.322799930:7(3121-3134)Online publication date: Jul-2024
https://doi.org/10.1109/TVCG.2022.3227999
Lin TYang WNakagaki K(2023)ThrowIO: Actuated TUIs that Facilitate “Throwing and Catching” Spatial Interaction with Overhanging Mobile Wheeled RobotsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581267(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581267
Show More Cited By

Index Terms

Juggling 4.0: Learning Complex Motor Skills with Augmented Reality Through the Example of Juggling
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction techniques

Recommendations

Juggling in VR: Advantages of Immersive Virtual Reality in Juggling Learning
VRST '19: Proceedings of the 25th ACM Symposium on Virtual Reality Software and Technology

In this paper, we follow up on research dealing with motion learning in Virtual Reality (VR). We investigate the impact of VR motion learning on motion performance, motivation for motion learning and willingness to continue with the motion learning. In ...
Multimodal augmented reality: the norm rather than the exception
MVAR '16: Proceedings of the 2016 workshop on Multimodal Virtual and Augmented Reality

Augmented reality (AR) is commonly seen as a technology that overlays virtual imagery onto a participant's view of the world. In line with this, most AR research is focused on what we see. In this paper, we challenge this focus on vision and make a case ...
A study of comparing the use of augmented reality and physical models in chemistry education
VRCIA '06: Proceedings of the 2006 ACM international conference on Virtual reality continuum and its applications

Augmented reality (AR) is an emerging technology, which renders three-dimensional (3-D) virtual objects and allows people to interact with virtual and real objects at the same time. The purpose of this study is to investigate how students interact with ...

Comments

Information & Contributors

Information

Published In

UIST '18 Adjunct: Adjunct Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology

October 2018

251 pages

ISBN:9781450359498

DOI:10.1145/3266037

General Chairs:
Patrick Baudisch
Hasso-Plattner Institute, Germany
,
Albrecht Schmidt
LMU, Germany
,
Program Chair:
Andy Wilson
Microsoft Research, USA

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 October 2018

Check for updates

Author Tags

Qualifiers

Poster

Conference

UIST '18

Sponsor:

UIST '18: The 31st Annual ACM Symposium on User Interface Software and Technology

October 14, 2018

Berlin, Germany

Acceptance Rates

UIST '18 Adjunct Paper Acceptance Rate 80 of 375 submissions, 21%;

Overall Acceptance Rate 842 of 3,967 submissions, 21%

Upcoming Conference

UIST '24

Sponsor:
sigchi
sigchi

The 37th Annual ACM Symposium on User Interface Software and Technology

October 13 - 16, 2024

Pittsburgh , PA , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
326
Total Downloads

Downloads (Last 12 months)35
Downloads (Last 6 weeks)1

Reflects downloads up to 10 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Matsumoto TWu ELiao CKoike H(2024)ARpenSki: Augmenting Ski Training with Direct and Indirect Postural Visualization2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)10.1109/VR58804.2024.00024(1-9)Online publication date: 16-Mar-2024
https://doi.org/10.1109/VR58804.2024.00024
Diller FScheuermann GWiebel A(2024)Visual Cue Based Corrective Feedback for Motor Skill Training in Mixed Reality: A SurveyIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.322799930:7(3121-3134)Online publication date: Jul-2024
https://doi.org/10.1109/TVCG.2022.3227999
Lin TYang WNakagaki K(2023)ThrowIO: Actuated TUIs that Facilitate “Throwing and Catching” Spatial Interaction with Overhanging Mobile Wheeled RobotsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581267(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581267
Vandevoorde KVollenkemper LSchwan CKohlhase MSchenck W(2022)Using Artificial Intelligence for Assistance Systems to Bring Motor Learning Principles into Real World Motor TasksSensors10.3390/s2207248122:7(2481)Online publication date: 23-Mar-2022
https://doi.org/10.3390/s22072481
Borglund FYoung MEriksson JRasmussen A(2021)Feedback from HTC Vive Sensors Results in Transient Performance Enhancements on a Juggling Task in Virtual RealitySensors10.3390/s2109296621:9(2966)Online publication date: 23-Apr-2021
https://doi.org/10.3390/s21092966
Guerrero GGomez LAchig J(2020)Holonote: Text editor of augmented reality oriented to people with motor disabilities2020 15th Iberian Conference on Information Systems and Technologies (CISTI)10.23919/CISTI49556.2020.9140857(1-7)Online publication date: Jun-2020
https://doi.org/10.23919/CISTI49556.2020.9140857
Adolf JKán POutram BKaufmann HDoležal JLhotská L(2019)Juggling in VR: Advantages of Immersive Virtual Reality in Juggling LearningProceedings of the 25th ACM Symposium on Virtual Reality Software and Technology10.1145/3359996.3364246(1-5)Online publication date: 12-Nov-2019
https://dl.acm.org/doi/10.1145/3359996.3364246

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Juggling in VR: Advantages of Immersive Virtual Reality in Juggling Learning

Multimodal augmented reality: the norm rather than the exception

A study of comparing the use of augmented reality and physical models in chemistry education