poster

Projecting Recorded Expert Hands at Real Size, at Real Speed, and onto Real Objects for Manual Work

Authors:

Genta Suzuki,

Taichi Murase,

Yusaku FujiiAuthors Info & Claims

IUI '16 Companion: Companion Publication of the 21st International Conference on Intelligent User Interfaces

Pages 13 - 17

https://doi.org/10.1145/2876456.2879476

Published: 07 March 2016 Publication History

Get Access

Abstract

Expert manual workers in factories assemble more efficiently than novices because their movements are optimized for the tasks. In this paper, we present an approach to projecting the hand movements of experts at real size, and real speed and onto real objects in order to match the manual work movements of novices to those of experts. We prototyped a projector-camera system, which projects the virtual hands of experts. We conducted a user study in which users worked after watching experts work under two conditions: using a display and using our prototype system. The results show our prototype users worked more precisely and felt the tasks were easier. User ratings also show our prototype users watched videos of experts more fixedly, memorized them more clearly and distinctly tried to work in the same way shown in the videos as compared with display users.

Supplementary Material

suppl.mov (iuidp0105-file3.mp4)

Supplemental video

Download
36.94 MB

References

[1]

Markus Funk, Alireza Sahami Shirazi, Sven Mayer, Lars Lischke, and Albrecht Schmidt. 2015. Pick from here!: an interactive mobile cart using in-situ projection for order picking. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '15). 601--609. http://dx.doi.org/10.1145/2750858.2804268

Digital Library

Google Scholar

[2]

David Kirk and Danae Stanton Fraser. 2006. Comparing remote gesture technologies for supporting collaborative physical tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '06). 11911200. http://dx.doi.org/10.1145/1124772.1124951

Digital Library

Google Scholar

[3]

Oliver Korn, Albrecht Schmidt, and Thomas Hörz. 2013. The potentials of in-situ-projection for augmented workplaces in production: a study with impaired persons. In CHI '13 Extended Abstracts on Human Factors in Computing Systems (CHI EA '13). 979--984. http://dx.doi.org/10.1145/2468356.2468531

Digital Library

Google Scholar

[4]

Katja Rogers, Amrei Röhlig, Matthias Weing, Jan Gugenheimer, Bastian Könings, Melina Klepsch, Florian Schaub, Enrico Rukzio, Tina Seufert, and Michael Weber. 2014. P.I.A.N.O.: Faster Piano Learning with Interactive Projection. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces (ITS '14). 149--158. http://dx.doi.org/10.1145/2669485.2669514.

Digital Library

Google Scholar

[5]

Stephanie Rosenthal, Shaun K. Kane, Jacob O. Wobbrock, and Daniel Avrahami. 2010. Augmenting on-screen instructions with microprojected guides: when it works, and when it fails. In Proceedings of the 12th ACM international sconference on Ubiquitous computing (UbiComp '10). 203--212. http://dx.doi.org/10.1145/1864349.1864391

Digital Library

Google Scholar

[6]

MHD Yamen Saraiji, Charith Lasantha Fernando, Kouta Minamizawa, and Susumu Tachi. 2015. Mutual hand representation for telexistence robots using projected virtual hands. In Proceedings of the 6th Augmented Human International Conference (AH '15). 221--222. http://dx.doi.org/10.1145/2735711.2735777

Digital Library

Google Scholar

[7]

Ayaka Sato, Keita Watanabe, and Jun Rekimoto. 2014. MimiCook: a cooking assistant system with situated guidance. In Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction (TEI '14). 121--124. http://dx.doi.org/10.1145/2540930.2540952

Digital Library

Google Scholar

[8]

Rajinder Sodhi, Hrvoje Benko, and Andrew Wilson. 2012. LightGuide: projected visualizations for hand movement guidance. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). 179--188. http://dx.doi.org/10.1145/2207676.2207702

Digital Library

Google Scholar

[9]

Xiao Xiao, Paula Aguilera, Jonathan Williams, and Hiroshi Ishii. 2013. MirrorFugue iii: conjuring the recorded pianist. In CHI '13 Extended Abstracts on Human Factors in Computing Systems (CHI EA '13). 2891--2892. http://dx.doi.org/10.1145/2468356.2479564

Digital Library

Google Scholar

Cited By

View all

Taninaka IIwai DSato KPunpongsanon P(2023)Development of Training Systems using Spatial Augmented Hand2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW58643.2023.00182(679-680)Online publication date: Mar-2023
https://doi.org/10.1109/VRW58643.2023.00182
Sandnes FEika E(2019)Enhanced Learning of Jazz Chords with a Projector Based Piano Keyboard AugmentationInnovative Technologies and Learning10.1007/978-3-030-35343-8_21(194-203)Online publication date: 18-Nov-2019
https://doi.org/10.1007/978-3-030-35343-8_21
Siriborvornratanakul T(2018)Enhancing User Experiences of Mobile-Based Augmented Reality via Spatial Augmented RealityAdvances in Multimedia10.1155/2018/81947262018Online publication date: 18-Apr-2018
https://dl.acm.org/doi/10.1155/2018/8194726
Show More Cited By

Index Terms

Projecting Recorded Expert Hands at Real Size, at Real Speed, and onto Real Objects for Manual Work
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
2. Information systems
  1. Information systems applications
    1. Multimedia information systems

Recommendations

Assembly of the Virtual Model with Real Hands Using Augmented Reality Technology
Proceedings, Part I, of the 6th International Conference on Virtual, Augmented and Mixed Reality. Designing and Developing Virtual and Augmented Environments - Volume 8525

In the past few years, studying in the field of Augmented Reality AR has been expanded from technical aspect such as tracking system, authoring tools and etc. to applications ranging from the fields of education, entertainment, medicine to ...
Visual search in the (un)real world: how head-mounted displays affect eye movements, head movements and target detection
ETRA '10: Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications

Head-mounted displays (HMDs) that use a see-through display method allow for superimposing computer-generated images upon a real-world view. Such devices, however, normally restrict the user's field of view. Furthermore, low display resolution and ...
Augmenting the feel of real objects: An analysis of haptic augmented reality
Abstract
Advances in haptic technologies can alter how real objects feel to our touch and create the experience of haptic augmented reality (AR). However, the definition, use cases, and value to end users of such haptic AR remain unclear. Existing work is ...
Highlights
- We present an overview of haptic AR from a user-centered perspective rather than a technical perspective.
- With haptic AR literature having little to no evaluations of user experience, we conduct an exploratory study on the concept of ...

Comments

Information & Contributors

Information

Published In

IUI '16 Companion: Companion Publication of the 21st International Conference on Intelligent User Interfaces

March 2016

446 pages

ISBN:9781450341400

DOI:10.1145/2876456

General Chairs:
Jeffrey Nichols
Google Inc, USA
,
Jalal Mahmud
IBM Research, USA
,
John O'Donovan
UC Santa Barbara, USA
,
Program Chairs:
Cristina Conati
University of British Columbia, Canada
,
Massimo Zancanaro
Bruno Kessler Foundation, Italy

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 March 2016

Check for updates

Author Tags

Qualifiers

Poster

Conference

IUI'16

Sponsor:

IUI'16: 21st International Conference on Intelligent User Interfaces

March 7 - 10, 2016

California, Sonoma, USA

Acceptance Rates

IUI '16 Companion Paper Acceptance Rate 49 of 194 submissions, 25%;

Overall Acceptance Rate 746 of 2,811 submissions, 27%

Upcoming Conference

IUI '25

Sponsor:
sigai
sigai

30th International Conference on Intelligent User Interfaces

March 24 - 27, 2025

Cagliari , Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
351
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Taninaka IIwai DSato KPunpongsanon P(2023)Development of Training Systems using Spatial Augmented Hand2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW58643.2023.00182(679-680)Online publication date: Mar-2023
https://doi.org/10.1109/VRW58643.2023.00182
Sandnes FEika E(2019)Enhanced Learning of Jazz Chords with a Projector Based Piano Keyboard AugmentationInnovative Technologies and Learning10.1007/978-3-030-35343-8_21(194-203)Online publication date: 18-Nov-2019
https://doi.org/10.1007/978-3-030-35343-8_21
Siriborvornratanakul T(2018)Enhancing User Experiences of Mobile-Based Augmented Reality via Spatial Augmented RealityAdvances in Multimedia10.1155/2018/81947262018Online publication date: 18-Apr-2018
https://dl.acm.org/doi/10.1155/2018/8194726
Mok TOehlberg LMival OSmyth MDalsgaard P(2017)Critiquing Physical Prototypes for a Remote AudienceProceedings of the 2017 Conference on Designing Interactive Systems10.1145/3064663.3064722(1295-1307)Online publication date: 10-Jun-2017
https://dl.acm.org/doi/10.1145/3064663.3064722
Obinata YSuzuki GMurase TFujii YHancock MMarquardt NSchöning JTory M(2016)Pose Estimation for a Cuboid with Regular Patterns in an Interactive Assembly-support Projection SystemProceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces10.1145/2992154.2996776(331-336)Online publication date: 6-Nov-2016
https://dl.acm.org/doi/10.1145/2992154.2996776

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Assembly of the Virtual Model with Real Hands Using Augmented Reality Technology

Visual search in the (un)real world: how head-mounted displays affect eye movements, head movements and target detection

Augmenting the feel of real objects: An analysis of haptic augmented reality