demonstration

See-through mobile AR system for natural 3D interaction

Authors:

Yuko Unuma,

Takehiro Niikura,

Takashi KomuroAuthors Info & Claims

IUI '14 Companion: Companion Proceedings of the 19th International Conference on Intelligent User Interfaces

Pages 17 - 20

https://doi.org/10.1145/2559184.2559198

Published: 24 February 2014 Publication History

Get Access

Abstract

In this paper, we propose an interaction system which displays see-through images on the mobile display and that allows a user to interact with virtual objects overlaid on the see-through image using the user's hand. In this system, the camera which tracks the user's viewpoint is attached to the front of the mobile display and the depth camera which captures color and depth images of the user's hand and the background scene is attached to the back of the mobile display. Natural interaction with virtual objects using the user's hand is realized by displaying images so that the appearance of a space through the mobile display is consistent with that of the real space from the user's viewpoint. We implemented two applications to the system and showed the usefulness of this system in various AR applications.

References

[1]

M. L. Caballero et al., "Behand: Augmented Virtuality Gestural Interaction for Mobile Phones", Proc. MobileHCI 2010, pp. 451--454, 2010.

Digital Library

Google Scholar

[2]

M. Tomioka et al., "Approximated User-Perspective Rendering in Tablet-Based Augmented Reality", Proc. ISMAR 2013, pp. 21--28, 2013.

Google Scholar

[3]

H. Uchida and T. Komuro, "Geometrically Consistent Mobile AR for 3D Interaction", Proc. AH 2013, pp. 229--230, 2013.

Digital Library

Google Scholar

[4]

D. Baricevic et al., "A Hand-Held AR Magic Lens with User-Perspective Rendering", Proc. ISMAR 2012, pp. 197--206, 2012.

Digital Library

Google Scholar

Cited By

View all

Qin YYu CYao WYao JLiang CWeng YYan YShi Y(2023)Selecting Real-World Objects via User-Perspective Phone OcclusionProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580696(1-13)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580696
Borsoi RCosta G(2018)On the Performance and Implementation of Parallax Free Video See-Through DisplaysIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2017.270518424:6(2011-2022)Online publication date: 1-Jun-2018
https://doi.org/10.1109/TVCG.2017.2705184
Chessa MSolari F(2018)A geometric model of spatial distortions in virtual and augmented environments2018 IEEE International Conference on Image Processing, Applications and Systems (IPAS)10.1109/IPAS.2018.8708861(55-60)Online publication date: Dec-2018
https://doi.org/10.1109/IPAS.2018.8708861
Show More Cited By

Index Terms

See-through mobile AR system for natural 3D interaction
1. Information systems
  1. Information systems applications
    1. Multimedia information systems

Recommendations

Geometrically consistent mobile AR for 3D interaction
AH '13: Proceedings of the 4th Augmented Human International Conference

In this study, we propose a method to present an image that maintains geometric consistency between the actual scene outside the mobile display and the camera image. Thereby, we expect that interaction with the virtual object through the mobile display ...
[POSTER] Natural 3D Interaction Using a See-Through Mobile AR System
ISMAR '15: Proceedings of the 2015 IEEE International Symposium on Mixed and Augmented Reality

In this paper, we propose an interaction system in which the appearance of the image displayed on a mobile display is consistent with that of the real space and that enables a user to interact with virtual objects overlaid on the image using the user's ...
Direct hand touchable interactions in augmented reality environments for natural and intuitive user experiences

Several studies have been carried out on augmented reality (AR)-based environments that deal with user interfaces for manipulating and interacting with virtual objects aimed at improving immersive feeling and natural interaction. Most of these studies ...

Comments

Information & Contributors

Information

Published In

IUI '14 Companion: Companion Proceedings of the 19th International Conference on Intelligent User Interfaces

February 2014

100 pages

ISBN:9781450327299

DOI:10.1145/2559184

General Chairs:
Tsvi Kuflik
The University of Haifa, Israel
,
Oliviero Stock
FBK-IRST, Italy
,
Program Chairs:
Joyce Chai
Michigan State University
,
Antonio Krüger
Saarland University and DFKI GmbH, Germany

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 February 2014

Check for updates

Author Tags

Qualifiers

Demonstration

Conference

IUI'14

Sponsor:

IUI'14: IUI'14 19th International Conference on Intelligent User Interfaces

February 24 - 27, 2014

Haifa, Israel

Acceptance Rates

Overall Acceptance Rate 746 of 2,811 submissions, 27%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
219
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)0

Reflects downloads up to 11 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Qin YYu CYao WYao JLiang CWeng YYan YShi Y(2023)Selecting Real-World Objects via User-Perspective Phone OcclusionProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580696(1-13)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580696
Borsoi RCosta G(2018)On the Performance and Implementation of Parallax Free Video See-Through DisplaysIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2017.270518424:6(2011-2022)Online publication date: 1-Jun-2018
https://doi.org/10.1109/TVCG.2017.2705184
Chessa MSolari F(2018)A geometric model of spatial distortions in virtual and augmented environments2018 IEEE International Conference on Image Processing, Applications and Systems (IPAS)10.1109/IPAS.2018.8708861(55-60)Online publication date: Dec-2018
https://doi.org/10.1109/IPAS.2018.8708861
Mohr PTatzgern MGrubert JSchmalstieg DKalkofen D(2017)Adaptive user perspective rendering for Handheld Augmented Reality2017 IEEE Symposium on 3D User Interfaces (3DUI)10.1109/3DUI.2017.7893336(176-181)Online publication date: 2017
https://doi.org/10.1109/3DUI.2017.7893336
Andersen DPopescu VLin CCabrera MShanghavi AWachs J(2016)A Hand-Held, Self-Contained Simulated Transparent Display2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct)10.1109/ISMAR-Adjunct.2016.0049(96-101)Online publication date: Sep-2016
https://doi.org/10.1109/ISMAR-Adjunct.2016.0049
Andersen DPopescu VCabrera MShanghavi AGomez GMarley SMullis BWachs J(2016)Virtual annotations of the surgical field through an augmented reality transparent displayThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-015-1135-632:11(1481-1498)Online publication date: 1-Nov-2016
https://dl.acm.org/doi/10.1007/s00371-015-1135-6

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Geometrically consistent mobile AR for 3D interaction

[POSTER] Natural 3D Interaction Using a See-Through Mobile AR System

Direct hand touchable interactions in augmented reality environments for natural and intuitive user experiences