poster

FroggyHand: A Gesture Based Control System for Omni-Directional Projections

Authors:

Hideki KoikeAuthors Info & Claims

AHs '22: Proceedings of the Augmented Humans International Conference 2022

Pages 298 - 300

https://doi.org/10.1145/3519391.3524027

Published: 18 April 2022 Publication History

Get Access

Abstract

We would like to introduce FroggyHand, a novel interactive display which projects images onto a webbed skin between the user’s fingers. Applications connected to these images are then activated via hand tracking and gesture recognition. We present the implementation steps as well as small, prototype applications and discuss future plans.

Supplementary Material

MP4 File (FroggyHand.mp4)

Supplemental video

Download
49.07 MB

MP4 File (FroggyHandPresentationVideo.mp4)

Presentation video

Download
14.03 MB

References

[1]

Huidong Bai, Lei Gao, Jihad El-Sana, and Mark Billinghurst. 2013. Free-hand interaction for handheld augmented reality using an RGB-depth camera. In SIGGRAPH Asia 2013 Symposium on Mobile Graphics and Interactive Applications. 1–4.

Digital Library

Google Scholar

[2]

Ivan Grishchenko and RE Valentin Bazarevsky. 2020. MediaPipe Holistic—Simultaneous Face, Hand and Pose Prediction, on Device. Retrieved June 15(2020), 2021.

Google Scholar

[3]

Kosuke Maeda, Mitski Piekenbrock, Toshiki Sato, and Hideki Koike. 2018. A Tabletop System Using an OmniDirectional Projector-Camera. In Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces. 311–314.

Digital Library

Google Scholar

[4]

Leo Miyashita, Tomohiro Yamazaki, Kenji Uehara, Yoshihiro Watanabe, and Masatoshi Ishikawa. 2018. Portable lumipen: Dynamic sar in your hand. In 2018 IEEE International Conference on Multimedia and Expo (ICME). IEEE, 1–6.

Crossref

Google Scholar

[5]

Munir Oudah, Ali Al-Naji, and Javaan Chahl. 2020. Hand gesture recognition based on computer vision: a review of techniques. journal of Imaging 6, 8 (2020), 73.

Google Scholar

[6]

Jesus Suarez and Robin R Murphy. 2012. Hand gesture recognition with depth images: A review. In 2012 IEEE RO-MAN: the 21st IEEE international symposium on robot and human interactive communication. IEEE, 411–417.

Crossref

Google Scholar

[7]

Luna Takagi, Toshiki Sato, Shio Miyafuji, and Hideki Koike. 2021. Real-time Projection of Lip Animation onto Face Masks using OmniProcam. In ACM SIGGRAPH 2021 Posters. 1–2.

Digital Library

Google Scholar

[8]

Mais Yasen and Shaidah Jusoh. 2019. A systematic review on hand gesture recognition techniques, challenges and applications. PeerJ Computer Science 5(2019), e218.

Crossref

Google Scholar

Recommendations

A gesture control system for intuitive 3D interaction with virtual objects
VRCAI 08

We present a system for interacting with 3D objects in a 3D virtual environment. Using the notion that a typical head-mounted display (HMD) does not cover the user's entire face, we use a fiducial marker placed on the HMD to locate the user's exposed ...
The Gesture Authoring Space: Authoring Customised Hand Gestures for Grasping Virtual Objects in Immersive Virtual Environments
MuC '22: Proceedings of Mensch und Computer 2022

Natural user interfaces are on the rise. Manufacturers for Augmented, Virtual, and Mixed Reality head mounted displays are increasingly integrating new sensors into their consumer grade products, allowing gesture recognition without additional hardware. ...
Interaction Without Gesture or Speech -- A Gaze Controlled AR System
ICAT '07: Proceedings of the 17th International Conference on Artificial Reality and Telexistence

Even though gaze control is relatively well known as a human computer interaction method, gaze control is not a widely used technique, partly due to several usability issues. However, there are applications that can be improved with the use of eye gaze ...

Comments

Information & Contributors

Information

Published In

AHs '22: Proceedings of the Augmented Humans International Conference 2022

March 2022

350 pages

ISBN:9781450396325

DOI:10.1145/3519391

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 April 2022

Check for updates

Author Tags

Qualifiers

Poster
Research
Refereed limited

Funding Sources

JSPS Kaken-hi

Conference

AHs 2022

AHs 2022: Augmented Humans 2022

March 13 - 15, 2022

Kashiwa, Chiba, Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

0
Total Citations
84
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)1

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Abstract

Supplementary Material

References

Recommendations

A gesture control system for intuitive 3D interaction with virtual objects

The Gesture Authoring Space: Authoring Customised Hand Gestures for Grasping Virtual Objects in Immersive Virtual Environments

Interaction Without Gesture or Speech -- A Gaze Controlled AR System

Comments

Information

Published In

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Login options

Full Access

View options

PDF

eReader

HTML Format

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations