abstract

Light Me Up: An Augmented-Reality Projection System

Authors:

Panagiotis-Alexandros Bokaris,

Benjamin Askenazi,

Michael HaddadAuthors Info & Claims

SA '19: SIGGRAPH Asia 2019 XR

Pages 21 - 22

https://doi.org/10.1145/3355355.3361885

Published: 17 November 2019 Publication History

Get Access

Abstract

Real-time facial projection mapping is a challenging problem due to the low system latency and the high spatial augmentation accuracy requirements. We propose a new compact and inexpensive projector-camera system (ProCam) composed of off-the-self devices that achieves dynamic facial projection mapping. A mini projector and a depth sensor camera are coupled together to project content on a user’s face. In one application, the camera tracks the facial landmarks of a person and simulated makeup is mapped on the person’s face. The latter is created by defining different zones of interest on the face. Instead of using sophisticated hardware, we propose an affordable system that can be easily installed anywhere while it assures an immerse experience. No initialization phase is needed and the system can handle different face topologies. In addition, the users can keep their eyes open and enjoy the projetion in a mirror.

References

[1]

Amit H. Bermano, Markus Billeter, Daisuke Iwai, and Anselm Grundhöfer. 2017. Makeup Lamps: Live Augmentation of Human Faces via Projection. Computer Graphics Forum 36, 2 (May 2017), 311–323. https://doi.org/10.1111/cgf.13128

Crossref

Google Scholar

[2]

Panagiotis-Alexandros Bokaris. 2016. Video-projected augmented reality : Photometric compensation for static and dynamic concealment. Ph.D. Dissertation. http://www.theses.fr/2016SACLS453

Google Scholar

[3]

Anselm Grundhöfer and Daisuke Iwai. 2018. Recent Advances in Projection Mapping Algorithms, Hardware and Applications. Computer Graphics Forum 37, 2 (2018), 653–675. https://doi.org/10.1111/cgf.13387

Crossref

Google Scholar

[4]

Yuri Mikawa, Tomohiro Sueishi, Yoshihiro Watanabe, and Masatoshi Ishikawa. 2018. VarioLight: Hybrid Dynamic Projection Mapping Using High-speed Projector and Optical Axis Controller. In SIGGRAPH Asia 2018 Emerging Technologies(SA ’18). ACM, New York, NY, USA, Article 17, 2 pages. https://doi.org/10.1145/3275476.3275481

Digital Library

Google Scholar

[5]

Yuki Morikubo, Eugene San Lorenzo, Daiki Miyazaki, and Naoki Hashimoto. 2018. Tangible Projection Mapping: Dynamic Appearance Augmenting of Objects in Hands. In SIGGRAPH Asia 2018 Emerging Technologies(SA ’18). ACM, New York, NY, USA, Article 14, 2 pages. https://doi.org/10.1145/3275476.3275494

Digital Library

Google Scholar

[6]

Hiromasa Oku, Masahiro Nomura, Kumi Shibahara, and Akihiro Obara. 2018. Edible Projection Mapping. In SIGGRAPH Asia 2018 Emerging Technologies(SA ’18). ACM, New York, NY, USA, Article 2, 2 pages. https://doi.org/10.1145/3275476.3275486

Digital Library

Google Scholar

[7]

Christian Siegl, Vanessa Lange, Marc Stamminger, Frank Bauer, and Justus Thies. 2017. FaceForge: Markerless Non-Rigid Face Multi-Projection Mapping. IEEE Transactions on Visualization and Computer Graphics 23, 11 (Nov 2017), 2440–2446. https://doi.org/10.1109/TVCG.2017.2734428

Digital Library

Google Scholar

Cited By

View all

Yasui MIwataki RIshikawa MWatanabe Y(2024)Projection Mapping with a Brightly Lit Surrounding Using a Mixed Light Field ApproachIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337213230:5(2217-2227)Online publication date: May-2024
https://doi.org/10.1109/TVCG.2024.3372132
Peng HNishida SWatanabe Y(2023)Studying User Perceptible Misalignment in Simulated Dynamic Facial Projection Mapping2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00064(493-502)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR59233.2023.00064
Cabrera MUsachev IHeredia JTirado JTsetserukou D(2020)MaskBot: Real-time Robotic Projection Mapping with Head Motion TrackingSIGGRAPH Asia 2020 Emerging Technologies10.1145/3415255.3422896(1-2)Online publication date: 4-Dec-2020
https://dl.acm.org/doi/10.1145/3415255.3422896

Index Terms

Light Me Up: An Augmented-Reality Projection System
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
  2. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Mixed / augmented reality
      2. Virtual reality

Index terms have been assigned to the content through auto-classification.

Recommendations

Makeup Creativity Enhancement with an Augmented Reality Face Makeup System
FINAL EDITION

This study presents a novel interactive face makeup system that aims to support users to improve makeup creativity. In this system, facial feature points were tracked by Kinect and mapped to the 3D face model. The makeup tools were developed for ...
Calibration-Free Augmented Reality in Perspective

This paper deals with video-based augmented reality and proposes an algorithm for augmenting a real video sequence with views of graphics objects without metric calibration of the video camera by representing the motion of the video camera in projective ...
Marker Tracking and HMD Calibration for a Video-Based Augmented Reality Conferencing System
IWAR '99: Proceedings of the 2nd IEEE and ACM International Workshop on Augmented Reality

We describe an augmented reality conferencing system which uses the overlay of virtual images on the real world. Remote collaborators are represented on Virtual Monitors which can be freely positioned about a user in space. Users can collaboratively ...

Comments

Information & Contributors

Information

Published In

SA '19: SIGGRAPH Asia 2019 XR

November 2019

47 pages

ISBN:9781450369473

DOI:10.1145/3355355

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 November 2019

Check for updates

Author Tags

Qualifiers

Abstract
Research
Refereed limited

Conference

SA '19

Sponsor:

SIGGRAPH

SA '19: SIGGRAPH Asia 2019

November 17 - 20, 2019

QLD, Brisbane, Australia

Acceptance Rates

Overall Acceptance Rate 178 of 869 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
347
Total Downloads

Downloads (Last 12 months)46
Downloads (Last 6 weeks)0

Reflects downloads up to 30 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Yasui MIwataki RIshikawa MWatanabe Y(2024)Projection Mapping with a Brightly Lit Surrounding Using a Mixed Light Field ApproachIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.337213230:5(2217-2227)Online publication date: May-2024
https://doi.org/10.1109/TVCG.2024.3372132
Peng HNishida SWatanabe Y(2023)Studying User Perceptible Misalignment in Simulated Dynamic Facial Projection Mapping2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00064(493-502)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR59233.2023.00064
Cabrera MUsachev IHeredia JTirado JTsetserukou D(2020)MaskBot: Real-time Robotic Projection Mapping with Head Motion TrackingSIGGRAPH Asia 2020 Emerging Technologies10.1145/3415255.3422896(1-2)Online publication date: 4-Dec-2020
https://dl.acm.org/doi/10.1145/3415255.3422896

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Abstract

References

Cited By

Index Terms

Recommendations

Makeup Creativity Enhancement with an Augmented Reality Face Makeup System

Calibration-Free Augmented Reality in Perspective

Marker Tracking and HMD Calibration for a Video-Based Augmented Reality Conferencing System

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Get Access

Login options

Full Access

View options

PDF

eReader

HTML Format

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations