BitoBody: Real-time human contact detection and dynamic projection system
Article No.: 39, Pages 1 - 4
Abstract
In this research, we propose a novel human body contact detection and projection system with dynamic mesh collider. We use motion capture camera and generated human 3D models to detect the contact between user's bodies. Since it is difficult to update human mesh collider every frame, a special algorithm that divides body meshes into small pieces of polygons to do collision detection is developed and detected hit information will be dynamically projected according to its magnitude of damage. The maximum deviation of damage projection is about 7.9cm under a 240-fps optitrack motion capture system and 12.0cm under a 30-fps Kinect camera. The proposed system can be used in various sports where bodies come in contact and it allows the audience and players to understand the context easier.
References
[1]
Manuel Bastioni, Simone Re, and Shakti Misra. 2008. Ideas and Methods for Modeling 3D Human Figures: The Principal Algorithms Used by MakeHuman and Their Implementation in a New Approach to Parametric Modeling. In Proceedings of the 1st Bangalore Annual Compute Conference (COMPUTE '08). ACM, New York, NY, USA, Article 10, 6 pages.
[2]
John Canny. 1986. Collision detection for moving polyhedra. IEEE Transactions on Pattern Analysis and Machine Intelligence 2 (1986), 200--209.
[3]
Ed H Chi. 2005. Introducing wearable force sensors in martial arts. IEEE Pervasive Computing 3 (2005), 47--53.
[4]
Ed H Chi, Jin Song, and Greg Corbin. 2004. Killer App of wearable computing: wireless force sensing body protectors for martial arts. In Proceedings of the 17th annual ACM symposium on User interface software and technology. ACM, 277--285.
[5]
Thuong Hoang, Martin Reinoso, Zaher Joukhadar, Frank Vetere, and David Kelly. 2017. Augmented Studio: Projection Mapping on Moving Body for Physiotherapy Education. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 1419--1430.
[6]
Shahram Izadi, David Kim, Otmar Hilliges, David Molyneaux, Richard Newcombe, Pushmeet Kohli, Jamie Shotton, Steve Hodges, Dustin Freeman, Andrew Davison, et al. 2011. KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera. In Proceedings of the 24th annual ACM symposium on User interface software and technology. ACM, 559--568.
[7]
MakeHuman team 2018. MakeHuman. MakeHuman team. http://www.makehuman.org/.
[8]
Dushyant Mehta, Srinath Sridhar, Oleksandr Sotnychenko, Helge Rhodin, Mohammad Shafiei, Hans-Peter Seidel, Weipeng Xu, Dan Casas, and Christian Theobalt. 2017. Vnect: Real-time 3d human pose estimation with a single rgb camera. ACM Transactions on Graphics (TOG) 36, 4 (2017), 44.
[9]
Shio Miyafuji, Masato Sugasaki, and Hideki Koike. 2016. Ballumiere: Real-Time Tracking and Spherical Projection for High-Speed Moving Balls. In Proceedings of the 2016 ACM on Interactive Surfaces and Spaces. ACM, 33--37.
[10]
Natural Point. 2011. Optitrack. Natural Point, Inc.,{Online}. Available: http://www.naturalpoint. com/optitrack/.{Accessed 22 2 2014} (2011).
[11]
Munehiko Sato, Ivan Poupyrev, and Chris Harrison. 2012. Touché: enhancing touch interaction on humans, screens, liquids, and everyday objects. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 483--492.
[12]
Unity Technologies 2018. Unity. Unity Technologies. https://unity3d.com/.
[13]
Andrew D Wilson. 2010. Using a depth camera as a touch sensor. In ACM international conference on interactive tabletops and surfaces. ACM, 69--72.
[14]
Andrew D Wilson and Hrvoje Benko. 2010. Combining multiple depth cameras and projectors for interactions on, above and between surfaces. In Proceedings of the 23nd annual ACM symposium on User interface software and technology. ACM, 273--282.
[15]
Zhengyou Zhang. 2012. Microsoft Kinect Sensor and Its Effect. Technical Report. 4--12 pages. https://www.microsoft.com/en-us/research/publication/microsoft-kinect-sensor-and-its-effect/
[16]
Haiyu Zhu, Yao Yu, Yu Zhou, and Sidan Du. 2016. Dynamic human body modeling using a single RGB camera. Sensors 16, 3 (2016), 402.
[17]
Yuko Zou, Leo Miyashita, Tomohiko Hayakawa, Eric Siu, Carson Reynolds, and Masatoshi Ishikawa. 2013. i-me TOUCH: detecting human touch interaction. In ACM SIGGRAPH 2013 Posters. ACM, 35.
Index Terms
- BitoBody: Real-time human contact detection and dynamic projection system
Recommendations
Pmomo: Projection Mapping on Movable 3D Object
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing SystemsWe introduce Pmomo (acronym of projection mapping on movable object), a dynamic projection mapping system that tracks the 6-DOF position of real-world object, and shades it with virtual 3D contents by projection. The system can precisely lock the ...
Stealth Projection: Visually Removing Projectors from Dynamic Projection Mapping
SA '19: SIGGRAPH Asia 2019 PostersIn the present study, we propose a stealth projection method that visually removes the ProCam system in dynamic projection mapping (DPM). In recent years, DPM has been actively studied to change the appearance of moving and deforming objects by image ...
Dynamic projection mapping on deformable stretchable materials using boundary tracking
AbstractWe present the first method for dynamic projection mapping on rectangular, deformable and stretchable elastic materials using consumer-grade time of flight (ToF) depth cameras. We use a B-Spline patch to model the projection surface ...
Graphical abstractDisplay Omitted
Highlights- Exploit properties of rational B-spline patches to model the projection surface.
Comments
Information & Contributors
Information
Published In
March 2019
301 pages
ISBN:9781450365475
DOI:10.1145/3311823
Copyright © 2019 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 11 March 2019
Check for updates
Author Tags
Qualifiers
- Short-paper
- Research
- Refereed limited
Conference
AH2019
Acceptance Rates
AH2019 Paper Acceptance Rate 26 of 53 submissions, 49%;
Overall Acceptance Rate 121 of 306 submissions, 40%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 159Total Downloads
- Downloads (Last 12 months)6
- Downloads (Last 6 weeks)3
Reflects downloads up to 09 Nov 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in