SmartVP: Viewpoint Optimization Based on Individual Preference for Watching 3D Boxing Punch Videos
Abstract
When broadcasting the 3D boxing punch videos, spectators may have different preferences for spectating. Some people prefer to see the hitting point, while others want to see the punching form. It is not easy to provide a uniformly optimal viewpoint. In this paper, we introduce a novel method to select an optimal viewpoint for watching punching moments in VR that can handle different spectator preferences. We customize a visibility model that utilizes 8 bounding boxes to account for the visibility of upper body parts. We use a neural network classification model to reproduce the optimal viewpoint selection based on the features of body parts visibility, punch side, and punch offset. We collected spectators’ preferred viewpoints from 24 participants under 3 controlled preference conditions: seeing the punch Arm Form clearly (AF), seeing the Facial Expression clearly (FE), and no additional restriction (None). We conducted a user study to evaluate the empirical performance of our system. The training and user study results show that our method can reproduce the optimal viewpoint with spectator preference.
References
[1]
Championship Boxing Preview - Thurman vs Garcia. Retrieved July 20, 2022 from https://subvrsive.com/blog/showtime-championship-boxing-preview-thurman-vs-garcia
[2]
Azure Kinect body tracking joints. Retrieved July 25, 2022 from https://docs.microsoft.com/en-us/azure/kinect-dk/body-joints
[3]
Mojtaba Ahangar Arzati and Siamak Arzanpour. 2021. Viewpoint Selection for DermDrone using Deep Reinforcement Learning. In 2021. 21st International Conference on Control, Automation and Systems (ICCAS). IEEE, 544–553.
[4]
Jackie Assa, Daniel Cohen-Or, I-Cheng Yeh, and Tong-Yee Lee. 2008. Motion overview of human actions. ACM Transactions on Graphics (TOG) 27,5 (2008), 1–10.
[5]
Wei Cheng, Lan Xu, Lei Han, Yuanfang Guo, and Lu Fang. 2018. ihuman3d: Intelligent human body 3d reconstruction using a single flying camera. In Proceedings of the 26th ACM international conference on Multimedia. 1733–1741.
[6]
Marc Christie, Patrick Olivier, and Jean-Marie Normand. 2008. Camera control in computer graphics. In Computer Graphics Forum, Vol. 27. Wiley Online Library, 2197–2218.
[7]
Mingsong Dou, Sameh Khamis, Yury Degtyarev, Philip Davidson, Sean Ryan Fanello, Adarsh Kowdle, Sergio Orts Escolano, Christoph Rhemann, David Kim, Jonathan Taylor, 2016. Fusion4d: Real-time performance capture of challenging scenes. ACM Transactions on Graphics (ToG) 35, 4 (2016), 1–13.
[8]
Petr Doubek. 2005. Multi-view tracking and viewpoint selection. Vol. 39. ETH Zurich.
[9]
Alvin I Goldman. 2015. Theory of human action. Princeton University Press.
[10]
Hou-Ning Hu, Yen-Chen Lin, Ming-Yu Liu, Hsien-Tzu Cheng, Yung-Ju Chang, and Min Sun. 2017. Deep 360 pilot: Learning a deep agent for piloting through 360 sports videos. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 1396–1405.
[11]
Chong Huang, Fei Gao, Jie Pan, Zhenyu Yang, Weihao Qiu, Peng Chen, Xin Yang, Shaojie Shen, and Kwang-Ting Cheng. 2018. Act: An autonomous drone cinematography system for action scenes. In 2018 ieee international conference on robotics and automation (icra). IEEE, 7039–7046.
[12]
Sena Kiciroglu, Helge Rhodin, Sudipta N Sinha, Mathieu Salzmann, and Pascal Fua. 2020. Activemocap: Optimized viewpoint selection for active human motion capture. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 103–112.
[13]
Richard A Newcombe, Dieter Fox, and Steven M Seitz. 2015. Dynamicfusion: Reconstruction and tracking of non-rigid scenes in real-time. In Proceedings of the IEEE conference on computer vision and pattern recognition. 343–352.
[14]
Dmitry Rudoy and Lihi Zelnik-Manor. 2010. Posing to the camera: automatic viewpoint selection for human actions. In Asian Conference on Computer Vision. Springer, 307–320.
Index Terms
- SmartVP: Viewpoint Optimization Based on Individual Preference for Watching 3D Boxing Punch Videos
Recommendations
A Unified Approach to Streamline Selection and Viewpoint Selection for 3D Flow Visualization
We treat streamline selection and viewpoint selection as symmetric problems which are formulated into a unified information-theoretic framework. This is achieved by building two interrelated information channels between a pool of candidate streamlines ...
Action snapshot with single pose and viewpoint
Many art forms present visual content as a single image captured from a particular viewpoint. How to select a meaningful representative moment from an action performance is difficult, even for an experienced artist. Often, a well-picked image can tell a ...
Boxing against drones: Drones in sports education
IDC '16: Proceedings of the The 15th International Conference on Interaction Design and ChildrenThis paper investigates how drones could be integrated into the context of sports, boxing in particular. The goal of this project is to design a drone application that allows direct and embodied interaction. The sport of boxing provides a very ...
Comments
Information & Contributors
Information
Published In
March 2023
207 pages
ISBN:9781450398381
DOI:10.1145/3591156
Copyright © 2023 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 16 June 2023
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
IVSP 2023
IVSP 2023: 2023 5th International Conference on Image, Video and Signal Processing
March 24 - 26, 2023
Singapore, Singapore
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 33Total Downloads
- Downloads (Last 12 months)23
- Downloads (Last 6 weeks)1
Reflects downloads up to 16 Oct 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format