research-article

Shake'n'sense: reducing interference for overlapping structured light depth cameras

Authors:

David KimAuthors Info & Claims

CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 1933 - 1936

https://doi.org/10.1145/2207676.2208335

Published: 05 May 2012 Publication History

Get Access

Abstract

We present a novel yet simple technique that mitigates the interference caused when multiple structured light depth cameras point at the same part of a scene. The technique is particularly useful for Kinect, where the structured light source is not modulated. Our technique requires only mechanical augmentation of the Kinect, without any need to modify the internal electronics, firmware or associated host software. It is therefore simple to replicate. We show qualitative and quantitative results highlighting the improvements made to interfering Kinect depth signals. The camera frame rate is not compromised, which is a problem in approaches that modulate the structured light source. Our technique is non-destructive and does not impact depth values or geometry. We discuss uses for our technique, in particular within instrumented rooms that require simultaneous use of multiple overlapping fixed Kinect cameras to support whole room interactions.

References

[1]

Berthouzoz, F., Fattal, R., Resolution Enhancement by Vibrating Displays, To Appear ACM TOG 2012.

Digital Library

Google Scholar

[2]

Hartley, R. and Zisserman, A. Multiple View Geometry in Computer Vision. Cambridge University Press.

Digital Library

Google Scholar

[3]

Michael Kazhdan, Matthew Bolitho, and Hugues Hoppe. 2006. Poisson surface reconstruction. In Proc. Geometry processing (SGP '06). Eurographics, 61--70.

Digital Library

Google Scholar

[4]

Kinect Hacks, http://www.kinecthacks.net/

Google Scholar

[5]

Maimone, A. and Fuchs, H. Encumbrance-free Telepresence System with Real-time 3D Capture and Display using Commodity Depth Cameras, In Proc. ISMAR '11.

Digital Library

Google Scholar

[6]

A. Maimone and H. Fuchs. Reducing Interference Between Multiple Structured Light Depth Sensors Using Motion. To appear in IEEE Virtual Reality 2012.

Digital Library

Google Scholar

[7]

Wilson, A., and Benko, H. Combining Multiple Depth Cameras and Projectors for Interactions On, Above, and Between Surfaces. In Proceedings UIST 2010.

Digital Library

Google Scholar

Cited By

View all

Kamble TMahajan SKulkarni A(2023)Enhanced 3D Scene Reconstruction Using Synchronized Multiple Kinect Depth Cameras2023 IEEE Pune Section International Conference (PuneCon)10.1109/PuneCon58714.2023.10450079(1-4)Online publication date: 14-Dec-2023
https://doi.org/10.1109/PuneCon58714.2023.10450079
Kamble TMahajan S(2022)3D Vision Using Multiple Structured Light-Based Kinect Depth CamerasInternational Journal of Image and Graphics10.1142/S021946782450001324:01Online publication date: 21-Sep-2022
https://doi.org/10.1142/S0219467824500013
Ubina NCheng SChang CCai SLan HLu H(2022)Intelligent Underwater Stereo Camera Design for Fish Metric Estimation Using Reliable Object MatchingIEEE Access10.1109/ACCESS.2022.318575310(74605-74619)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3185753
Show More Cited By

Index Terms

Shake'n'sense: reducing interference for overlapping structured light depth cameras
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Hybrid HFR Depth: Fusing Commodity Depth and Color Cameras to Achieve High Frame Rate, Low Latency Depth Camera Interactions
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

The low frame rate and high latency of consumer depth cameras limits their use in interactive applications. We propose combining the Kinect depth camera with an ordinary color camera to synthesize a high frame rate and low latency depth image. We ...
High Quality Photometric Reconstruction Using a Depth Camera
CVPR '14: Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition

In this paper we present a depth-guided photometric 3D reconstruction method that works solely with a depth camera like the Kinect. Existing methods that fuse depth with normal estimates use an external RGB camera to obtain photometric information and ...
Modelling and accuracy estimation of a new omnidirectional depth computation sensor

Depth computation is an attractive feature in computer vision. The use of traditional perspective cameras for panoramic perception requires several images, most likely implying the use of several cameras or of a sensor with mobile elements. Moreover, ...

Comments

Information & Contributors

Information

Published In

CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

May 2012

3276 pages

ISBN:9781450310154

DOI:10.1145/2207676

General Chair:
Joseph A. Konstan
University of Minnesota
,
Program Chairs:
Ed H. Chi
Google
,
Kristina Höök
Mobile Life at KTH

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 May 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '12

Sponsor:

SIGCHI

CHI '12: CHI Conference on Human Factors in Computing Systems

May 5 - 10, 2012

Texas, Austin, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

80
Total Citations
View Citations
1,214
Total Downloads

Downloads (Last 12 months)15
Downloads (Last 6 weeks)3

Reflects downloads up to 01 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Kamble TMahajan SKulkarni A(2023)Enhanced 3D Scene Reconstruction Using Synchronized Multiple Kinect Depth Cameras2023 IEEE Pune Section International Conference (PuneCon)10.1109/PuneCon58714.2023.10450079(1-4)Online publication date: 14-Dec-2023
https://doi.org/10.1109/PuneCon58714.2023.10450079
Kamble TMahajan S(2022)3D Vision Using Multiple Structured Light-Based Kinect Depth CamerasInternational Journal of Image and Graphics10.1142/S021946782450001324:01Online publication date: 21-Sep-2022
https://doi.org/10.1142/S0219467824500013
Ubina NCheng SChang CCai SLan HLu H(2022)Intelligent Underwater Stereo Camera Design for Fish Metric Estimation Using Reliable Object MatchingIEEE Access10.1109/ACCESS.2022.318575310(74605-74619)Online publication date: 2022
https://doi.org/10.1109/ACCESS.2022.3185753
Lee JGupta M(2021)Blocks-World Cameras2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR46437.2021.01125(11407-11417)Online publication date: Jun-2021
https://doi.org/10.1109/CVPR46437.2021.01125
Garcia-Salguero MGonzalez-Jimenez JMoreno F(2019)Human 3D Pose Estimation with a Tilting Camera for Social Mobile Robot InteractionSensors10.3390/s1922494319:22(4943)Online publication date: 13-Nov-2019
https://doi.org/10.3390/s19224943
Aalerud ADybedal JHovland G(2019)Automatic Calibration of an Industrial RGB-D Camera Network Using Retroreflective Fiducial MarkersSensors10.3390/s1907156119:7(1561)Online publication date: 31-Mar-2019
https://doi.org/10.3390/s19071561
Williams SAhn CGunc HOzgirin EPearce MXiong Z(2019)Evaluating sensors for the measurement of public life: A future in image processingEnvironment and Planning B: Urban Analytics and City Science10.1177/239980831985263646:8(1534-1548)Online publication date: 14-Sep-2019
https://doi.org/10.1177/2399808319852636
Meruvia-Pastor O(2019)Enhancing 3D Capture with Multiple Depth Camera Systems: A State-of-the-Art ReportRGB-D Image Analysis and Processing10.1007/978-3-030-28603-3_7(145-166)Online publication date: 27-Oct-2019
https://doi.org/10.1007/978-3-030-28603-3_7
Atapour-Abarghouei ABreckon T(2019)Dealing with Missing Depth: Recent Advances in Depth Image Completion and EstimationRGB-D Image Analysis and Processing10.1007/978-3-030-28603-3_2(15-50)Online publication date: 27-Oct-2019
https://doi.org/10.1007/978-3-030-28603-3_2
Palovuori KRakkolainen I(2018)Improved Interaction for Mid-Air Projection Screen TechnologyVirtual and Augmented Reality10.4018/978-1-5225-5469-1.ch082(1742-1761)Online publication date: 2018
https://doi.org/10.4018/978-1-5225-5469-1.ch082
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Hybrid HFR Depth: Fusing Commodity Depth and Color Cameras to Achieve High Frame Rate, Low Latency Depth Camera Interactions

High Quality Photometric Reconstruction Using a Depth Camera

Modelling and accuracy estimation of a new omnidirectional depth computation sensor