Article

Outdoor See-Through Vision Utilizing Surveillance Cameras

Authors:

Yoshinari Kameda,

Taisuke Takemasa,

Yuichi OhtaAuthors Info & Claims

ISMAR '04: Proceedings of the 3rd IEEE/ACM International Symposium on Mixed and Augmented Reality

Pages 151 - 160

https://doi.org/10.1109/ISMAR.2004.45

Published: 02 November 2004 Publication History

Abstract

This paper presents a new outdoor mixed-reality system designed for people who carry a camera-attached small handy device in an outdoor scene where a number of surveillance cameras are embedded. We propose a new functionality in outdoor mixed reality that the handy device can display live status of invisible areas hidden by some structures such as buildings, walls, etc. The function is implemented on a camera-attached, small handy subnotebook PC (HPC). The videos of the invisible areas are taken by surveillance cameras and they are precisely overlapped on the video of HPC camera, hence a user can notice objects in the invisible areas and see directly what the objects do. We utilize surveillance cameras for two purposes. (1) They obtain videos of invisible areas. The videos are trimmed and warped so as to impose them into the video of the HPC camera. (2) They are also usedfor updating textures of calibration markers in order to handle possible texture changes in real outdoor world. We have implemented a preliminary system with four surveillance cameras and proved that our system can visualize invisible areas in real time.

References

[1]

Y. Baillot, S. J. Julier, D. Brown, and M. A. Livingston. A tracker alignment framework for augmented reality. International Symposium on Mixed and Augmented Reality, pages 142-150, 2003.

Digital Library

[2]

G. Baratoff, A. Neubeck, and H. Regenbrecht. Interactive multi-marker calibration for augmented reality applications. International Symposium on Mixed and Augmented Reality, pages 107-116, 2002.

Digital Library

[3]

R. Behringer, J. Park, and V. Sundareswaran. Model-based visual tracking for outdoor augmented reality applications. International Symposium on Mixed and Augmented Reality, pages 277-278, 2002.

Digital Library

[4]

P. J. Besl and N. D. Mckay. A method for registration of 3-d shapes. IEEE Transactions on PAMI, 14(2):239-256, 1992.

Digital Library

[5]

D. Brown, S. Julier, Y. Baillot, and M. A. Livingston. An event-based data distribution mechanism for collaborative mobile augmented reality and virtual environments. Proceedings of IEEE Virtual Reality (VR2003), pages 23-29, 2003.

Digital Library

[6]

K. W. Chia, A. D. Cheok, and S. J. Prince. Online 6dof augmented reality registration from natual features. International Symposium on Mixed and Augmented Reality, pages 305-313, 2002.

Digital Library

[7]

A. I. Comport, Éric Marchand, and F. Chaumette. A real-time tracker for markerless augmented reality. International Symposium on Mixed and Augmented Reality , pages 36-45, 2003.

Digital Library

[8]

Y. Cui and S. S. Ge. Autonomous vehicle positioning with gps in urban canyon environments. IEEE Transactions on Robotics and Automation, 19(1):15- 25, 2003.

[9]

V. Ferrari, T. Tuytelaars, and L. V. Gool. Markerless augmented reality with a real-time affine region tracker. International Symposium on Argumented Reality , pages 87-96, 2001.

Digital Library

[10]

E. Ichihara, H. Takao, and Y. Ohta. Bird's-eye view for highway drivers using roadside cameras. IEEE International Conference on Multimedia Computing and Systems, 2:640-645, 1999.

Digital Library

[11]

B. Jiang, U. Neumann, and S. You. A robust hybrid tracking system for outdoor augmented reality. IEEE Virtual Reality, pages 3-10, 2004.

Digital Library

[12]

G. Klein and T. Drummond. Robust visual tracking for non-instrumented augumented reality. International Symposium on Mixed and Augmented Reality, pages 113-122, 2003.

Digital Library

[13]

M. Kourogi and T. Kurata. A method of personal positioning based on sensor data fusion of wearable camera and self-contained sensors. Proceedings of IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI2003), pages 287-292, 2003.

[14]

M. Kourogi and T. Kurata. Personal positioning based on walking locomotion analysis with self-contained sensors and a wearable camera. International Symposium on Mixed and Augmented Reality, pages 103-112, 2003.

Digital Library

[15]

T. Koyama, I. Kitahara, and Y. Ohta. Live mixed-reality 3d video in soccer stadium. International Symposium on Mixed and Augmented Reality, pages 178- 187, 2003.

Digital Library

[16]

J. Krösche, J. Baldzer, and S. Boll. Mobidenk - mobile multimedia in monument conservation. IEEE Multi-media , 11(2):72-77, April-June 2004.

Digital Library

[17]

R. Kumar, H. S. Sawhney, Y. Guo, S. Hsu, and S. Samarasekara. 3d manipulation of motion imagery. International Conference on Image Processing, 1:17- 20, 2000.

[18]

W. Pasman and C. Woodward. Implementation of an augmented reality system on a pda. International Symposium on Mixed and Augmented Reality, pages 276-277, 2003.

Digital Library

[19]

J. N. K. Patrick Dähne. Archeoguide: System architecture of a mobile outdoor augumented reality system. International Symposium on Mixed and Augmented Reality, pages 263-264, 2002.

Digital Library

[20]

W. Piekarski and B. H. Thomas. Tinmith-metro: New outdoor techniques for creating city models with an augmented reality wearable computer. International Symposium on Wearable Computers, pages 31- 38, 2001.

Digital Library

[21]

N. B. Priyantha, A. Chakraborty, and H. Balakrishnan. The cricket location-support system. Proc. 6th ACM International Conference on Mobile Computing and Networking (MOBICOM), pages 32-43, 2000.

Digital Library

[22]

M. Ribo, P. Lang, H. Ganster, M. Brandner, C. Stock, and A. Pinz. Hybrid tracking for outdoor augmented reality applications. IEEE Compuer Graphics and Applications , pages 54-63, November/December 2002.

Digital Library

[23]

K. Satoh, S. Uchiyama, H. Yamamoto, and H. Tamura. Robust vision-based registration utilizing bird's-eye view with user's view. International Symposium on Mixed and Augmented Reality, pages 46-55, 2003.

Digital Library

[24]

I. O. Sebe, J. Hu, S. You, and U. Newmann. 3d video surveillance with augmented virtual environments. ACM SIGMM Workshop on Video Serveillance , pages 107-112, 2003.

Digital Library

[25]

J. Shi and C. Tomasi. Good features to track. IEEE International Conference on Computer Vision and Pattern Recognition (CVPR94), pages 593-600, 1994.

[26]

G. Simon and M.-O. Berger. Reconstructing while registering: a novel approach for markerless augmented reality. International Symposium on Mixed and Augmented Reality, pages 285-294, 2002.

Digital Library

[27]

J. R. Spann and K. S. Kaufman. Photogrammetry using 3d graphics and projective textures. IAPRS, 33(B5/1-V5):748-755, 2000.

[28]

R. Tenmoku, M. Kanbara, and N. Yokoya. A wearable augmented reality system using positioning infrastructures and a pedometer. Proceedings of IEEE International Symposium on Wearable Computers, pages 110-117, 2003.

Digital Library

[29]

C. Tomasi and T. Kanade. Detection and tracking of point features. Carnegie Mellon University Technical Report CMU-CS-91-132, April 1991.

[30]

S. Uchiyama, K. Takemoto, K. Satoh, H. Yamamoto, and H. Tamura. Mr platform: A basic body on which mixed reality applications are built. International Symposium on Mixed and Augmented Reality, pages 246-253, 2003.

Digital Library

[31]

D. Wagner and D. Schmalstieg. First steps towards handheld augmented reality. International Symposium on Wearable Computers, pages 127-135, 2003.

Digital Library

[32]

X. Zhang, S. Fronz, and N. Navab. Visual marker detection and decoding in ar systems: A comparative studay. International Symposium on Mixed and Augmented Reality, pages 97-106, 2002.

Digital Library

Cited By

Tran MTran M(2023)Anomaly Event Retrieval System from TV News and Surveillance CamerasProceedings of the 12th International Symposium on Information and Communication Technology10.1145/3628797.3628891(953-959)Online publication date: 7-Dec-2023
https://dl.acm.org/doi/10.1145/3628797.3628891
Laviola EGattullo MEvangelista AFiorentino MUva A(2023)In-situ or side-by-side? A user study on augmented reality maintenance instructions in blind areasComputers in Industry10.1016/j.compind.2022.103795144:COnline publication date: 1-Jan-2023
https://dl.acm.org/doi/10.1016/j.compind.2022.103795
Zhang CXi MAdcock M(2021)Improving Visual Search Tasks by Bending the Virtual City Twins: A Preliminary Study in Virtual RealityProceedings of the 33rd Australian Conference on Human-Computer Interaction10.1145/3520495.3520528(252-256)Online publication date: 30-Nov-2021
https://dl.acm.org/doi/10.1145/3520495.3520528
Show More Cited By

Outdoor See-Through Vision Utilizing Surveillance Cameras
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision tasks
      2. Image and video acquisition
  2. Computer graphics
    1. Graphics systems and interfaces
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms

Recommendations

Stereo vision using two PTZ cameras

The research of traditional stereo vision is mainly based on static cameras. As PTZ (Pan-Tilt-Zoom) cameras are able to obtain multi-view-angle and multi-resolution information, they have received more and more concern in both research and real ...
Calibrating an Optical See-Through Rig with Two Non-overlapping Cameras: The Virtual Camera Framework
3DIMPVT '12: Proceedings of the 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission

We present a novel extrinsic calibration method for optical see-through systems. It is primarily aimed at tablet-like systems with a semi transparent screen, a camera tracking the user position and another camera analyzing the scene but easily ...
Outdoor mixed reality utilizing surveillance cameras
SIGGRAPH '04: ACM SIGGRAPH 2004 Sketches

An outdoor mixed-reality system designed for pedestrians who carries a camera-attached PDA is presented. Our system utilizes surveillance cameras for two purposes; for showing hidden area to the pedestrians by mixed-reality technology and for updating ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

ISMAR '04: Proceedings of the 3rd IEEE/ACM International Symposium on Mixed and Augmented Reality

November 2004

301 pages

ISBN:0769521916

In-Cooperation

Publisher

IEEE Computer Society

United States

Publication History

Published: 02 November 2004

Check for updates

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
409
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Tran MTran M(2023)Anomaly Event Retrieval System from TV News and Surveillance CamerasProceedings of the 12th International Symposium on Information and Communication Technology10.1145/3628797.3628891(953-959)Online publication date: 7-Dec-2023
https://dl.acm.org/doi/10.1145/3628797.3628891
Laviola EGattullo MEvangelista AFiorentino MUva A(2023)In-situ or side-by-side? A user study on augmented reality maintenance instructions in blind areasComputers in Industry10.1016/j.compind.2022.103795144:COnline publication date: 1-Jan-2023
https://dl.acm.org/doi/10.1016/j.compind.2022.103795
Zhang CXi MAdcock M(2021)Improving Visual Search Tasks by Bending the Virtual City Twins: A Preliminary Study in Virtual RealityProceedings of the 33rd Australian Conference on Human-Computer Interaction10.1145/3520495.3520528(252-256)Online publication date: 30-Nov-2021
https://dl.acm.org/doi/10.1145/3520495.3520528
Erat OIsop WKalkofen DSchmalstieg D(2018)Drone-Augmented Human VisionIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2018.279405824:4(1437-1446)Online publication date: 1-Apr-2018
https://dl.acm.org/doi/10.1109/TVCG.2018.2794058
Santos MSouza Almeida IYamamoto GTaketomi TSandor CKato H(2016)Exploring legibility of augmented reality X-rayMultimedia Tools and Applications10.1007/s11042-015-2954-175:16(9563-9585)Online publication date: 1-Aug-2016
https://dl.acm.org/doi/10.1007/s11042-015-2954-1
Chen JGranier XLin NPeng QBaciu GLau RLin MKomura TPeng Q(2010)On-line visualization of underground structures using context featuresProceedings of the 17th ACM Symposium on Virtual Reality Software and Technology10.1145/1889863.1889898(167-170)Online publication date: 22-Nov-2010
https://dl.acm.org/doi/10.1145/1889863.1889898
Chen IMacDonald BWünsche B(2008)Markerless augmented reality for robotic helicoptor applicationsProceedings of the 2nd international conference on Robot vision10.5555/1787703.1787716(125-138)Online publication date: 18-Feb-2008
https://dl.acm.org/doi/10.5555/1787703.1787716
Avery BThomas BPiekarski W(2008)User evaluation of see-through vision for mobile outdoor augmented realityProceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality10.1109/ISMAR.2008.4637327(69-72)Online publication date: 15-Sep-2008
https://dl.acm.org/doi/10.1109/ISMAR.2008.4637327
Avery BPiekarski WThomas B(2007)Visualizing Occluded Physical Objects in Unfamiliar Outdoor Augmented Reality EnvironmentsProceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality10.1109/ISMAR.2007.4538869(1-2)Online publication date: 13-Nov-2007
https://dl.acm.org/doi/10.1109/ISMAR.2007.4538869
Tenmoku RKanbara MYokoya N(2006)A new view management method for wearable augmented reality systemsProceedings of the 12th Eurographics conference on Virtual Environments10.5555/2386021.2386040(127-134)Online publication date: 8-May-2006
https://dl.acm.org/doi/10.5555/2386021.2386040
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten