Real-time walkthrough of outdoor scenes using TRI-view morphing
Authors: 
Qianqian Li, Yu Zhou, Yao Yu, Sidan Du, Ziqiang WangAuthors Info & Claims
Qianqian Li, Yu Zhou, Yao Yu, Sidan Du, Ziqiang WangAuthors Info & ClaimsPages 2921 - 2925
Abstract
In this paper, an image-based walkthrough system is presented for navigating real-world outdoor scenes based on only three uncalibrated images without reconstructing 3D model. An image-based rendering operation is performed on these sample images and generates photorealistic in-between views in real time. We extend the traditional two-step view morphing to real-time tri-view morphing based on epipolar constraint. Compared with other tri-view morphing methods, our scheme copes well with both complex outdoor scenes and wide baseline scenes, which also poses a qualified alternative to state-of-the-art dense 3D reconstruction. Putting on a head mount display (HMD) like Oculus Rift, user can experience realistic and immersive exploration of real-world scenes.
6. References
[1]
Harry Shum and Sing B Kang, “Review of image-based rendering techniques,” in Visual Communications and Image Processing 2000. International Society for Optics and Photonics, 2000, pp. 2–13.
[2]
Christoph Fehn, “Depth-image-based rendering (dibr), compression, and transmission for a new approach on 3d-tv,” in Electronic Imaging 2004. International Society for Optics and Photonics, 2004, pp. 93–104.
[3]
Gaurav Chaurasia, Sylvain Duchene, Olga Sorkine-Hornung, and George Drettakis, “Depth synthesis and local warps for plausible image-based navigation,” ACM Transactions on Graphics (TOG), vol. 32, no. 3, pp. 30, 2013.
[4]
Konstantinos Rematas, Tobias Ritschel, Mario Fritz, and Tinne Tuytelaars, “Image-based synthesis and resynthesis of viewpoints guided by 3d models,” in 2014 IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 2014, pp. 3898–3905.
[5]
Chong Wang, Zhen-Yu Zhu, Shing-Chow Chan, and Heung-Yeung Shum, “Real-time depth image acquisition and restoration for image based rendering and processing systems,” Journal of Signal Processing Systems, vol. 79, no. 1, pp. 1–18, 2015.
[6]
Marc Levoy and Pat Hanrahan, “Light field rendering,” in Proceedings of the 23rd annual conference on Computer graphics and interactive techniques. ACM, 1996, pp. 31–42.
[7]
Fu-Chung Huang, Kevin Chen, and Gordon Wet-zstein, “The light field stereoscope: immersive computer graphics via factored near-eye light field displays with focus cues,” ACM Transactions on Graphics (TOG), vol. 34, no. 4, pp. 60, 2015.
[8]
Steven J Gortler, Radek Grzeszczuk, Richard Szeliski, and Michael F Cohen, “The lumigraph,” in Proceedings of the 23rd annual conference on Computer graphics and interactive techniques. ACM, 1996, pp. 43–54.
[9]
Seth Berrier, Michael Tetzlaff, Michael Ludwig, and Gary Meyer, “Improved appearance rendering for pho-togrammetrically acquired 3d models,” in 2015 Digital Heritage. IEEE, 2015, vol. 1, pp. 255–262.
[10]
Seitz, M. Steven Dyer, and R. Charles, “View morphing,” In Proceedings of Computer Graphics (SIG-GRAPH 96, pp. 21–30, 1999.
[11]
Russell A Manning and Charles R Dyer, “Interpolating view and scene motion by dynamic view morphing,” in Computer Vision and Pattern Recognition, 1999. IEEE Computer Society Conference on. IEEE, 1999, vol. 1.
[12]
Tobias Gurdan, Martin R Oswald, Daniel Gurdan, and Daniel Cremers, “Spatial and temporal interpolation of multi-view image sequences,” in German Conference on Pattern Recognition. Springer, 2014, pp. 305–316.
[13]
Jiangjian Xiao and Mubarak Shah, “Tri-view morphing,” Computer Vision and Image Understanding, vol. 96, no. 3, pp. 345–366, 2004.
[14]
Pin Chatkaewmanee and Matthew Nelson Dailey, “Ob-ject virtual viewing using adaptive tri-view morphing,” IET Image Processing, vol. 7, no. 6, pp. 586–595, 2013.
[15]
Jonathan Richard Shewchuk, “Triangle: Engineering a 2d quality mesh generator and delaunay triangulator,” in Applied computational geometry towards geometric engineering, pp. 203–222. Springer, 1996.
[16]
Kaname Tomite, Kazumasa Yamazawa, and Naokazu Yokoya, “Arbitrary viewpoint rendering from multiple omnidirectional images for interactive walkthroughs,” in Pattern Recognition, 2002. Proceedings. 16th International Conference on. IEEE, 2002, vol. 3, pp. 987–990.
[17]
Hideo Saito, Makoto Kimura, Satoshi Yaguchi, and Na-ho Inamoto, “View interpolation of multiple cameras based on projective geometry,” in International Workshop on Pattern Recognition and Understanding for Visual Information Media, 2002.
[18]
Charles Loop and Zhengyou Zhang, “Computing rectifying homographies for stereo vision,” in Computer Vision and Pattern Recognition, 1999. IEEE Computer Society Conference on, 1999, p. 1125.
[19]
Mikhail G Mozerov and Joost van de Weijer, “Accu-rate stereo matching by two-step energy minimization,” IEEE Transactions on Image Processing, vol. 24, no. 3, pp. 1153–1163, 2015.
[20]
Pasqualina Fragneto, Andrea Fusiello, Beatrice Rossi, Luca Magri, and Matteo Ruffini, “Uncalibrated view synthesis with homography interpolation,” in 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission. IEEE, 2012, pp. 270–277.
[21]
Dragomir Anguelov, Carole Dulong, Daniel Filip, Christian Frueh, Stéphane Lafon, Richard Lyon, Abhijit Ogale, Luc Vincent, and Josh Weaver, “Google street view: Capturing the world at street level,” 2010.
Index Terms
- Real-time walkthrough of outdoor scenes using TRI-view morphing
Index terms have been assigned to the content through auto-classification.
Recommendations
Tri-view morphing
Model-based and image-based 3D scene representation for interactive visalizationThis paper presents an efficient image-based approach to navigate a scene based on only three wide-baseline uncalibrated images without the explicit use of a 3D model. After automatically recovering corresponding points between each pair of images, an ...
Real-time multi-view 3d object tracking in cluttered scenes
ISVC'06: Proceedings of the Second international conference on Advances in Visual Computing - Volume Part IIThis paper presents an approach to real-time 3D object tracking in cluttered scenes using multiple synchronized and calibrated cameras. The goal is to accurately track targets over a long period of time in the presence of complete occlusion in some of ...
Panorama image interpolation for real-time walkthrough
SIGGRAPH '16: ACM SIGGRAPH 2016 PostersWe propose a method to generate new views of a scene by capturing a few panorama images in real space and interpolating captured images. We describe a procedure for interpolating panoramas captured at four corners of a rectangle area without geometry, ...
Comments
Information & Contributors
Information
Published In
Sep 2017
4869 pages
Copyright © 2017.
Publisher
IEEE Press
Publication History
Published: 17 September 2017
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 26 Jan 2025