This paper introduces the delta tree, a data structure that represents an object using a set of reference images. It also describes an algorithm for generating arbitrary re-projections of an object by traversing its delta tree. Delta trees are an efficient representation in terms of both storage and rendering performance. Each node of a delta tree stores an image taken from a point on a sampling sphere that encloses the object. Each image is compressed by discarding pixels that can be reconstructed by warping its ancestor''s images to the node''s viewpoint. The partial image stored at each node is divided into blocks and represented in the frequency domain. The rendering process generates an image at an arbitrary viewpoint by traversing the delta tree from a root node to one or more of its leaves. A subdivision algorithm selects only the required blocks from the nodes along the path. For each block, only the frequency components necessary to reconstruct the final image at an appropriate sampling density are used. This frequency selection mechanism handles both antialiasing and level-of- detail within a single framework. A complex scene is initially rendered by compositing images generated by traversing the delta trees of its components. Once the reference views of a scene are rendered once in this manner, the entire scene can be reprojected to an arbitrary viewpoint by traversing its own delta tree. Our approach is limited to generating views of an object from outside the object''s convex hull. In practice we work around this problem by subdividing objects to render views from within the convex hull.
Cited By
- Décoret X, Durand F, Sillion F and Dorsey J Billboard clouds for extreme model simplification ACM SIGGRAPH 2003 Papers, (689-696)
- Décoret X, Durand F, Sillion F and Dorsey J (2003). Billboard clouds for extreme model simplification, ACM Transactions on Graphics, 22:3, (689-696), Online publication date: 1-Jul-2003.
- Tecchia F, Loscos C and Chrysanthou Y (2002). Image-Based Crowd Rendering, IEEE Computer Graphics and Applications, 22:2, (36-43), Online publication date: 1-Mar-2002.
- Aliaga D, Funkhouser T, Yanovsky D and Carlbom I Sea of images Proceedings of the conference on Visualization '02, (331-338)
- Oliveira M and Bishop G Image-based objects Proceedings of the 1999 symposium on Interactive 3D graphics, (191-198)
- Gernot S Image-based object representation by layered impostors Proceedings of the ACM symposium on Virtual reality software and technology, (99-104)
- Shade J, Gortler S, He L and Szeliski R Layered depth images Proceedings of the 25th annual conference on Computer graphics and interactive techniques, (231-242)
- Rademacher P and Bishop G Multiple-center-of-projection images Proceedings of the 25th annual conference on Computer graphics and interactive techniques, (199-206)
Recommendations
Image-based rendering of diffuse, specular and glossy surfaces from a single image
SIGGRAPH '01: Proceedings of the 28th annual conference on Computer graphics and interactive techniquesIn this paper, we present a new method to recover an approximation of the bidirectional reflectance distribution function (BRDF) of the surfaces present in a real scene. This is done from a single photograph and a 3D geometric model of the scene. The ...
Stick textures for image-based rendering
Special issue on SPM 05This paper presents a new data structure, called stick textures, to give a continuous and compact 3D representation of the scene displayed in depth images. A stick texture is constructed for each pixel of a depth image, composed of the interpolated ...
An introduction to image-based rendering
Integrated image and graphics technologiesIn this chapter, we review the techniques for image-based rendering. Unlike traditional 3D computer graphics in which 3D geometry of the scene is known, image-based rendering (IBR) techniques render novel views directly from input images. IBR techniques ...