Content and Surface Aware Projection
Authors: 
Long Mai, Hoang Le, Feng LiuAuthors Info & Claims
Long Mai, Hoang Le, Feng LiuAuthors Info & ClaimsAbstract
Image projection is important for many applications in entertainment industry, augmented reality, and computer graphics. However, perceived distortion is often introduced by projection, which is a common problem of a projector system. Compensating such distortion for projection on non-trivial surfaces is often very challenging. In this paper, we propose a novel method to pre-warp the image such that it appears as distortion-free as possible on the surface after projection. Our method estimates a desired optimal warping function via an optimization framework. Specifically, we design an objective energy function that models the perceived distortion in projection results. By taking into account both the geometry of the surface and the image content, our method can produce more visually plausible projection results compared with traditional projector systems. We demonstrate the effectiveness of our method with projection results on a wide variety of images and surface geometries.
References
[1]
O. Bimber, A. Emmerling, and T. Klemmer. Embedded entertainment with smart projectors. Computer, 38(1):48–55, 2005.
[2]
O. Bimber and R. Raskar. Spatial augmented reality - merging real and virtual worlds. A K Peters, 2005.
[3]
R. Carroll, M. Agrawal, and A. Agarwala. Optimizing contentpreserving projections for wide-angle images. ACM Transactions on Graphics, 28(3):43:1–43:9, 2009.
[4]
C. Everitt. Projective texture mapping, 1999.
[5]
M. S. Floater and K. Hormann. Surface parameterization: a tutorial and survey. In Advances in Multiresolution for Geometric Modelling, pp. 157–186, 2005.
[6]
J. Harel, C. Koch, and P. Perona. Graph-based visual saliency. In Advances in Neural Information Processing Systems, pp. 545–552, 2006.
[7]
T. Igarashi, T. Moscovich, and J. F. Hughes. As-rigid-as-possible shape manipulation. ACM Transactions on Graphics, 24(3):1134–1141, 2005.
[8]
B. R. Jones, H. Benko, E. Ofek, and A. D. Wilson. Illumiroom: peripheral projected illusions for interactive experiences. In ACM CHI Conference on Human Factors in Computing Systems, pp. 869–878, 2013.
[9]
D. Kim and J. K. Hahn. Projective texture mapping with full panorama. Computer Graphics Forum, 21(3):421–430, 2002.
[10]
M. Lacroix. A hdtv projector for wide field of view flight simulators. In IMAGE VI Conference, pp. 493–500, 1992.
[11]
B. Li and I. Sezan. Automatic keystone correction for smart projectors with embedded camera. In IEEE International Conference on Image Processing, vol. 4, pp. 2829–2832, 2004.
[12]
Z. Li, K. Wong, Y. Gong, and M. Chang. An effective method for movable projector keystone correction. IEEE Transactions on Multimedia, 13(1):155–160, 2011.
[13]
F. Liu, M. Gleicher, H. Jin, and A. Agarwala. Content-preserving warps for 3d video stabilization. ACM Transactions on Graphics, 28(3):44:1–44:9, 2009.
[14]
S.-J. Luo, I.-C. Shen, B.-Y. Chen, W.-H. Cheng, and Y.-Y. Chuang. Perspective-aware warping for seamless stereoscopic image cloning. ACM Trans. Graph., 31(6):182:1–182:8, 2012.
[15]
M. Mine, D. Rose, B. Yang, J. van Baar, and A. Grundhofer. Projectionbased augmented reality in disney theme parks. Computer, 45(7):32–40, 2012.
[16]
D. Moreno and G. Taubin. Simple, accurate, and robust projectorcamera calibration. In Proceedings of the 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission, 3DIMPVT ’12, pp. 464–471, 2012.
[17]
R. Raskar and P. A. Beardsley. A self-correcting projector. In IEEE Conference on Computer Vision and Pattern Recognition, pp. 504–508, 2001.
[18]
R. Raskar, J. van Baar, P. A. Beardsley, T. Willwacher, S. Rao, and C. Forlines. ilamps: geometrically aware and self-configuring projectors. ACM Transactions on Graphics, 22(3):809–818, 2003.
[19]
R. Raskar, G. Welch, M. Cutts, A. Lake, L. Stesin, and H. Fuchs. The office of the future: a unified approach to image-based modeling and spatially immersive displays. In ACM SIGGRAPH, pp. 179–188, 1998.
[20]
R. Raskar, G. Welch, K.-L. Low, and D. Bandyopadhyay. Shader lamps: Animating real objects with image-based illumination. In Eurographics Workshop on Rendering Techniques, pp. 89–102, 2001.
[21]
J. Shaw and E. Lantz. Dome theaters: Spheres of influence. In TiLE Proceedings, pp. 59–65, 1998.
[22]
A. Sheffer, E. Praun, and K. Rose. Mesh parameterization methods and their applications. In Foundations and Trends in Computer Graphics and Vision, p. 2006. Now Publishers, 2006.
[23]
P. Shirley and S. Marschner. Fundamentals of Computer Graphics. A. K. Peters, Ltd., Natick, MA, USA, 3rd ed., 2009.
[24]
R. Sukthankar, R. G. Stockton, and M. D. Mullin. Automatic keystone correction for camera-assisted presentation interfaces. In ACM International Conference on Advances in Multimodal Interfaces, pp. 607–614, 2000
[25]
R. Sukthankar, R. G. Stockton, and M. D. Mullin. Smarter presentations: Exploiting homography in camera-projector systems. In IEEE International Conference on Computer Vision, pp. 247–253, 2001.
[26]
Y.-S. Wang, H.-C. Lin, O. Sorkine, and T.-Y. Lee. Motion-based video retargeting with optimized crop-and-warp. ACM Transactions on Graphics, 29(4):90:1–90:9, 2010.
[27]
Y.-S. Wang, C.-L. Tai, O. Sorkine, and T.-Y. Lee. Optimized scaleand-stretch for image resizing. ACM Transactions on Graphics, 27(5), 2008
[28]
K. D. Willis and I. Poupyrev. Motionbeam: designing for movement with handheld projectors. In ACM CHI Extended Abstracts on Human Factors in Computing Systems, pp. 3253–3258, 2010.
[29]
K. D. Willis, I. Poupyrev, S. E. Hudson, and M. Mahler. Sidebyside: ad-hoc multi-user interaction with handheld projectors. In ACM Symposium on User Interface Software and Technology, pp. 431–440, 2011
[30]
L. Wolf, M. Guttmann, and D. Cohen-or. Non-homogeneous contentdriven video-retargeting. In IEEE International Conference on Computer Vision, pp. 1–6, 2007.
[31]
J. Zaragoza, T.-J. Chin, M. S. Brown, and D. Suter. As-projectiveas-possible image stitching with moving dlt. In IEEE Conference on Computer Vision and Pattern Recognition, pp. 2339–2346, 2013.
- Content and Surface Aware Projection
Recommendations
Lorentzian discriminant projection and its applications
ACCV'09: Proceedings of the 9th Asian conference on Computer Vision - Volume Part IIIThis paper develops a supervised dimensionality reduction method, Lorentzian Discriminant Projection (LDP), for discriminant analysis and classification Our method represents the structures of sample data by a manifold, which is furnished with a ...
Surface Parameterization Using Riemann Surface Structure
ICCV '05: Proceedings of the Tenth IEEE International Conference on Computer Vision - Volume 2We propose a general method that parameterizes general surfaces with complex (possible branching) topology using Riemann surface structure. Rather than evolve the surface geometry to a plane or sphere, we instead use the fact that all orientable ...
Isometric projection
AAAI'07: Proceedings of the 22nd national conference on Artificial intelligence - Volume 1Recently the problem of dimensionality reduction has received a lot of interests in many fields of information processing. We consider the case where data is sampled from a low dimensional manifold which is embedded in high dimensional Euclidean space. ...
Comments
Information & Contributors
Information
Published In
Sponsors
- The Canadian Human-Computer Communications Society / Société Canadienne du Dialogue Humaine Machine (CHCCS/SCDHM)
- Microsoft: Microsoft
- University of Alberta: University of Alberta
In-Cooperation
- SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques
- SIGCHI: ACM Special Interest Group on Computer-Human Interaction
- EUROGRAPHICS: The European Association for Computer Graphics
Publisher
Canadian Human-Computer Communications Society
Waterloo, Canada
Publication History
Published: 06 January 2017
Check for updates
Qualifiers
- Research-article
Acceptance Rates
GI '17 Paper Acceptance Rate 26 of 52 submissions, 50%;
Overall Acceptance Rate 206 of 508 submissions, 41%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 10 Nov 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in