Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Assisted color acquisition for 3D models

Published: 01 November 2017 Publication History

Abstract

Immediate feedback of material acquisition.Per-vertex material reflectance representation.Assisted acquisition for in situ digitization campaigns.Good diffuse color with specular approximation. Display Omitted Capturing surface appearance precisely is paramount for modeling realistic materials. Nevertheless, the spatially varying nature of most materials is difficult to measure. State-of-the-art methods often rely on complex apparatus and controlled environments, and even if they are able to acquire reliable SVBRDFs, the whole process usually takes a long time and generates a large amount of data, that is often redundant.In this work, we propose a method for fast and assisted acquisition of material properties on-site. The system has a simple setup, requiring only a generic camera and a light source. Consequently, it is also very portable and appropriate for a broad range of object sizes and scenarios. The system guides the acquisition process, allowing for a fast capture session while at the same time producing high-quality per vertex diffuse colors. To help in achieving a complete coverage it suggests missing light directions, reducing the amount of necessary input images and the acquisition time. The system is designed to work in situ, therefore the whole acquisition process works with immediate feedback and interactive integration of new data.We show results for a variety of objects differing in size and materials.

References

[1]
C. Schwartz, M. Weinmann, R. Ruiters, R. Klein, Integrated high-quality acquisition of geometry and appearance for cultural heritage, Eurographics Association, 2011.
[2]
H.P.A. Lensch, J. Kautz, M. Goesele, W. Heidrich, H.-P. Seidel, Image-based reconstruction of spatial appearance and geometric detail, ACM Trans Gr, 22 (2003) 234-257.
[3]
G. Palma, M. Callieri, M. Dellepiane, R. Scopigno, A statistical method for SVBRDF approximation from video sequences in general lighting conditions, Comp Gr Forum, 31 (2012) 1491-1500.
[4]
J. Dorsey, H. Rushmeier, F. Sillion, Digital modeling of material appearance, Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 2008.
[5]
T. Weyrich, J. Lawrence, H.P. Lensch, S. Rusinkiewicz, T. Zickler, Principles of appearance acquisition and representation, Found Trends Comput Gr Vis, 4 (2009) 75-191.
[6]
H. Lensch, J. Kautz, M. Goesele, W. Heidrich, H.-P. Seidel, Image-based reconstruction of spatially varying materials, in: Rendering Techniques 2001, Eurographics; Springer Vienna, 2001, pp. 103-114.
[7]
T. Malzbender, D. Gelb, H. Wolters, Polynomial texture maps, ACM, New York, NY, USA, 2001.
[8]
D. Goldman, B. Curless, A. Hertzmann, S. Seitz, Shape and spatially-varying BRDFs from photometric stereo, 2005.
[9]
N.G. Alldrin, T. Zickler, D.J. Kriegman, Photometric stereo with non-parametric and spatially-varying reflectance., IEEE Computer Society, 2008.
[10]
M. Holroyd, J. Lawrence, T. Zickler, A coaxial optical scanner for synchronous acquisition of 3d geometry and surface reflectance, ACM, New York, NY, USA, 2010.
[11]
T. Nll, J. Khler, G. Reis, D. Stricker, Fully automatic, omnidirectional acquisition of geometry and appearance in the context of cultural heritage preservation, in: Journal on Computing and Cultural Heritage (JOCCH), ACM, 2015.
[12]
P. Santos, M. Ritz, R. Tausch, H. Schmedt, R. Monroy, A.D. Stefano, CultLab3D - on the verge of 3D mass digitization, in: Proceedings of the Eurographics Workshop on Graphics and Cultural Heritage, The Eurographics Association, 2014.
[13]
G. Schwartz, K. Nishino, Automatically discovering local visual material attributes, 2015.
[14]
F. Romeiro, T. Zickler, Computer vision ECCV 2010, Springer Berlin Heidelberg, Heraklion, Crete, Greece chap. Blind Reflectometry, 2010.
[15]
M. Aittala, T. Weyrich, J. Lehtinen, Two-shot SVBRDF capture for stationary materials, ACM Trans Gr, 34 (2015).
[16]
J. Riviere, P. Peers, A. Ghosh, Mobile surface reflectometry, Comput Gr Forum (2016).
[17]
M. Aittala, T. Weyrich, J. Lehtinen, Practical SVBRDF capture in the frequency domain, ACM Trans Gr, 32 (2013).
[18]
Y. Dong, G. Chen, P. Peers, J. Zhang, X. Tong, Appearance-from-motion: recovering spatially varying surface reflectance under unknown lighting, ACM Trans Gr, 33 (2014).
[19]
P. Ren, J. Wang, J. Snyder, X. Tong, B. Guo, Pocket reflectometry, ACM Trans Gr, 30 (2011).
[20]
A. Treuille, A. Hertzmann, S.M. Seitz, Example-based stereo with general BRDFs, 2004.
[21]
H. Wu, K. Zhou, Appfusion: interactive appearance acquisition using a kinect sensor, Comput Gr Forum, 34 (2015) 289-298.
[22]
R. Ruiters, C. Schwartz, R. Klein, Data driven surface reflectance from sparse and irregular samples, Comput Gr Forum (Proc of Eurographics), 31 (2012) 315-324.
[23]
J.B. Nielsen, H.W. Jensen, R. Ramamoorthi, On optimal, minimal BEDF sampling for reflectance acquisition, ACM Trans Gr, 34 (2015).
[24]
M. Mudge, C. Schroer, G. Earl, K. Martinez, H. Pagi, C. Toler-Franklin, Principles and practices of robust, photography-based digital imaging techniques for museums, Eurographics Association (VAST10), Paris, France, 2010.
[25]
M. Corsini, M. Dellepiane, F. Ponchio, R. Scopigno, Image-to-geometry registration: a mutual information method exploiting illumination-related geometric properties, Comput Gr Forum, 28 (2009) 1755-1764.
[26]
B. Shi, P. Tan, Y. Matshushita, K. Ikeuchi, Bi-polynomial modeling of low-frequency reflectances, IEEE Trans Pattern Anal Mach Intell, 36 (2014) 1078-1091.
[27]
D. Cohen-Or, C. Greif, T. Ju, N.J. Mitra, H.R. Zhang, A sampler of useful computational tools for applied geometry, computer graphics, and image processing, A. K. Peters, Ltd., Natick, MA, USA, 2015.
[28]
F.M. Nascimento, A.B. de Carvalho, B.T. Andrade, Improving the selection of bases of brdfs for appearance preservation, 2016.
[29]
M. Dellepiane, R. Marroquim, M. Callieri, P. Cignoni, R. Scopigno, Flow-based local optimization for image-to-geometry projection, IEEE Trans Vis Comput Gr, 18 (2012) 463-474.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Computers and Graphics
Computers and Graphics  Volume 68, Issue C
November 2017
150 pages

Publisher

Pergamon Press, Inc.

United States

Publication History

Published: 01 November 2017

Author Tags

  1. Digitization and Image Capture
  2. Reflectance

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 01 Nov 2024

Other Metrics

Citations

Cited By

View all

View Options

View options

Get Access

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media