research-article

Material memex: automatic material suggestions for 3D objects

Authors:

Thorsten Thormählen,

Tobias Ritschel, and

Hans-Peter SeidelAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 31, Issue 6

Article No.: 143, Pages 1 - 8

https://doi.org/10.1145/2366145.2366162

Published: 01 November 2012 Publication History

Abstract

The material found on 3D objects and their parts in our everyday surroundings is highly correlated with the geometric shape of the parts and their relation to other parts of the same object. This work proposes to model this context-dependent correlation by learning it from a database containing several hundreds of objects and their materials. Given a part-based 3D object without materials, the learned model can be used to fully automatically assign plausible material parameters, including diffuse color, specularity, gloss, and transparency. Further, we propose a user interface that provides material suggestions. This user-interface can be used, for example, to refine the automatic suggestion. Once a refinement has been made, the model incorporates this information, and the automatic assignment is incrementally improved. Results are given for objects with different numbers of parts and with different topological complexity. A user study validates that our method significantly simplifies and accelerates the material assignment task compared to other approaches.

Supplementary Material

ZIP File (143-138-0028.zip)

Supplemental Materials for Material memex: automatic material suggestions for 3D objects

Download
71.68 MB

References

[1]

Bush, V. 1945. As we may think. Atlantic Monthly 176, 101--108.

[2]

Chajdas, M. G., Lefebvre, S., and Stamminger, M. 2010. Assisted texture assignment. In Proc. I3D, 173--179.

Digital Library

[3]

Chaudhuri, S., Kalogerakis, E., Guibas, L., and Koltun, V. 2011. Probabilistic reasoning for assembly-based 3D modeling. ACM Trans. Graph. (Proc. SIGGRAPH) 30.

Digital Library

[4]

Chen, D.-Y., Tian, X.-P., Shen, Y.-T., and Ouhyoung, M. 2003. On visual similarity based 3D model retrieval. Comput. Graph. Forum (Proc. Eurographics) 22, 223--232.

[5]

Fisher, M., and Hanrahan, P. 2010. Context-based search for 3D models. ACM Trans. Graph. (Proc. SIGGRAPH Asia) 29, 182:1--182:10.

Digital Library

[6]

Fisher, M., Savva, M., and Hanrahan, P. 2011. Characterizing structural relationships in scenes using graph kernels. ACM Trans. Graph (Proc. SIGGRAPH) 30, 34:1--34:12.

Digital Library

[7]

Kalogerakis, E., Hertzmann, A., and Singh, K. 2010. Learning 3D mesh segmentation and labeling. ACM Trans. Graph. (Proc. SIGGRAPH) 29, 102:1--102:12.

Digital Library

[8]

Kautz, J., Boulos, S., and Durand, F. 2007. Interactive editing and modeling of bidirectional texture functions. ACM Trans. Graph. (Proc. SIGGRAPH) 26.

Digital Library

[9]

Kerr, W. B., and Pellacini, F. 2010. Toward evaluating material design interface paradigms for novice users. ACM Trans. Graph. 29, 35:1--35:10.

Digital Library

[10]

Kschischang, F. R., Frey, B. J., and Loeliger, H.-A. 1998. Factor graphs and the sum-product algorithm. IEEE Trans. Information Theory 47, 498--519.

Digital Library

[11]

Lee, Y. J., Zitnick, C. L., and Cohen, M. F. 2011. Shadowdraw: real-time user guidance for freehand drawing. ACM Trans. Graph. (Proc. SIGGRAPH), 27:1--27:10.

Digital Library

[12]

Lefebvre, S., Hornus, S., and Lasram, A. 2010. By-example synthesis of architectural textures. ACM Trans. Graph. 29, 84:1--84:8.

Digital Library

[13]

Lu, J., Georghiades, A. S., Glaser, A., Wu, H., Wei, L.-Y., Guo, B., Dorsey, J., and Rushmeier, H. 2007. Context-aware textures. ACM Trans. Graph. 26.

Digital Library

[14]

Malisiewicz, T., and Efros, A. A. 2009. Beyond categories: The visual memex model for reasoning about object relationships. In Proc. Neural Information Processing Systems.

[15]

Mertens, T., Kautz, J., Chen, J., Bekaert, P., and Durand, F. 2006. Texture transfer using geometry correlation. In Proc. EGSR, 273--284.

Digital Library

[16]

Ngan, A., Durand, F., and Matusik, W. 2006. Image-driven navigation of analytical BRDF models. In Proc. EGSR, 399--407.

Digital Library

[17]

Pellacini, F., and Lawrence, J. 2007. AppWand: Editing measured materials using appearance-driven optimization. ACM Trans. Graph. (Proc. SIGGRAPH) 26.

Digital Library

[18]

Pellacini, F., Ferwerda, J. A., and Greenberg, D. P. 2000. Toward a psychophysically-based light reflection model for image synthesis. In Proc. SIGGRAPH, 55--64.

Digital Library

[19]

Phong, B.-T. 1975. Illumination for computer generated pictures. Communications of the ACM 18, 6, 311--317.

Digital Library

[20]

Torralba, A. 2003. Contextual priming for object detection. Int. J. Comput. Vision 53, 169--191.

Digital Library

[21]

Wang, B., Yu, Y., Wong, T.-T., Chen, C., and Xu, Y.-Q. 2010. Data-driven image color theme enhancement. ACM Trans. Graph. (Proc. SIGGRAPH Asia) 29, 146:1--146:10.

Digital Library

[22]

Yu, L.-F., Yeung, S. K., Tang, C.-K., Terzopoulos, D., Chan, T. F., and Osher, S. 2011. Make it home: Automatic optimization of furniture arrangement. ACM Trans. Graph. (Proc. SIGGRAPH) 30, 86.

Digital Library

Cited By

Guo SShi YXiao PFu YLin JZeng WLee T(2023)Creative and Progressive Interior Color Design with Eye-tracked User PreferenceACM Transactions on Computer-Human Interaction10.1145/354292230:1(1-31)Online publication date: 7-Mar-2023
https://dl.acm.org/doi/10.1145/3542922
Patil APatil SLi MFisher MSavva MZhang H(2023)Advances in Data‐Driven Analysis and Synthesis of 3D Indoor ScenesComputer Graphics Forum10.1111/cgf.1492743:1Online publication date: 11-Sep-2023
https://doi.org/10.1111/cgf.14927
Li WChen XWang JChen B(2023)Patch-Based 3D Natural Scene Generation from a Single Example2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52729.2023.01608(16762-16772)Online publication date: Jun-2023
https://doi.org/10.1109/CVPR52729.2023.01608
Show More Cited By

Index Terms

Material memex: automatic material suggestions for 3D objects
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Image and video acquisition
        3D imaging
  2. Computer graphics
    1. Animation
    2. Shape modeling
2. Theory of computation
  1. Randomness, geometry and discrete structures
    1. Computational geometry

Recommendations

Multi-scale material appearance
Read More
Recovery of material under complex illumination conditions
GRAPHITE '04: Proceedings of the 2nd international conference on Computer graphics and interactive techniques in Australasia and South East Asia

To calculate the inter-reflection between real objects and virtual ones in augmented reality, recovery of material for the real objects is necessary. In this paper, an approach is proposed to recover the material properties from a single high dynamic ...
Read More
Single Image Neural Material Relighting
SIGGRAPH '23: ACM SIGGRAPH 2023 Conference Proceedings

This paper presents a novel neural material relighting method for revisualizing a photograph of a planar spatially-varying material under novel viewing and lighting conditions. Our approach is motivated by the observation that the plausibility of a ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 31, Issue 6

November 2012

794 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/2366145

Issue’s Table of Contents

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 November 2012

Published in TOG Volume 31, Issue 6

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

40
Total Citations
View Citations
568
Total Downloads

Downloads (Last 12 months)13
Downloads (Last 6 weeks)2

Other Metrics

View Author Metrics

Citations

Cited By

Guo SShi YXiao PFu YLin JZeng WLee T(2023)Creative and Progressive Interior Color Design with Eye-tracked User PreferenceACM Transactions on Computer-Human Interaction10.1145/354292230:1(1-31)Online publication date: 7-Mar-2023
https://dl.acm.org/doi/10.1145/3542922
Patil APatil SLi MFisher MSavva MZhang H(2023)Advances in Data‐Driven Analysis and Synthesis of 3D Indoor ScenesComputer Graphics Forum10.1111/cgf.1492743:1Online publication date: 11-Sep-2023
https://doi.org/10.1111/cgf.14927
Li WChen XWang JChen B(2023)Patch-Based 3D Natural Scene Generation from a Single Example2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52729.2023.01608(16762-16772)Online publication date: Jun-2023
https://doi.org/10.1109/CVPR52729.2023.01608
Teacher MVelu R(2023)Additive Manufacturing of Functionally Graded Materials: A Comprehensive ReviewInternational Journal of Precision Engineering and Manufacturing10.1007/s12541-023-00864-x25:1(165-197)Online publication date: 7-Oct-2023
https://doi.org/10.1007/s12541-023-00864-x
Hu RSu XChen XVan Kaick OHuang H(2022)Photo-to-shape material transfer for diverse structuresACM Transactions on Graphics10.1145/3528223.353008841:4(1-14)Online publication date: 22-Jul-2022
https://dl.acm.org/doi/10.1145/3528223.3530088
Lin JXiao PFu YShi YWang HGuo SHe YLee T(2022)C3 Assignment: Camera Cubemap Color Assignment for Creative Interior DesignIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2020.304172828:8(2895-2908)Online publication date: 1-Aug-2022
https://doi.org/10.1109/TVCG.2020.3041728
Yeh YLi ZHold-Geoffroy YZhu RXu ZHasan MSunkavalli KChandraker M(2022)PhotoScene: Photorealistic Material and Lighting Transfer for Indoor Scenes2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52688.2022.01801(18541-18550)Online publication date: Jun-2022
https://doi.org/10.1109/CVPR52688.2022.01801
Tümmers KKemper TFuhrmann A(2022)Generating VR Meeting Rooms with Non-rectangular Floor Plans Using Cost Optimization and Hard ConstraintsVirtual Reality and Mixed Reality10.1007/978-3-031-16234-3_10(171-188)Online publication date: 14-Sep-2022
https://dl.acm.org/doi/10.1007/978-3-031-16234-3_10
Fu QYan HFu HLi X(2020)Interactive Design and Preview of Colored Snapshots of Indoor ScenesComputer Graphics Forum10.1111/cgf.1416639:7(543-552)Online publication date: 24-Nov-2020
https://doi.org/10.1111/cgf.14166
Chaudhuri SRitchie DWu JXu KZhang H(2020)Learning Generative Models of 3D StructuresComputer Graphics Forum10.1111/cgf.1402039:2(643-666)Online publication date: 13-Jul-2020
https://doi.org/10.1111/cgf.14020
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents