Cited By
View all- Wu JCai YSun TMa KLu C(2024)Integrating AIGC with design: dependence, application, and evolution - a systematic literature reviewJournal of Engineering Design10.1080/09544828.2024.2362587(1-39)Online publication date: 6-Jun-2024
Towards a Co-creative System for Creating, Suggesting, and Assessing Material Textures for 3D Renderings During Design Reviews in Industrial Design
Pages 58 - 62
Abstract
Material selection is an important task in industrial design as they affect several aspects of a product including its sensory characteristics and feasibility. This paper presents an early iteration of a co-creative system that uses generative AI to change, suggest, and provide feedback on a 3D rendering’s materials. The system is aimed to be used during design review sessions to assist designers in quickly exploring alternatives, and converging on suitable materials before construction. We first interviewed industrial designers on how they assess materials in various deliverables (e.g., sketches, and 3D renderings) during design review sessions. Based on our findings, we then develop a prototype of the co-creative system for generating, suggesting, and providing feedback on a 3D rendering’s material textures. We believe that using this system can assist designers in not only creating textures for their 3D renderings but also in providing material-aware feedback to create the product feasibly.
References
[1]
Charlotte Asbjørn Sorensen, Santosh Jagtap, and Anders Warell. 2016. Material Selection in Industrial Design Education - a Literature Review. Design Education: Collaboration and Cross-DisciplinarySeptember (2016), 708–713.
[2]
Mike Ashby and Kara Johnson. 2003. The art of materials selection. Materials Today 6, 12 (2003), 24–35. https://doi.org/10.1016/S1369-7021(03)01223-9
[3]
Sai Bi, Nima Khademi Kalantari, and Ravi Ramamoorthi. 2017. Patch-based optimization for image-based texture mapping. ACM Transactions on Graphics 36, 4 (2017). https://doi.org/10.1145/3072959.3073610
[4]
Tom B. Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel M. Ziegler, Jeffrey Wu, Clemens Winter, Christopher Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020. Language models are few-shot learners. In Advances in Neural Information Processing Systems, Vol. 2020-Decem. arxiv:2005.14165
[5]
Carson-Katri. 2022. dream-textures: Stable diffusion built-in to the blender shader editor. Retrieved November 10, 2022 from https://github.com/carson-katri/dream-textures
[6]
Xiang Anthony Chen, Ye Tao, Guanyun Wang, and Runchang Kang. 2018. Forte : User-Driven Generative Design. In CHI Conference on Human Factors in Computing Systems. 1–12.
[7]
Yongwei Chen, Rui Chen, Jiabao Lei, Yabin Zhang, and Kui Jia. 2022. TANGO: Text-driven Photorealistic and Robust 3D Stylization via Lighting Decomposition. In NeurIPS. 1–13. arxiv:2210.11277http://arxiv.org/abs/2210.11277
[8]
Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2020. Generative adversarial networks. Commun. ACM 63, 11 (2020), 139–144. https://doi.org/10.1145/3422622 arxiv:2203.00667
[9]
Daniel Gustafsson. 2019. Analysing the Double diamond design process through research & implementation. (2019), 55. http://urn.fi/URN:NBN:fi:aalto-201907144349
[10]
Ruizhen Hu, Xiangyu Su, Xiangkai Chen, Oliver Van Kaick, and Hui Huang. 2022. Photo-to-Shape Material Transfer for Diverse Structures. ACM Trans. Graph. 41, 4, Article 131 (Jul 2022), 14 pages. https://doi.org/10.1145/3528223.3530088
[11]
A. Jahan, M. Y. Ismail, S. M. Sapuan, and F. Mustapha. 2010. Material screening and choosing methods - A review. Materials and Design 31, 2 (2010), 696–705. https://doi.org/10.1016/j.matdes.2009.08.013
[12]
Bu Jin, Beiwen Tian, Hao Zhao, and Guyue Zhou. 2022. Language-Guided Semantic Style Transfer of 3D Indoor Scenes. (2022), 11–17. https://doi.org/10.1145/3552482.3556555
[13]
Elvin Karana, Paul Hekkert, and Prabhu Kandachar. 2010. A tool for meaning driven materials selection. Materials and Design 31, 6 (2010), 2932–2941. https://doi.org/10.1016/j.matdes.2009.12.021
[14]
Rubaiat Habib Kazi, Tovi Grossman, Hyunmin Cheong, Ali Hashemi, and George Fitzmaurice. 2017. DreamSketch: Early stage 3D design explorations with sketching and generative design. In UIST 2017 - Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. 401–414. https://doi.org/10.1145/3126594.3126662
[15]
Haibing Li and Roland Lachmayer. 2018. Generative Design Approach for Modeling Creative Designs. IOP Conference Series: Materials Science and Engineering 408, 1 (2018). https://doi.org/10.1088/1757-899X/408/1/012035
[16]
Hubert Lin, Melinos Averkiou, Evangelos Kalogerakis, Balazs Kovacs, Siddhant Ranade, Vladimir Kim, Siddhartha Chaudhuri, and Kavita Bala. 2018. Learning material-aware local descriptors for 3D shapes. In Proceedings - 2018 International Conference on 3D Vision, 3DV 2018. 150–159. https://doi.org/10.1109/3DV.2018.00027 arxiv:1810.08729
[17]
Vivian Liu, Jo Vermeulen, George Fitzmaurice, and Justin Matejka. 2022. 3DALL-E: Integrating Text-to-Image AI in 3D Design Workflows. arxiv:2210.11603http://arxiv.org/abs/2210.11603
[18]
Justin Matejka, Michael Glueck, Erin Bradner, Ali Hashemi, Tovi Grossman, and George Fitzmaurice. 2018. Dream lens: Exploration and visualization of large-scale generative design datasets. In Conference on Human Factors in Computing Systems - Proceedings. https://doi.org/10.1145/3173574.3173943
[19]
Oscar Michel, Roi Bar-On, Richard Liu, Sagie Benaim, and Rana Hanocka. 2022. Text2Mesh: Text-Driven Neural Stylization for Meshes. (2022), 13492–13502. arxiv:2112.03221https://arxiv.org/abs/2112.03221
[20]
Maxine Perroni-Scharf, Kalyan Sunkavalli, Jonathan Eisenmann, and Yannick Hold-Geoffroy. 2022. Material Swapping for 3D Scenes using a Learnt Material Similarity Measure. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops. 2033–2042. https://doi.org/10.1109/CVPRW56347.2022.00221
[21]
Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, and Ilya Sutskever. 2021. Learning Transferable Visual Models From Natural Language Supervision. (2021). arxiv:2103.00020http://arxiv.org/abs/2103.00020
[22]
Aditya Ramesh, Mikhail Pavlov, Gabriel Goh, Scott Gray, Chelsea Voss, Alec Radford, Mark Chen, and Ilya Sutskever. 2020. Zero-Shot Text-to-Image Generation.
[23]
Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Bjorn Ommer. 2022. High-Resolution Image Synthesis with Latent Diffusion Models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 10674–10685. https://doi.org/10.1109/cvpr52688.2022.01042 arxiv:2112.10752
[24]
Greg Saul, Manfred Lau, Jun Mitani, and Takeo Igarashi. 2011. SketchChair: An all-in-one chair design system for end users. In Proceedings of the 5th International Conference on Tangible Embedded and Embodied Interaction, TEI’11. 73–80. https://doi.org/10.1145/1935701.1935717
[25]
Adriana Schulz, Jie Xu, Bo Zhu, Changxi Zheng, Eitan Grinspun, and Wojciech Matusik. 2017. Interactive design space exploration and optimization for CAD models. ACM Transactions on Graphics 36, 4 (2017). https://doi.org/10.1145/3072959.3073688
[26]
Aart van Bezooyen. 2013. Materials Driven Design. Number 1971. Elsevier. 277–286 pages. https://doi.org/10.1016/B978-0-08-099359-1.00019-9
[27]
I. E.H. Van Kesteren, P. J. Stappers, and J. C.M. de Bruijn. 2007. Materials in Products Selection: Tools for including user-interaction in materials selection. International Journal of Design 1, 3 (2007), 41–55.
[28]
Tuanfeng Y. Wang, Hao Su, Qixing Huang, Jingwei Huang, Leonidas Guibas, and Niloy J. Mitra. 2016. Unsupervised Texture Transfer from Images to Model Collections. ACM Trans. Graph. 35, 6, Article 177 (Nov. 2016), 13 pages. https://doi.org/10.1145/2980179.2982404
[29]
Yong Liang Yang, Jun Wang, and Niloy J. Mitra. 2015. Reforming shapes for material-aware fabrication. Eurographics Symposium on Geometry Processing 34, 5 (2015), 53–64. https://doi.org/10.1111/cgf.12696
[30]
Yu-Ying Yeh, Zhengqin Li, Yannick Hold-Geoffroy, Rui Zhu, Zexiang Xu, Milos Hasan, Kalyan Sunkavalli, and Manmohan Chandraker. 2022. PhotoScene: Photorealistic Material and Lighting Transfer for Indoor Scenes. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 18541–18550. https://doi.org/10.1109/cvpr52688.2022.01801 arxiv:2207.00757
Index Terms
- Towards a Co-creative System for Creating, Suggesting, and Assessing Material Textures for 3D Renderings During Design Reviews in Industrial Design
Recommendations
Human+Non-human Creative Identities. Symbiotic Synthesis in Industrial Design Creative Processes
Progress in Artificial IntelligenceAbstractAs digital technologies are increasingly used in creative professions, the evolution of the relationship between designers and machines is growing in interest. Such topic is part of a broad debate on how cognitive processes and human intelligence ...
Interactive evolution for industrial design
C&C '07: Proceedings of the 6th ACM SIGCHI conference on Creativity & cognitionInteractive evolutionary design (IED) has the potential to change development processes in industrial design from generating individual solutions to designing parametric models that are employed to create a vast space of possible solutions. This paper ...
The Effect of User-Centered Principles on Industrial Product Design
ICSEM '10: Proceedings of the 2010 International Conference on System Science, Engineering Design and Manufacturing Informatization - Volume 01This paper is aimed at giving rise to the industrial designers to pay more attention to the design principles of ‘User-Centered’ during their product design. In the paper, mainly analyzed some products those used in every day life of people. The way of ...
Comments
Information & Contributors
Information
Published In
April 2023
109 pages
Copyright © 2023 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 03 October 2023
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
Asian CHI 2023
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 92Total Downloads
- Downloads (Last 12 months)52
- Downloads (Last 6 weeks)5
Reflects downloads up to 01 Feb 2025
Other Metrics
Citations
Cited By
View all- Wu JCai YSun TMa KLu C(2024)Integrating AIGC with design: dependence, application, and evolution - a systematic literature reviewJournal of Engineering Design10.1080/09544828.2024.2362587(1-39)Online publication date: 6-Jun-2024
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format