Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

WallPlan: synthesizing floorplans by learning to generate wall graphs

Published: 22 July 2022 Publication History

Abstract

Floorplan generation has drawn widespread interest in the community. Recent learning-based methods for generating realistic floorplans have made significant progress while a complex heuristic post-processing is still necessary to obtain desired results. In this paper, we propose a novel wall-oriented method, called WallPlan, for automatically and efficiently generating plausible floorplans from various design constraints. We pioneer the representation of the floorplan as a wall graph with room labels and consider the floorplan generation as a graph generation. Given the boundary as input, we first initialize the boundary with windows predicted by WinNet. Then a graph generation network GraphNet and semantics prediction network LabelNet are coupled to generate the wall graph progressively by imitating graph traversal. WallPlan can be applied for practical architectural designs, especially the wall-based constraints. We conduct ablation experiments, qualitative evaluations, quantitative comparisons, and perceptual studies to evaluate our method's feasibility, efficacy, and versatility. Intensive experiments demonstrate our method requires no post-processing, producing higher quality floorplans than state-of-the-art techniques.

Supplementary Material

supplemental material (092-488-supp-mtl.zip)
MP4 File (092-488-supp-video.mp4)
supplemental material
MP4 File (3528223.3530135.mp4)
presentation

References

[1]
Scott A Arvin and Donald H House. 2002. Modeling architectural design objectives in physically based space planning. Automation in Construction 11, 2 (2002), 213--225.
[2]
Fan Bao, Dong-Ming Yan, Niloy J Mitra, and Peter Wonka. 2013. Generating and exploring good building layouts. ACM Transactions on Graphics (TOG) 32, 4 (2013), 1--10.
[3]
Ying Cao, Rynson WH Lau, and Antoni B Chan. 2014. Look over here: Attention-directing composition of manga elements. ACM Transactions on Graphics (TOG) 33, 4 (2014), 1--11.
[4]
Stanislas Chaillou. 2020. ArchiGAN: Artificial Intelligence x Architecture. In Architectural Intelligence. Springer, 117--127.
[5]
Guolong Chen, Wenzhong Guo, and Yuzhong Chen. 2010. A PSO-based intelligent decision algorithm for VLSI floorplanning. Soft Computing 14, 12 (2010), 1329--1337.
[6]
Qi Chen, Qi Wu, Rui Tang, Yuhan Wang, Shuai Wang, and Mingkui Tan. 2020. Intelligent home 3d: Automatic 3d-house design from linguistic descriptions only. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 12625--12634.
[7]
Lubin Fan and Peter Wonka. 2016. A probabilistic model for exteriors of residential buildings. ACM Transactions on Graphics (TOG) 35, 5 (2016), 1--13.
[8]
Tian Feng, Lap-Fai Yu, Sai-Kit Yeung, Kang Kang Yin, and Kun Zhou. 2016. Crowd-driven mid-scale layout design. ACM Trans. Graph. 35, 4 (2016), 132--1.
[9]
Mark Hendrikx, Sebastiaan Meijer, Joeri Van Der Velden, and Alexandru Iosup. 2013. Procedural content generation for games: A survey. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 9, 1 (2013), 1--22.
[10]
Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, and Sepp Hochreiter. 2017. Gans trained by a two time-scale update rule converge to a local nash equilibrium. Advances in neural information processing systems 30 (2017).
[11]
Ruizhen Hu, Zeyu Huang, Yuhan Tang, Oliver Van Kaick, Hao Zhang, and Hui Huang. 2020. Graph2plan: Learning floorplan generation from layout graphs. ACM Transactions on Graphics (TOG) 39, 4 (2020), 118--1.
[12]
Graziella Laignel, Nicolas Pozin, Xavier Geffrier, Loukas Delevaux, Florian Brun, and Bastien Dolla. 2021. Floor plan generation through a mixed constraint programming-genetic optimization approach. Automation in Construction 123 (2021), 103491.
[13]
Manyi Li, Akshay Gadi Patil, Kai Xu, Siddhartha Chaudhuri, Owais Khan, Ariel Shamir, Changhe Tu, Baoquan Chen, Daniel Cohen-Or, and Hao Zhang. 2019. Grains: Generative recursive autoencoders for indoor scenes. ACM Transactions on Graphics (TOG) 38, 2 (2019), 1--16.
[14]
Han Liu, Yong-Liang Yang, Sawsan AlHalawani, and Niloy J Mitra. 2013. Constraint-aware interior layout exploration for pre-cast concrete-based buildings. The Visual Computer 29, 6 (2013), 663--673.
[15]
Chongyang Ma, Nicholas Vining, Sylvain Lefebvre, and Alla Sheffer. 2014. Game level layout from design specification. In Computer Graphics Forum, Vol. 33. Wiley Online Library, 95--104.
[16]
Benachir Medjdoub and Bernard Yannou. 2000. Separating topology and geometry in space planning. Computer-aided design 32, 1 (2000), 39--61.
[17]
Paul Merrell, Eric Schkufza, and Vladlen Koltun. 2010. Computer-generated residential building layouts. In ACM SIGGRAPH Asia 2010 papers. 1--12.
[18]
Jeremy Michalek, Ruchi Choudhary, and Panos Papalambros. 2002. Architectural layout design optimization. Engineering optimization 34, 5 (2002), 461--484.
[19]
Jeremy Michalek and Panos Papalambros. 2002. Interactive design optimization of architectural layouts. Engineering optimization 34, 5 (2002), 485--501.
[20]
Nelson Nauata, Kai-Hung Chang, Chin-Yi Cheng, Greg Mori, and Yasutaka Furukawa. 2020. House-gan: Relational generative adversarial networks for graph-constrained house layout generation. In European Conference on Computer Vision. Springer, 162--177.
[21]
Nelson Nauata, Sepidehsadat Hosseini, Kai-Hung Chang, Hang Chu, Chin-Yi Cheng, and Yasutaka Furukawa. 2021. House-GAN++: Generative Adversarial Layout Refinement Network towards Intelligent Computational Agent for Professional Architects. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 13632--13641.
[22]
Peter O'Donovan, Aseem Agarwala, and Aaron Hertzmann. 2014. Learning layouts for single-pagegraphic designs. IEEE transactions on visualization and computer graphics 20, 8 (2014), 1200--1213.
[23]
Xufang Pang, Ying Cao, Rynson WH Lau, and Antoni B Chan. 2016. Directing user attention via visual flow on web designs. ACM Transactions on Graphics (TOG) 35, 6 (2016), 1--11.
[24]
Wamiq Para, Paul Guerrero, Tom Kelly, Leonidas J Guibas, and Peter Wonka. 2021. Generative layout modeling using constraint graphs. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 6690--6700.
[25]
Deepak Pathak, Philipp Krahenbuhl, Jeff Donahue, Trevor Darrell, and Alexei A Efros. 2016. Context encoders: Feature learning by inpainting. In Proceedings of the IEEE conference on computer vision and pattern recognition. 2536--2544.
[26]
Chi-Han Peng, Yong-Liang Yang, Fan Bao, Daniel Fink, Dong-Ming Yan, Peter Wonka, and Niloy J Mitra. 2016. Computational network design from functional specifications. ACM Transactions on Graphics (TOG) 35, 4 (2016), 1--12.
[27]
Chi-Han Peng, Yong-Liang Yang, and Peter Wonka. 2014. Computing layouts with deformable templates. ACM Transactions on Graphics (TOG) 33, 4 (2014), 1--11.
[28]
Daniel Ritchie, Kai Wang, and Yu-an Lin. 2019. Fast and flexible indoor scene synthesis via deep convolutional generative models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 6182--6190.
[29]
Julian F Rosser, Gavin Smith, and Jeremy G Morley. 2017. Data-driven estimation of building interior plans. International Journal of Geographical Information Science 31, 8 (2017), 1652--1674.
[30]
Carl Sechen. 2012. VLSI placement and global routing using simulated annealing. Vol. 54. Springer Science & Business Media.
[31]
Krishnendra Shekhawat, Nitant Upasani, Sumit Bisht, and Rahil N Jain. 2021. A tool for computer-generated dimensioned floorplans based on given adjacencies. Automation in Construction 127 (2021), 103718.
[32]
T Singha, HS Dutta, and M De. 2012. Optimization of floor-planning using genetic algorithm. Procedia Technology 4 (2012), 825--829.
[33]
Carlos A Vanegas, Tom Kelly, Basil Weber, Jan Halatsch, Daniel G Aliaga, and Pascal Müller. 2012. Procedural generation of parcels in urban modeling. In Computer graphics forum, Vol. 31. Wiley Online Library, 681--690.
[34]
Kai Wang, Yu-An Lin, Ben Weissmann, Manolis Savva, Angel X Chang, and Daniel Ritchie. 2019. Planit: Planning and instantiating indoor scenes with relation graph and spatial prior networks. ACM Transactions on Graphics (TOG) 38, 4 (2019), 1--15.
[35]
KaiWang, Manolis Savva, Angel X Chang, and Daniel Ritchie. 2018. Deep convolutional priors for indoor scene synthesis. ACM Transactions on Graphics (TOG) 37, 4 (2018), 1--14.
[36]
Kai Wang, Xianghao Xu, Leon Lei, Selena Ling, Natalie Lindsay, Angel X Chang, Manolis Savva, and Daniel Ritchie. 2021. Roominoes: Generating Novel 3D Floor Plans From Existing 3D Rooms. In Computer Graphics Forum, Vol. 40. Wiley Online Library, 57--69.
[37]
Xiao-Yu Wang and Kang Zhang. 2020. Generating layout designs from high-level specifications. Automation in Construction 119 (2020), 103288.
[38]
Wenming Wu, Lubin Fan, Ligang Liu, and Peter Wonka. 2018. MIQP-based Layout Design for Building Interiors. In Computer Graphics Forum, Vol. 37. Wiley Online Library, 511--521.
[39]
Wenming Wu, Xiao-Ming Fu, Rui Tang, Yuhan Wang, Yu-Hao Qi, and Ligang Liu. 2019. Data-driven interior plan generation for residential buildings. ACM Transactions on Graphics (TOG) 38, 6 (2019), 1--12.
[40]
Xuyong Yang, Tao Mei, Ying-Qing Xu, Yong Rui, and Shipeng Li. 2016. Automatic generation of visual-textual presentation layout. ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM) 12, 2 (2016), 1--22.
[41]
Yong-Liang Yang, Jun Wang, Etienne Vouga, and Peter Wonka. 2013. Urban pattern: Layout design by hierarchical domain splitting. ACM Transactions on Graphics (TOG) 32, 6 (2013), 1--12.
[42]
Yi-Ting Yeh, Katherine Breeden, Lingfeng Yang, Matthew Fisher, and Pat Hanrahan. 2013. Synthesis of tiled patterns using factor graphs. ACM Transactions on Graphics (TOG) 32, 1 (2013), 1--13.
[43]
Yi-Ting Yeh, Lingfeng Yang, Matthew Watson, Noah D Goodman, and Pat Hanrahan. 2012. Synthesizing open worlds with constraints using locally annealed reversible jump mcmc. ACM Transactions on Graphics (TOG) 31, 4 (2012), 1--11.
[44]
Zaiwei Zhang, Zhenpei Yang, Chongyang Ma, Linjie Luo, Alexander Huth, Etienne Vouga, and Qixing Huang. 2020. Deep generative modeling for scene synthesis via hybrid representations. ACM Transactions on Graphics (TOG) 39, 2 (2020), 1--21.
[45]
Xinru Zheng, Xiaotian Qiao, Ying Cao, and Rynson WH Lau. 2019. Content-aware generative modeling of graphic design layouts. ACM Transactions on Graphics (TOG) 38, 4 (2019), 1--15.
[46]
Lichen Zhou, Chuang Zhang, and Ming Wu. 2018. D-linknet: Linknet with pretrained encoder and dilated convolution for high resolution satellite imagery road extraction. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops. 182--186.
[47]
Yang Zhou, Zachary While, and Evangelos Kalogerakis. 2019. Scenegraphnet: Neural message passing for 3d indoor scene augmentation. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 7384--7392.

Cited By

View all
  • (2024)Raster‐to‐Graph: Floorplan Recognition via Autoregressive Graph Prediction with an Attention TransformerComputer Graphics Forum10.1111/cgf.1500743:2Online publication date: 17-Apr-2024
  • (2024)PlanNet: A Generative Model for Component-Based Plan SynthesisIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.327520030:8(4739-4751)Online publication date: 1-Aug-2024
  • (2024)MorphNeRF: Text-Guided 3D-Aware Editing via Morphing Generative Neural Radiance FieldsIEEE Transactions on Multimedia10.1109/TMM.2024.337988826(8516-8528)Online publication date: 1-Jan-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics
ACM Transactions on Graphics  Volume 41, Issue 4
July 2022
1978 pages
ISSN:0730-0301
EISSN:1557-7368
DOI:10.1145/3528223
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 July 2022
Published in TOG Volume 41, Issue 4

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. deep learning
  2. floorplan generation
  3. graph traversal

Qualifiers

  • Research-article

Funding Sources

  • the Fundamental Research Funds for the Central Universities of China
  • the National Natural Science Foundation of China

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)323
  • Downloads (Last 6 weeks)15
Reflects downloads up to 26 Sep 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Raster‐to‐Graph: Floorplan Recognition via Autoregressive Graph Prediction with an Attention TransformerComputer Graphics Forum10.1111/cgf.1500743:2Online publication date: 17-Apr-2024
  • (2024)PlanNet: A Generative Model for Component-Based Plan SynthesisIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.327520030:8(4739-4751)Online publication date: 1-Aug-2024
  • (2024)MorphNeRF: Text-Guided 3D-Aware Editing via Morphing Generative Neural Radiance FieldsIEEE Transactions on Multimedia10.1109/TMM.2024.337988826(8516-8528)Online publication date: 1-Jan-2024
  • (2024)MMNet: Multi-Collaboration and Multi-Supervision Network for Sequential Deepfake DetectionIEEE Transactions on Information Forensics and Security10.1109/TIFS.2024.336115119(3409-3422)Online publication date: 1-Jan-2024
  • (2024)Constrained Layout Generation with Factor Graphs2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.01221(12851-12860)Online publication date: 16-Jun-2024
  • (2024)MaskPLAN: Masked Generative Layout Planning from Partial Input2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR52733.2024.00856(8964-8973)Online publication date: 16-Jun-2024
  • (2024)Generating 3D House Wireframes with SemanticsComputer Vision – ECCV 202410.1007/978-3-031-72670-5_13(223-240)Online publication date: 30-Sep-2024
  • (2024)Artificial Intelligence for Predicting Reuse PatternsA Circular Built Environment in the Digital Age10.1007/978-3-031-39675-5_4(57-78)Online publication date: 4-Jan-2024
  • (2024) Automating computational design with generative AI Civil Engineering Design10.1002/cend.2024000066:2(41-52)Online publication date: 17-Jul-2024
  • (2023)Reconversion of a building to a new functional program using graph matchingInternational Journal of Architectural Computing10.1177/14780771231197790Online publication date: 12-Sep-2023
  • Show More Cited By

View Options

Get Access

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media