research-article

SmartBoxes for interactive urban reconstruction

Authors:

Liangliang Nan,

Daniel Cohen-Or,

Baoquan ChenAuthors Info & Claims

SIGGRAPH '10: ACM SIGGRAPH 2010 papers

Article No.: 93, Pages 1 - 10

https://doi.org/10.1145/1833349.1778830

Published: 26 July 2010 Publication History

Abstract

We introduce an interactive tool which enables a user to quickly assemble an architectural model directly over a 3D point cloud acquired from large-scale scanning of an urban scene. The user loosely defines and manipulates simple building blocks, which we call SmartBoxes, over the point samples. These boxes quickly snap to their proper locations to conform to common architectural structures. The key idea is that the building blocks are smart in the sense that their locations and sizes are automatically adjusted on-the-fly to fit well to the point data, while at the same time respecting contextual relations with nearby similar blocks. SmartBoxes are assembled through a discrete optimization to balance between two snapping forces defined respectively by a data-fitting term and a contextual term, which together assist the user in reconstructing the architectural model from a sparse and noisy point cloud. We show that a combination of the user's interactive guidance and high-level knowledge about the semantics of the underlying model, together with the snapping forces, allows the reconstruction of structures which are partially or even completely missing from the input.

Supplementary Material

MP4 File (tp120-10.mp4)

Download
62.34 MB

References

[1]

Bokeloh, M., Berner, A., Wand, M., Seidel, H.-P., and Schilling, A. 2009. Symmetry detection using feature lines. Computer Graphics Forum (Proceedings of Eurographics) 28, 2, 697--706.

[2]

Chen, X., Kang, S. B., Xu, Y.-Q., Dorsey, J., and Shum, H.-Y. 2008. Sketching reality: Realistic interpretation of architectural designs. ACM Trans. on Graphics 27, 2, 1--15.

Digital Library

[3]

Debevec, P. E., Taylor, C. J., and Malik, J. 1996. Modeling and rendering architecture from photographs: A hybrid geometry- and image-based approach. Proc. of ACM SIGGRAPH, 11--20.

Digital Library

[4]

Dick, A. R., Torr, P. H. S., and Cipolla, R. 2004. Modelling and interpretation of architecture from several images. Int. J. Comput. Vision 60, 2, 111--134.

Digital Library

[5]

Früh, C., Jain, S., and Zakhor, A. 2005. Data processing algorithms for generating textured 3d building facade meshes from laser scans and camera images. Int. J. Comput. Vision 61, 2.

Digital Library

[6]

Furukawa, Y., Curless, B., Seitz, S. M., and Szeliski, R. 2009. Reconstructing building interiors from images.

[7]

Furukawa, Y., Curless, B., Seitz, S. M., and Szeliski, R. 2009. Manhattan-world stereo. In Proc. of IEEE Conf. on Comp. Vis. and Pat. Rec., 1422--1429.

[8]

Gal, R., Shamir, A., Hassner, T., Pauly, M., and Cohen-Or, D. 2007. Surface reconstruction using local shape priors. In Proc. of Eurographics Symp. on Geometry Processing, 253--262.

Digital Library

[9]

Goesele, M., Snavely, N., Curless, B., Hoppe, H., and Seitz, S. 2007. Multi-view stereo for community photo collections. In Proc. of Int. Conf. on Comp. Vis., 1--8.

[10]

Hohmann, B., Krispel, U., Havemann, S., and Fellner, D. W. 2009. Cityfit: High-quality urban recontrustion by fitting shape grammars to images and derived textured point clouds. In Proceedings of the 3rd ISPRS Workshop.

[11]

Jiang, N., Tan, P., and Cheong, L.-F. 2009. Symmetric architecture modeling with a single image. ACM Trans. on Graphics 28, 5, 1--8.

Digital Library

[12]

Levoy, M., Pulli, K., Curless, B., Rusinkiewicz, S., Koller, D., Pereira, L., Ginzton, M., Anderson, S., Davis, J., Ginsberg, J., Shade, J., and Fulk, D. 2000. The digital michelangelo project: 3D scanning of large statues. In Proc. of ACM SIGGRAPH, 131--144.

Digital Library

[13]

Müller, P., Wonka, P., Haegler, S., Ulmer, A., and Van Gool, L. 2006. Procedural modeling of buildings. ACM Trans. on Graphics 25, 3, 614--623.

Digital Library

[14]

Müller, P., Zeng, G., Wonka, P., and Gool, L. J. V. 2007. Image-based procedural modeling of facades. ACM Trans. on Graphics 26, 3, 85.

Digital Library

[15]

Parish, Y. I. H., and Müller, P. 2001. Procedural modeling of cities. In Proc. of ACM SIGGRAPH, 301--308.

Digital Library

[16]

Pauly, M., Mitra, N. J., Giesen, J., Gross, M., and Guibas, L. J. 2005. Example-based 3D scan completion. In Proc. of Eurographics Symp. on Geometry Processing, 23.

Digital Library

[17]

Pauly, M., Mitra, N. J., Wallner, J., Pottmann, H., and Guibas, L. 2008. Discovering structural regularity in 3D geometry. ACM Trans. on Graphics 27, 3.

Digital Library

[18]

Pollefeys, M., Nistér, D., Frahm, J. M., Akbarzadeh, A., Mordohai, P., Clipp, B., Engels, C., Gallup, D., Kim, S. J., Merrell, P., Salmi, C., Sinha, S., Talton, B., Wang, L., Yang, Q., Stewénius, H., Yang, R., Welch, G., and Towles, H. 2008. Detailed real-time urban 3D reconstruction from video. Int. J. Comput. Vision 78, 2--3, 143--167.

Digital Library

[19]

Schindler, K., and Bauer, J. 2003. A model-based method for building reconstruction. In Proc. of IEEE Workshop on Higher-Level Knowledge in 3D Modeling and Motion Analysis, 74.

Digital Library

[20]

Schnabel, R., Wahl, R., and Klein, R. 2007. Efficient RANSAC for point-cloud shape detection. Computer Graphics Forum 26, 2, 214--226.

[21]

Schnabel, R., Degener, P., and Klein, R. 2009. Completion and reconstruction with primitive shapes. Computer Graphics Forum (Proc. of Eurographics) 28, 2, 503--512.

[22]

Sinha, S. N., Steedly, D., Szeliski, R., Agrawala, M., and Pollefeys, M. 2008. Interactive 3D architectural modeling from unordered photo collections. ACM Trans. on Graphics 27, 5, 1--10.

Digital Library

[23]

Vanegas, C. A., Aliaga, D. G., Wonka, P., Mueller, P., Waddell, P., and Watson, B. 2009. Modeling the appearance and behavior of urban spaces. In Proc. of Eurographics State-of-the-Art Report.

[24]

Werner, T., and Zisserman, A. 2002. New techniques for automated architecture reconstruction from photographs. In Proceedings of the 7th European Conference on Computer Vision, Copenhagen, Denmark, vol. 2, 541--555.

Digital Library

[25]

Wonka, P., Wimmer, M., Sillion, F., and Ribarsky, W. 2003. Instant architecture. ACM Trans. on Graphics 22, 3, 669--677.

Digital Library

[26]

Xiao, J., Fang, T., Tan, P., Zhao, P., Ofek, E., and Quan, L. 2008. Image-based façade modeling. ACM Trans. on Graphics 27, 5, 1--10.

Digital Library

[27]

Xiao, J., Fang, T., Zhao, P., Maxime, L., and Quan, L. 2009. Image-based street-side city modeling. ACM Trans. on Graphics 28, 5, 1--12.

Digital Library

[28]

Zebedin, L., Bauer, J., Karner, K., and Bischof, H. 2008. Fusion of feature- and area-based information for urban buildings modeling from aerial imagery. In Proc. Euro. Conf. on Comp. Vis., 873--886.

Digital Library

Cited By

Ding ZLu YShao SQin YLu MSong ZSun D(2025)Research on 3D Reconstruction Methods for Incomplete Building Point Clouds Using Deep Learning and Geometric PrimitivesRemote Sensing10.3390/rs1703039917:3(399)Online publication date: 24-Jan-2025
https://doi.org/10.3390/rs17030399
Li TZhang ZWang YCui YLi YZhou DYin BYang X(2024)Self-supervised indoor scene point cloud completion from a single panoramaThe Visual Computer10.1007/s00371-024-03509-w41:3(1891-1905)Online publication date: 17-Jun-2024
https://doi.org/10.1007/s00371-024-03509-w
Yu HCao JLiu XChen Z(2024)Regularity-constrained point cloud reconstruction of building models via global alignmentThe Visual Computer10.1007/s00371-023-03241-x40:11(8363-8375)Online publication date: 20-Jan-2024
https://doi.org/10.1007/s00371-023-03241-x
Show More Cited By

Index Terms

SmartBoxes for interactive urban reconstruction

Recommendations

SmartBoxes for interactive urban reconstruction

We introduce an interactive tool which enables a user to quickly assemble an architectural model directly over a 3D point cloud acquired from large-scale scanning of an urban scene. The user loosely defines and manipulates simple building blocks, which ...
The Spatial Reconstruction and Evolution of Urban Fringe Villages: A Case Study of Zhengzhou
ICETCE '12: Proceedings of the 2012 Second International Conference on Electric Technology and Civil Engineering

The urbanization of urban fringe villages have these characteristics. With the rapid expansion of cities, the space of urban fring villages are reconstructed. By a case study of Zheng zhou, this paper analysises the spatial reconstruction and evolution ...
Layer-Wise Floorplan Extraction for Automatic Urban Building Reconstruction
Urban building reconstruction is an important step for urban digitization and realisticvisualization. In this paper, we propose a novel automatic method to recover urban building geometry from 3D point clouds. The proposed method is suitable for buildings ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGGRAPH '10: ACM SIGGRAPH 2010 papers

July 2010

984 pages

ISBN:9781450302104

DOI:10.1145/1833349

Conference Chair:
Tony DeRose,
Editor:
Hugues Hoppe
ACM Transactions on Graphics

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 July 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Funding Sources

Ministry of Science and Technology of the People's Republic of China
Shenzhen Science and Technology Foundation
National Natural Science Foundation of China
Natural Sciences and Engineering Research Council of Canada

Conference

SIGGRAPH '10

Sponsor:

SIGGRAPH

SIGGRAPH '10: Special Interest Group on Computer Graphics and Interactive Techniques Conference

July 26 - 30, 2010

California, Los Angeles

Acceptance Rates

SIGGRAPH '10 Paper Acceptance Rate 103 of 390 submissions, 26%;

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

37
Total Citations
View Citations
1,914
Total Downloads

Downloads (Last 12 months)24
Downloads (Last 6 weeks)0

Reflects downloads up to 11 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Ding ZLu YShao SQin YLu MSong ZSun D(2025)Research on 3D Reconstruction Methods for Incomplete Building Point Clouds Using Deep Learning and Geometric PrimitivesRemote Sensing10.3390/rs1703039917:3(399)Online publication date: 24-Jan-2025
https://doi.org/10.3390/rs17030399
Li TZhang ZWang YCui YLi YZhou DYin BYang X(2024)Self-supervised indoor scene point cloud completion from a single panoramaThe Visual Computer10.1007/s00371-024-03509-w41:3(1891-1905)Online publication date: 17-Jun-2024
https://doi.org/10.1007/s00371-024-03509-w
Yu HCao JLiu XChen Z(2024)Regularity-constrained point cloud reconstruction of building models via global alignmentThe Visual Computer10.1007/s00371-023-03241-x40:11(8363-8375)Online publication date: 20-Jan-2024
https://doi.org/10.1007/s00371-023-03241-x
Szabo AHaaser GSteinlechner HWalch AMaierhofer SOrtner TGröller M(2023)Feature-assisted interactive geometry reconstruction in 3D point clouds using incremental region growingComputers & Graphics10.1016/j.cag.2023.02.004111(213-224)Online publication date: Apr-2023
https://doi.org/10.1016/j.cag.2023.02.004
Huang JStoter JPeters RNan L(2022)City3D: Large-Scale Building Reconstruction from Airborne LiDAR Point CloudsRemote Sensing10.3390/rs1409225414:9(2254)Online publication date: 7-May-2022
https://doi.org/10.3390/rs14092254
Sellán SJacobson A(2022)Stochastic Poisson Surface ReconstructionACM Transactions on Graphics10.1145/3550454.355544141:6(1-12)Online publication date: 30-Nov-2022
https://dl.acm.org/doi/10.1145/3550454.3555441
Eilaf MAlekseev YMajorzadehzahiri A(2021)Analysis and evaluation of urban socioeconomic dimensionsVestnik MGSU10.22227/1997-0935.2021.7.801-808(801-808)Online publication date: Jul-2021
https://doi.org/10.22227/1997-0935.2021.7.801-808
He ZWang YCheng Z(2021)Manhattan‐world urban building reconstruction by fitting cubesComputer Graphics Forum10.1111/cgf.1442140:7(289-300)Online publication date: 27-Nov-2021
https://doi.org/10.1111/cgf.14421
Hanocka RMetzer GGiryes RCohen-Or D(2020)Point2MeshACM Transactions on Graphics10.1145/3386569.339241539:4(126:1-126:12)Online publication date: 12-Aug-2020
https://dl.acm.org/doi/10.1145/3386569.3392415
Wen XXie HLiu HYan L(2019)Accurate Reconstruction of the LoD3 Building Model by Integrating Multi-Source Point Clouds and Oblique Remote Sensing ImageryISPRS International Journal of Geo-Information10.3390/ijgi80301358:3(135)Online publication date: 8-Mar-2019
https://doi.org/10.3390/ijgi8030135
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten