research-article

A benchmark for 3D mesh segmentation

Authors:

Aleksey Golovinskiy,

Thomas FunkhouserAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 28, Issue 3

Article No.: 73, Pages 1 - 12

https://doi.org/10.1145/1531326.1531379

Published: 27 July 2009 Publication History

Abstract

This paper describes a benchmark for evaluation of 3D mesh segmentation salgorithms. The benchmark comprises a data set with 4,300 manually generated segmentations for 380 surface meshes of 19 different object categories, and it includes software for analyzing 11 geometric properties of segmentations and producing 4 quantitative metrics for comparison of segmentations. The paper investigates the design decisions made in building the benchmark, analyzes properties of human-generated and computer-generated segmentations, and provides quantitative comparisons of 7 recently published mesh segmentation algorithms. Our results suggest that people are remarkably consistent in the way that they segment most 3D surface meshes, that no one automatic segmentation algorithm is better than the others for all types of objects, and that algorithms based on non-local shape features seem to produce segmentations that most closely resemble ones made by humans.

Supplementary Material

JPG File (tps078_09.jpg)

Download
10.02 KB

Zip (73-307.zip)

The auxiliary materials are all accessible via index.html. Further information can be found at http://segeval.cs.princeton.edu

Download
135.67 MB

MP4 File (tps078_09.mp4)

Download
37.79 MB

References

[1]

Agathos, A., Pratikakis, I., Perantonis, S., Sapidis, N., and Azariadis, P. 2007. 3d mesh segmentation methodologies for cad applications. 827--841.

[2]

Amazon, 2008. Mechanical turk. www.mturk.com.

[3]

Attene, M., Katz, S., Mortara, M., Patane, G., Spagnuolo, M., and Tal, A. 2006. Mesh segmentation - a comparative study. In SMI '06: Proceedings of the IEEE International Conference on Shape Modeling and Applications 2006, IEEE Computer Society, Washington, DC, USA, 7.

Digital Library

[4]

Attene, M., Falcidieno, B., and Spagnuolo, M. 2006. Hierarchical mesh segmentation based on fitting primitives. Vis. Comput. 22, 3, 181--193.

Digital Library

[5]

Benhabiles, H., Vandeborre, J., Lavoue, G., and Daoudi, M. 2009. A framework for the objective evaluation of segmentation algorithms using a ground-truth of human segmented 3d-models. In Shape Modeling International.

[6]

Biasotti, S., Marini, S., Mortara, M., and Patan&#232;, G. 2003. An overview on properties and efficacy of topological skeletons in shape modelling. In Shape Modeling International, 245--256, 297.

Digital Library

[7]

Biederman, I. 1987. Recognition-by-components: A theory of human image understanding. Psychological Review 94, 2, 115--147.

[8]

Chazelle, B., Dobkin, D., Shourhura, N., and Tal, A. 1997. Strategies for polyhedral surface decomposition: An experimental study. Computational Geometry: Theory and Applications 7, 4--5, 327--342.

Digital Library

[9]

Correia, P., and Pereira, F. 2000. Objective evaluation of relative segmentation quality. In ICIP00, Vol I: 308--311.

[10]

Everingham, M., Muller, H., and Thomas, B. T. 2002. Evaluating image segmentation algorithms using the pareto front. In ECCV '02: Proceedings of the 7th European Conference on Computer Vision-Part IV, Springer-Verlag, London, UK, 34--48.

Digital Library

[11]

Federico, M., Giordani, D., and Coletti, P. 2000. Development and evaluation of an Italian broadcast news corpus. In Second International Conference on Language Resources and Evaluation (LREC), 921--924.

[12]

Funkhouser, T., Kazhdan, M., Shilane, P., Min, P., Kiefer, W., Tal, A., Rusinkiewicz, S., and Dobkin, D. 2004. Modeling by example. ACM Trans. Graph. 23, 3, 652--663.

Digital Library

[13]

Garland, M., Willmott, A., and Heckbert, P. S. 2001. Hierarchical face clustering on polygonal surfaces. In I3D '01: Proceedings of the 2001 symposium on Interactive 3D graphics, ACM, New York, NY, USA, 49--58.

Digital Library

[14]

Gelfand, N., and Guibas, L. J. 2004. Shape segmentation using local slippage analysis. In SGP '04: Proceedings of the 2004 Eurographics/ACM SIGGRAPH symposium on Geometry processing, ACM, New York, NY, USA, 214--223.

Digital Library

[15]

Giorgi, D., Biasotti, S., and Paraboschi, L., 2007. SHREC:SHape REtrieval Contest: Watertight models track, http://watertight.ge.imati.cnr.it/.

[16]

Golovinskiy, A., and Funkhouser, T. 2008. Randomized cuts for 3D mesh analysis. ACM Transactions on Graphics (Proc. SIGGRAPH ASIA) 27, 5 (Dec.).

Digital Library

[17]

Gregory, A. D., State, A., Lin, M. C., Manocha, D., and Livingston, M. A. 1999. Interactive surface decomposition for polyhedral morphing. The Visual Computer 15, 9, 453--470.

Digital Library

[18]

Hoffman, D. D., and Singh, M. 1997. Salience of visual parts. Cognition 63, 29--78.

[19]

Hoffman, D. D., Richards, W., Pentl, A., Rubin, J., and Scheuhammer, J. 1984. Parts of recognition. Cognition 18, 65--96.

[20]

Huang, Q., and Dom, B. 1995. Quantitative methods of evaluating image segmentation. In ICIP '95: Proceedings of the 1995 International Conference on Image Processing (Vol. 3)-Volume 3, IEEE Computer Society, Washington, DC, USA, 3053.

Digital Library

[21]

Katz, S., and Tal, A. 2003. Hierarchical mesh decomposition using fuzzy clustering and cuts. ACM Transactions on Graphics (Proc. SIGGRAPH) 22, 3 (July), 954--961.

Digital Library

[22]

Katz, S., Leifman, G., and Tal, A. 2005. Mesh segmentation using feature point and core extraction. The Visual Computer 21, 8--10, 649--658.

[23]

Kraevoy, V., Julius, D., and Sheffer, A. 2007. Shuffler: Modeling with interchangeable parts. In Pacific Graphics.

[24]

Lai, Y.-K., Hu, S.-M., Martin, R. R., and Rosin, P. L. 2008. Fast mesh segmentation using random walks. In Symposium on Solid and Physical Modeling, 183--191.

Digital Library

[25]

Lee, Y., Lee, S., Shamir, A., Cohen-Or, D., and Seidel, H.-P. 2004. Intelligent mesh scissoring using 3D snakes. In 12th Pacific Conference on Computer Graphics and Applications (PG).

Digital Library

[26]

L&#233;vy, B., Petitjean, S., Ray, N., and Maillot, J. 2002. Least squares conformal maps for automatic texture atlas generation. ACM Trans. Graph. 21, 3, 362--371.

Digital Library

[27]

Lin, H.-Y. S., Liao, H.-Y. M., and Lin, J.-C. 2007. Visual salience-guided mesh decomposition. IEEE Transactions on Multimedia 9, 1, 46--57.

Digital Library

[28]

Liu, R., and Zhang, H. 2004. Segmentation of 3d meshes through spectral clustering. In PG '04: Proceedings of the Computer Graphics and Applications, 12th Pacific Conference, IEEE Computer Society, Washington, DC, USA, 298--305.

Digital Library

[29]

Martin, D., Fowlkes, C., Tal, D., and Malik, J. 2001. A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In in Proc. 8th Intl Conf. Computer Vision, 416--423.

[30]

Mortara, M., Patane, G., Spagnuolo, M., Falcidieno, B., and Rossignac, J. 2004. Blowing bubbles for the multi-scale analysis and decomposition of triangle meshes. Algorithmica (Special Issues on Shape Algorithms) 38, 2, 227--248.

Digital Library

[31]

Mortara, M., Patan&#232;, G., Spagnuolo, M., Falcidieno, B., and Rossignac, J. 2004. Plumber: a method for a multi-scale decomposition of 3D shapes into tubular primitives and bodies. In ACM symposium on Solid modeling and applications, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, 339--344.

Digital Library

[32]

Over, P., Leung, C., Ip, H., and Grubinger, M. 2004. Multimedia retrieval benchmarks. IEEE MultiMedia 11, 2, 80--84.

Digital Library

[33]

Rand, W. 1971. Objective criteria for the evaluation of clustering methods. Journal of the American Statistical Association 66, 846--850.

[34]

Robbiano, F., Attene, M., Spagnuolo, M., and Falcidieno, B. 2007. Part-based annotation of virtual 3d shapes. In CW '07: Proceedings of the 2007 International Conference on Cyberworlds, IEEE Computer Society, Washington, DC, USA, 427--436.

Digital Library

[35]

Russell, B. C., Torralba, A., Murphy, K. P., and Freeman, W. T. 2008. Labelme: A database and web-based tool for image annotation. Int. J. Comput. Vision 77, 1--3, 157--173.

Digital Library

[36]

Shamir, A. 2008. A survey on mesh segmentation techniques. Computer Graphics Forum 28, 6, 1539--1556.

[37]

Shapira, L., Shamir, A., and Cohen-Or, D. 2008. Consistent mesh partitioning and skeletonisation using the shape diameter function. Vis. Comput. 24, 4, 249--259.

Digital Library

[38]

Shilane, P., Min, P., Kazhdan, M., and Funkhouser, T. 2004. The princeton shape benchmark. In Shape Modeling International, IEEE Computer Society, Washington, DC, USA, 167--178.

Digital Library

[39]

Shlafman, S., Tal, A., and Katz, S., 2002. Metamorphosis of polyhedral surfaces using decomposition.

[40]

Smeaton, A. F., Kraaij, W., and Over, P. 2004. TREC video retrieval evaluation: a case study and status report. In Coupling Approaches, Coupling Media and Coupling Languages for Information Retrieval (RIAO).

[41]

Unnikrishnan, R., Pantofaru, C., and Hebert, M. 2005. A measure for objective evaluation of image segmentation algorithms. In Proceedings of the 2005 IEEE Conference on Computer Vision and Pattern Recognition (CVPR '05), Workshop on Empirical Evaluation Methods in Computer Vision, vol. 3, 34--41.

Digital Library

[42]

Wu, H.-Y., Pan, C., Pan, J., Yang, Q., and Ma, S. 2007. A sketch-based interactive framework for real-time mesh segmentation. In Computer Graphics International.

[43]

Zhang, H., Fritts, J. E., and Goldman, S. A. 2008. Image segmentation evaluation: A survey of unsupervised methods. Comput. Vis. Image Underst. 110, 2, 260--280.

Digital Library

[44]

Zhang, Y. 1996. A survey on evaluation methods for image segmentation. PR 29, 8 (August), 1335--1346.

[45]

Z&#246;ckler, M., Stalling, D., and Hege, H.-C. 2000. Fast and intuitive generation of geometric shape transitions. The Visual Computer 16(5), 241--253.

[46]

Zuckerberger, E. 2002. Polyhedral surface decomposition with applications. Computers and Graphics 26, 5 (October), 733--743.

Cited By

Shu ZLi SXin SLiu L(2025)3D Shape Segmentation With Potential Consistency Mining and EnhancementIEEE Transactions on Multimedia10.1109/TMM.2024.352167427(133-144)Online publication date: 1-Jan-2025
https://dl.acm.org/doi/10.1109/TMM.2024.3521674
Gao KHorng JChang CChang C(2025)Crypto-space reversible data hiding for 3D mesh models with k-Degree neighbor diffusionJournal of Information Security and Applications10.1016/j.jisa.2024.10395789(103957)Online publication date: Mar-2025
https://doi.org/10.1016/j.jisa.2024.103957
He YYu HLiu XYang ZSun WAnwar SMian A(2025)Deep learning based 3D segmentation in computer vision: A surveyInformation Fusion10.1016/j.inffus.2024.102722115(102722)Online publication date: Mar-2025
https://doi.org/10.1016/j.inffus.2024.102722
Show More Cited By

Recommendations

A benchmark for 3D mesh segmentation
SIGGRAPH '09: ACM SIGGRAPH 2009 papers

This paper describes a benchmark for evaluation of 3D mesh segmentation salgorithms. The benchmark comprises a data set with 4,300 manually generated segmentations for 380 surface meshes of 19 different object categories, and it includes software for ...
A comprehensive overview of methodologies and performance evaluation frameworks in 3D mesh segmentation

An overview of the state-of-the-art in 3D mesh segmentation.An overview of performance evaluation frameworks for 3D mesh segmentation.New categorization for 3D mesh segmentation methodologies.Pros and cons in performance evaluation frameworks. 3D mesh ...
Joint labelling and segmentation for 3D scanned human body
SA '16: SIGGRAPH ASIA 2016 Virtual Reality meets Physical Reality: Modelling and Simulating Virtual Humans and Environments

In this paper, we present an approach to perform 3D human body labelling and segmentation jointly. Given a 3D mesh of scanned human body with texture, our approach segments it into 5 parts: head, torso, arms, legs and feet automatically. We assume that ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 28, Issue 3

August 2009

750 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/1531326

Issue’s Table of Contents

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 July 2009

Published in TOG Volume 28, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

516
Total Citations
View Citations
3,324
Total Downloads

Downloads (Last 12 months)156
Downloads (Last 6 weeks)20

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Shu ZLi SXin SLiu L(2025)3D Shape Segmentation With Potential Consistency Mining and EnhancementIEEE Transactions on Multimedia10.1109/TMM.2024.352167427(133-144)Online publication date: 1-Jan-2025
https://dl.acm.org/doi/10.1109/TMM.2024.3521674
Gao KHorng JChang CChang C(2025)Crypto-space reversible data hiding for 3D mesh models with k-Degree neighbor diffusionJournal of Information Security and Applications10.1016/j.jisa.2024.10395789(103957)Online publication date: Mar-2025
https://doi.org/10.1016/j.jisa.2024.103957
He YYu HLiu XYang ZSun WAnwar SMian A(2025)Deep learning based 3D segmentation in computer vision: A surveyInformation Fusion10.1016/j.inffus.2024.102722115(102722)Online publication date: Mar-2025
https://doi.org/10.1016/j.inffus.2024.102722
Gu ZYang EDavis A(2024)Filter-Guided Diffusion for Controllable Image GenerationACM SIGGRAPH 2024 Conference Papers10.1145/3641519.3657489(1-10)Online publication date: 13-Jul-2024
https://dl.acm.org/doi/10.1145/3641519.3657489
Afzaal HAlim U(2024)Evaluating Force-Based Haptics for Immersive Tangible Interactions with Surface VisualizationsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2024.345631631:1(886-896)Online publication date: 10-Sep-2024
https://dl.acm.org/doi/10.1109/TVCG.2024.3456316
Yazgan MSahillioğlu Y(2024)A Partition Based Method for Spectrum-Preserving Mesh SimplificationIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.334161030:10(6839-6850)Online publication date: Oct-2024
https://doi.org/10.1109/TVCG.2023.3341610
Zhao ZXie WZuo BWang Y(2024)Skeleton Extraction for Articulated Objects With the Spherical Unwrapping ProfilesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.323937030:7(3731-3748)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1109/TVCG.2023.3239370
Umam AYang CChuang JLin Y(2024)Unsupervised Point Cloud Co-Part Segmentation via Co-Attended Superpoint Generation and AggregationIEEE Transactions on Multimedia10.1109/TMM.2024.337129426(7775-7786)Online publication date: 28-Feb-2024
https://dl.acm.org/doi/10.1109/TMM.2024.3371294
Hou GOu BLong MPeng F(2024)Separable Reversible Data Hiding for Encrypted 3D Mesh Models Based on Octree Subdivision and Multi-MSB PredictionIEEE Transactions on Multimedia10.1109/TMM.2023.329557826(2395-2407)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TMM.2023.3295578
Shu ZWu TShen JXin SLiu L(2024)Semi-Supervised 3D Shape Segmentation via Self RefiningIEEE Transactions on Image Processing10.1109/TIP.2024.337420033(2044-2057)Online publication date: 12-Mar-2024
https://dl.acm.org/doi/10.1109/TIP.2024.3374200
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents