research-article

Schelling points on 3D surface meshes

Authors:

Abulhair Saparov,

Thomas FunkhouserAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 31, Issue 4

Article No.: 29, Pages 1 - 12

https://doi.org/10.1145/2185520.2185525

Published: 01 July 2012 Publication History

Abstract

This paper investigates "Schelling points" on 3D meshes, feature points selected by people in a pure coordination game due to their salience. To collect data for this investigation, we designed an online experiment that asked people to select points on 3D surfaces that they expect will be selected by other people. We then analyzed properties of the selected points, finding that: 1) Schelling point sets are usually highly symmetric, and 2) local curvature properties (e.g., Gauss curvature) are most helpful for identifying obvious Schelling points (tips of protrusions), but 3) global properties (e.g., segment centeredness, proximity to a symmetry axis, etc.) are required to explain more subtle features. Based on these observations, we use regression analysis to combine multiple properties into an analytical model that predicts where Schelling points are likely to be on new meshes. We find that this model benefits from a variety of surface properties, particularly when training data comes from examples in the same object class.

Supplementary Material

JPG File (tp100_12.jpg)

Download
20.71 KB

MP4 File (tp100_12.mp4)

Download
29.73 MB

References

[1]

Alexa, M. 2000. Merging polyhedral shapes with scattered features. Visual Computer 16, 26--37.

Digital Library

[2]

Amazon, 2009. Mechanical turk. http://www.mturk.com.

[3]

Attneave, F. 1954. Some informational aspects of visual perception. Psychological Review 61, 3.

[4]

Breiman, L. 2001. Random forests. Machine Learning 45, 1, 5--32.

Digital Library

[5]

Bronstein, A., Bronstein, M., and Kimmel, R. 2006. Generalized multidimensional scaling: A framework for isometry-invariant partial surface matching. Proceedings of the National Academy of Science, 1168--1172.

[6]

Bronstein, A., Bronstein, M., Bustos, B., Castellani, U., Crisani, M., Falcidieno, B., Guibas, L., Kokkinos, I., Murino, V., Ovsjanikov, M., Patane, G., Sipiran, I., Spagnuolo, M., and Sun, J. 2010. SHREC 2011: robust feature detection and description benchmark. In Eurographics Workshop on 3D Object Retrieval.

Digital Library

[7]

Castellani, U., Cristani, M., Fantoni, S., and Murino, V. 2008. Sparse points matching by combining 3d mesh saliency with statistical descriptors. Computer Graphics Forum 27, 2, 643--652.

[8]

Chen, X., Golovinskiy, A., and Funkhouser, T. 2009. A benchmark for 3D mesh segmentation. ACM Transactions on Graphics (Proc. SIGGRAPH) 28, 3 (Aug.).

Digital Library

[9]

Chua, C., and Jarvis, R. 1996. Point signatures: A new representation for 3D object recognition. International Journal of Computer Vision 25, 1, 63--85.

Digital Library

[10]

Cole, F., Golovinskiy, A., Limpaecher, A., Barros, H. S., Finkelstein, A., Funkhouser, T., and Rusinkiewicz, S. 2008. Where do people draw lines? ACM Transactions on Graphics (Proc. SIGGRAPH) 27, 3 (Aug.).

Digital Library

[11]

Cole, F., Sanik, K., DeCarlo, D., Finkelstein, A., Funkhouser, T., and an d Manish Singh, S. R. 2009. How well do line drawings depict shape? ACM Transactions on Graphics (Proc. SIGGRAPH) 28, 3 (Aug.).

Digital Library

[12]

Funkhouser, T., and Shilane, P. 2006. Partial matching of 3d shapes with priority-driven search. In Symposium on Geometry Processing.

Digital Library

[13]

Gal, R., and Cohen-Or, D. 2006. Salient geometric features for partial shape matching and similarity. ACM Transaction on Graphics (January).

Digital Library

[14]

Garland, M., and Heckbert, P. S. 1997. Surface simplification using quadric error metrics. In Proceedings of SIGGRAPH 1997, Computer Graphics Proceedings, Annual Conference Series, 209--216.

Digital Library

[15]

Giorgi, D., Biasotti, S., and Paraboschi, L., 2007. SHREC:SHape REtrieval Contest: Watertight models track, http://watertight.ge.imati.cnr.it/.

[16]

Heer, J., and Bostock, M. 2010. Crowdsourcing graphical perception: Using Mechanical Turk to assess visualization design. In ACM Human Factors in Computing Systems (CHI), 203--212.

Digital Library

[17]

Hisada, M., Belyaev, A., and Kunii, T. 2002. A skeleton-based approach for detection of perceptually salient features on polygonal surfaces. Computer Graphics Forum 21, 4, 689--700.

[18]

Hoffman, D. D., and Singh, M. 1997. Salience of visual parts. vol. 63.

[19]

Huang, T., Cheng, K., and Chuang, Y. 2009. A collaborative benchmark for region of interest detection algorithms. 296--303.

[20]

Itti, L., Koch, C., and Neibur, E. 1998. A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 20, 11, 1254--1259.

Digital Library

[21]

Johnson, A. 2000. Surface landmark selection and matching in natural terrain. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 2, 413--420. Using saliency in choosing spin images.

[22]

Kalogerakis, E., Hertzmann, A., and Singh, K. 2010. Learning 3d mesh segmentation and labeling. ACM Transactions on Graphics (proc. SIGGRAPH) 29, 3.

Digital Library

[23]

Katz, S., Leifman, G., and Tal, A. 2005. Mesh segmentation using feature point and core extraction. Visual Computer (September).

[24]

Kim, Y., Varshney, A., and adn François Guimbretière, D. J. 2010. Mesh saliency and human eye fixations. ACM Transactions on Applied Perception 7, 2 (February).

Digital Library

[25]

Kim, V., Lipman, Y., and Funkhouser, T. 2011. Blended intrinsic maps. ACM Transactions on Graphics (SIGGRAPH 2011) (jul).

Digital Library

[26]

Ko, B., and Nam, J. 2006. Object-of-interest image segmentation based on human attention and semantic region clustering. J Opt Soc Am A Opt Image Sci Vis 23, 10 (October), 2462--2470.

[27]

Koch, C., and Ullman, S. 1985. Shifts in selective visual attention: towards the underlying neural circuitry. Human Neurobiology 4, 219--227.

[28]

Kraevoy, V., and Sheffer, A. 2004. Cross-parameterization and compatible remeshing of 3d models. ACM Transactions on Graphics (Proc SIGGRAPH) 23, 3, 861--869.

Digital Library

[29]

Lee, C. H., Varshney, A., and Jacobs, D. W. 2005. Mesh saliency. ACM Transactions on Graphics (SIGGRAPH 2005) (aug).

Digital Library

[30]

Lewis, D. 1969. Convention: A Philosophical Study. Harvard University Press.

[31]

Li, X., and Guskov, I. 2005. Multi-scale features for approximate alignment of point-based surfaces. In Symposium on Geometry Processing.

Digital Library

[32]

Li, X., and Guskov, I. 2007. 3d object recognition from range images using pyramid matching. In Workshop on 3D Representation for Recognition (3dRR).

[33]

Lipman, Y., and Funkhouser, T. 2009. Mobius voting for surface correspondence. ACM Transactions on Graphics (SIGGRAPH 2009) (August).

Digital Library

[34]

Milanes, R., Wechsler, H., Gil, S., Bost, J., and Pun, T. 1994. Integration of bottom-up and top-down cues for visual attention using non-linear relaxation. IEEE Computer Vision and Pattern Recognition, 781--785.

[35]

Moreels, P., and Perona, P. 2007. Evaluation of features detectors and descriptors based on 3d objects. IJCV 73, 3 (July), 263--284.

Digital Library

[36]

Novotni, M., Degener, P., and Klein, R. 2005. Correspondence generation and matching of 3d shape subparts. Tech. Rep. CG-2005-2, Universität Bonn, June.

[37]

Parker, P. 2011. Webster's On-line Dictionary: The Rosetta Edition. http://www.websters-online-dictionary.org.

[38]

Privitera, C., and Stark, L. 2000. Algorithms for defining visual regions-of-interest: Comparison with eye fixations. PAMI 22, 9 (September), 970--982.

Digital Library

[39]

Rosenholtz, R. 1999. A simple saliency model predicts a number of motion popout phenomena. Vision Research 39, 19, 3157--3163.

[40]

Rusinkiewicz, S. 2004. Estimating curvatures and their derivatives on triangle meshes. In Symposium on 3D Data Processing, Visualization, and Transmission.

Digital Library

[41]

Santella, A., and DeCarlo, D. 2004. Robust clustering of eye movement recordings for quantification of visual interest. In Eye Tracking Research and Applications (ETRA), 27--34.

Digital Library

[42]

Schelling, T. 1960. The Strategy of Conflict. Harvard University Press.

[43]

Schlattmann, M., Degener, P., and Klein, R. 2008. Scale space based feature point detection on surfaces. Journal of WSCG 16 (February).

[44]

Schmid, C., Mohr, R., and Bauckhage, C. 2000. Evaluation of interest point detectors. IJCV 37, 2 (June), 151--172.

Digital Library

[45]

Sebe, N., and Lew, M. 2003. Comparing salient point detectors. Pattern Recognition Letters 24, 1-3 (January), 89--96.

Digital Library

[46]

Shapira, L., Shamir, A., and Cohen-Or, D. 2008. Consistent mesh partitioning and skeletonisation using the shape diameter function. Vis. Comput. 24, 4, 249--259.

Digital Library

[47]

Shilane, P., and Funkhouser, T. 2007. Distinctive regions of 3d surfaces. ACM Transactions on Graphics 26, 2 (June).

Digital Library

[48]

Simpson, J. 1989. Oxford English Dictionary, Second Edition. Oxford University Press. http://dictionary.oed.com.

[49]

Sonthi, R., Kunjur, G., and Gadh, R. 1997. Shape feature determination using the curvature region representation. In Proc. Solid Modeling, ACM.

Digital Library

[50]

Stark, M., and Schiele, B. 2007. How good are local features for classes of geometric objects. 1--8.

[51]

Sumner, R., and Popovic, J. 2004. Deformation transfer for triangle meshes. ACM Transactions on Graphics (Proc SIGGRAPH) 23, 3, 399--405.

Digital Library

[52]

Sun, J., Ovsjanikov, M., and Guibas, L. 2009. A Concise and Provably Informative Multi-Scale Signature Based on Heat Diffusion. In Computer Graphics Forum, vol. 28, Wiley Online Library, 1383--1392.

Digital Library

[53]

Tsotsos, J., Culhane, S., Wai, W., Lai, Y., Davis, N., and Nuflo, F. 1995. Modeling visual-attention via selective tuning. Artificial Intelligence 78, 1-2, 507--545.

Digital Library

[54]

van Kaick, O., Zhang, H., Hamarneh, G., and Cohen-Or, D. 2010. A survey on shape correspondence. In Proc. of Eurographics State-of-the-art Report.

[55]

Von Ahn, L., and Dabbish, L. 2008. Designing games with a purpose. Communications of the ACM 51, 8, 58--67.

Digital Library

[56]

Witten, I. H., and Frank, E. 2005. Data mining: Practical machine learning tools and techniques, 2nd edition.

Digital Library

[57]

Xu, K., Zhang, H., Tagliasacchi, A., Liu, L., Li, G., Meng, M., and Xiong, Y. 2009. Partial intrinsic reflectional symmetry of 3d shapes. ACM Transactions on Graphics, (Proceedings SIGGRAPH Asia 2009) 28, 5, to appear.

Digital Library

[58]

Zaharescu, A., Boyer, E., Varanasi, K., and Horaud, R. 2009. Surface feature detection and description with applications to mesh matching. In CVPR.

[59]

Zhang, E., Mischaikow, K., and Turk, G. 2005. Feature-based surface parameterization and texture mapping. ACM Transactions on Graphics 24, 1.

Digital Library

[60]

Zhang, H., Sheffer, A., Cohen-Or, D., Zhou, Q., van Kaick, O., and Tagliasacchi, A. 2008. Deformation-driven shape correspondence. Comput. Graph. Forum 27, 5, 1431--1439.

Digital Library

[61]

Zhou, Y., and Huang, Z. 2004. Decomposing polygon meshes by means of critical points. In MMM, 187--195.

Digital Library

[62]

Zuliani, M., Kenney, C., and Manjunath, B. 2004. A mathematical comparison of point detectors. In Computer Vision and Pattern Recognition Workshop, 172.

Digital Library

Cited By

Vasic IQuattrini RPierdicca RMancini AVasic B(2024)3VR: Vice Versa Virtual Reality Algorithm to Track and Map User ExperienceJournal on Computing and Cultural Heritage 10.1145/365634617:3(1-19)Online publication date: 6-Apr-2024
https://dl.acm.org/doi/10.1145/3656346
Lv CZhang DGeng SWu ZHuang H(2024)Color Transfer for Images: A SurveyACM Transactions on Multimedia Computing, Communications, and Applications10.1145/363515220:8(1-29)Online publication date: 9-Jul-2024
https://dl.acm.org/doi/10.1145/3635152
Ding XChen ZLin WChen Z(2024)Towards 3D Colored Mesh Saliency: Database and BenchmarksIEEE Transactions on Multimedia10.1109/TMM.2023.331292426(3580-3591)Online publication date: 2024
https://doi.org/10.1109/TMM.2023.3312924
Show More Cited By

Recommendations

A 3D shape descriptor based on spectral analysis of medial axis

The medial axis of a 3D shape is widely known for its ability as a compact and complete shape representation. However, there is still lack of a generative description defined over the medial axis directly which limits its actual application to 3D shape ...
Skinning 3D meshes
Special issue on SMI 2002

A planar parameterization of 3D surfaces is useful for many applications, The applicability of the parameterization depends on how well it preserves the surface geometry (angles, distances, and areas). For most surface meshes there is no ...
Spectral Analysis on Medial Axis of 2D Shapes

Shape analysis finds many important applications in shape understanding, matching and retrieval. Among the various shape analysis methods, spectral shape analysis aims to study the spectrum of the Laplace-Beltrami operator of some well-designed shape-...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 31, Issue 4

July 2012

935 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/2185520

Issue’s Table of Contents

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2012

Published in TOG Volume 31, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

106
Total Citations
View Citations
1,155
Total Downloads

Downloads (Last 12 months)41
Downloads (Last 6 weeks)8

Reflects downloads up to 27 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

Vasic IQuattrini RPierdicca RMancini AVasic B(2024)3VR: Vice Versa Virtual Reality Algorithm to Track and Map User ExperienceJournal on Computing and Cultural Heritage 10.1145/365634617:3(1-19)Online publication date: 6-Apr-2024
https://dl.acm.org/doi/10.1145/3656346
Lv CZhang DGeng SWu ZHuang H(2024)Color Transfer for Images: A SurveyACM Transactions on Multimedia Computing, Communications, and Applications10.1145/363515220:8(1-29)Online publication date: 9-Jul-2024
https://dl.acm.org/doi/10.1145/3635152
Ding XChen ZLin WChen Z(2024)Towards 3D Colored Mesh Saliency: Database and BenchmarksIEEE Transactions on Multimedia10.1109/TMM.2023.331292426(3580-3591)Online publication date: 2024
https://doi.org/10.1109/TMM.2023.3312924
Ding Gİmamoğlu NCaglayan AMurakawa MNakamura R(2024)Attention-guided LiDAR segmentation and odometry using image-to-point cloud saliency transferMultimedia Systems10.1007/s00530-024-01389-730:4Online publication date: 1-Aug-2024
https://dl.acm.org/doi/10.1007/s00530-024-01389-7
Martin DFandos AMasia BSerrano A(2024)SAL3D: a model for saliency prediction in 3D meshesThe Visual Computer10.1007/s00371-023-03206-0Online publication date: 4-Jan-2024
https://doi.org/10.1007/s00371-023-03206-0
Djuren TKohlbrenner MAlexa M(2023)K-Surfaces: Bézier-Splines Interpolating at Gaussian Curvature ExtremaACM Transactions on Graphics10.1145/361838342:6(1-13)Online publication date: 5-Dec-2023
https://dl.acm.org/doi/10.1145/3618383
Shu ZGao LYi SWu FDing XWan TXin S(2023)Context-Aware 3D Points of Interest Detection via Spatial Attention MechanismACM Transactions on Multimedia Computing, Communications, and Applications10.1145/359702619:6(1-19)Online publication date: 12-Jul-2023
https://dl.acm.org/doi/10.1145/3597026
Chen MLau M(2023)Learning 3D Shape Aesthetics Globally and LocallyComputer Graphics Forum10.1111/cgf.1470241:7(579-588)Online publication date: 20-Mar-2023
https://doi.org/10.1111/cgf.14702
Chen GDai HZhou TShen JShao L(2023)Automatic Schelling Point Detection From MeshesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.314414329:6(2926-2939)Online publication date: 1-Jun-2023
https://doi.org/10.1109/TVCG.2022.3144143
Song RZhang WZhao YLiu YRosin P(2023)3D Visual Saliency: An Independent Perceptual Measure or A Derivative of 2D Image Saliency?IEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2023.3287356(1-17)Online publication date: 2023
https://doi.org/10.1109/TPAMI.2023.3287356
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents