article

Mesh saliency

Authors:

Amitabh Varshney,

David W. JacobsAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 24, Issue 3

Pages 659 - 666

https://doi.org/10.1145/1073204.1073244

Published: 01 July 2005 Publication History

Abstract

Research over the last decade has built a solid mathematical foundation for representation and analysis of 3D meshes in graphics and geometric modeling. Much of this work however does not explicitly incorporate models of low-level human visual attention. In this paper we introduce the idea of mesh saliency as a measure of regional importance for graphics meshes. Our notion of saliency is inspired by low-level human visual system cues. We define mesh saliency in a scale-dependent manner using a center-surround operator on Gaussian-weighted mean curvatures. We observe that such a definition of mesh saliency is able to capture what most would classify as visually interesting regions on a mesh. The human-perception-inspired importance measure computed by our mesh saliency operator results in more visually pleasing results in processing and viewing of 3D meshes. compared to using a purely geometric measure of shape. such as curvature. We discuss how mesh saliency can be incorporated in graphics applications such as mesh simplification and viewpoint selection and present examples that show visually appealing results from using mesh saliency.

Supplementary Material

MP4 File (pps032.mp4)

Download
39.66 MB

References

[1]

Al-Regib, G., Altunbasak, Y., and Rossignac, J. 2005. Error-resilient transmission of 3D models. ACM Transactions on Graphics 24, 2, 182--208.

Digital Library

[2]

Blanz, V., Tarr, M. J., and Bülthoff, H. H. 1999. What object attributes determine canonical views? Perception 28, 5, 575--599.

[3]

Chen, L., Xie, X., Fan, X., Ma, W., Zhang, H., and Zhou, H. 2003. A visual attention model for adapting images on small displays. ACM Multimedia Systems Journal 9, 4, 353--364.

Digital Library

[4]

DeCarlo, D., and Santella, A. 2002. Stylization and abstraction of photographs. ACM Transactions on Graphics (Proceedings of ACM SIGGRAPH 2002) 21, 3, 769--776.

Digital Library

[5]

Fleishman, S., Cohen-Or, D., and Lischinski, D. 1999. Automatic camera placement for image-based modeling. In Proceedings of the 7th Pacific Conference on Computer Graphics and Applications (PG 1999), 12--20.

Digital Library

[6]

Frintrop, S., Nüchter, A., and Surmann, H. 2004. Visual attention for object recognition in spatial 3D data. In 2nd International Workshop on Attention and Performance in Computational Vision (WAPCV 2004). 75--82.

Digital Library

[7]

Garland, M., and Heckbert. P. 1997. Surface simplification using quadric error metrics. In Proceedings of ACM SIGGRAPH, 209--216.

Digital Library

[8]

Gooch, B., Reinhard, E., Moulding, C., and Shirley, P. 2001. Artistic composition for image creation. In Proceedings of Eurographics Workshop on Rendering Techniques, 83--88.

Digital Library

[9]

Guy. G., and Medioni, G. 1996. Inferring global perceptual contours from local features. International Journal of Computer Vision 20, 1--2, 113--133.

Digital Library

[10]

Heckbert. P. S., and Garland, M. 1999. Optimal triangulation and quadric-based surface simplification. Computational Geometry 14, 49--65.

Digital Library

[11]

Hisada, M., Belyaev, A. G., and Kunii, T. L. 2002. A skeleton-based approach for detection of perceptually salient features on polygonal surfaces. Computer Graphics Forum 21, 4, 689--700.

[12]

Hoppe. H. 1996. Progressive meshes. Proceedings of ACM SIGGRAPH.99--108.

Digital Library

[13]

Howlett, S., Hamill, J., and O'Sullivan, C. 2004. An experimental approach to predicting saliency for simplified polygonal models. In Proceedings of the 1st Symposium on Applied Perception in Graphics and Visualization, 57--64.

Digital Library

[14]

Itti, L., Koch, C., and Niebur, E. 1998. A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 20, 11, 1254--1259.

Digital Library

[15]

Kamada, T., and Kawai. S. 1988. A simple method for computing general position in displaying three-dimensional objects. Computer Vision, Graphics, Image Processing 41, 1, 43--56.

Digital Library

[16]

Karni. Z., and Gotsman, C. 2000. Spectral compression of mesh geometry. In Proceedings of ACM SIGGRAPH, 279--286.

Digital Library

[17]

Katz, S., and Tal, A. 2003. Hierarchical mesh decomposition using fuzzy clustering and cuts. ACM Transactions on Graphics (Proceedings of ACM SIGGRAPH 2003) 22, 3.

Digital Library

[18]

Kim, S.-J., Kim, S.-K., and Kim, C.-H. 2002. Discrete differential error metric for surface simplification. In Proceedings of 10th Pacific Conference on Computer Graphics and Applications (PG 2002), 276--283.

Digital Library

[19]

Kobbelt, L., Campagna, S., Vorsatz, J., and Seidel, H.-P. 1998. Interactive multi-resolution modeling on arbitrary meshes. In Proceedings of ACM SIGGRAPH, 105--114.

Digital Library

[20]

Koch, C., and Ullman, S. 1985. Shifts in selective visual attention: towards the underlying neural circuitry. Human Neurobiology 4, 219--227.

[21]

Lee, C. H., Hao, X., and Varshney, A. 2004. Light collages: Lighting design for effective visualization. In Proceedings of IEEE Visualization, 281--288.

Digital Library

[22]

Luebke, D., and Hallen, B. 2001. Perceptually driven simplification for interactive rendering. In Proceedings of Eurographics Workshop on Rendering Techniques, 223 -- 234.

Digital Library

[23]

Luebke, D., Reddy, M., Cohen, J., Varshney, A., Watson, B., and Huebner, R. 2003. Level of Detail for 3D Graphics. Morgan Kaufman.

Digital Library

[24]

Mantiuk, R., Myszkowski, K., and Pattanaik, S. 2003. Attention guided MPEG compression for computer animations. In Proceedings of the 19th Spring Conference on Computer Graphics, 239--244.

Digital Library

[25]

Medioni, G., and Guy, G. 1997. Inference of surfaces, curves and junctions from sparse, noisy 3-D data. IEEE Transactions on Pattern Analysis and Machine Intelligence 19, 11, 1265--1277.

Digital Library

[26]

Meyer, M., Desbrun, M., Schröder, P., and Barr, A. H. 2003. Discrete differential-geometry operators for triangulated 2-manifolds. In Visualization and Mathematics III(Proceedings of VisMath 2002), Springer Verlag, Berlin (Germany), 35--54.

[27]

Milanese, R., Wechsler, H., Gil, S., Bost, J., and Pun, T. 1994. Integration of bottom-up and top-down cues for visual attention using non-linear relaxation. In Proceedings of IEEE Computer Vision and Pattern Recognition, 781--785.

[28]

Privitera, C., and Stark, L. 1999. Focused JPEG encoding based upon automatic preidentified regions of interest. In Proceedings of SPIE, Human Vision and Electronic Imaging IV, 552--558.

[29]

Reddy., M. 2001. Perceptually optimized 3D graphics. IEEE Computer Graphics and Applications 21, 5. 68--75.

Digital Library

[30]

Rosenholtz, R. 1999. A simple saliency model predicts a number of motion popout phenomena. Vision Research 39, 19, 3157--3163.

[31]

Shashua, A., and Ullman, S. 1988. Structural saliency: The detection of globally salient structures using a locally connected network. In Proceedings of IEEE International Conference on Computer Vision, 321--327.

[32]

Stoev, S., and Straber, W. 2002. A case study on automatic camera placement and motion for visualizing historical data. In Proceedings of IEEE Visualization, 545--548.

Digital Library

[33]

Suh, B., Ling, H., Bederson, B. B., and Jacobs, D. W. 2003. Automatic thumbnail cropping and its effectiveness. CHI Letters (UIST 2003) 5, 2, 95--104.

Digital Library

[34]

Taubin, G. 1995. Estimating the tensor of curvature of a surface from a polyhedral approximation. In Proceedings of IEEE International Conference on Computer Vision, 902--907.

Digital Library

[35]

Tsotsos, J., Culhane, S., Wai, W., Lai. Y., Davis, N., and Nuflo, F. 1995. Modeling visual-attention via selective tuning. Artificial Intelligence 78, 1-2, 507--545.

Digital Library

[36]

Turk, G. 1992. Re-tiling polygon surfaces. In Proceedings of ACM SIGGRAPH, 55--64.

Digital Library

[37]

VáZQUEZ, P.-P., FEIXAS, M., SBERT, M., AND LLOBET, A. 2002. Viewpoint entropy: a new tool for obtaining good views of molecules. In Proceedings of the Symposium on Data Visualisation (VISSYM 2002), 183--188.

Digital Library

[38]

Watanabe, K., and Belyaev, A. G. 2001. Detection of salient curvature features on polygonal surfaces. Computer Graphics Forum (Eurographics 2001) 20, 3, 385--392.

[39]

Watson, B., Walker, N., and Hodges, L. F. 2004. Supra-threshold control of peripheral LOD. ACM Transactions on Graphics 23, 3, 750--759.

Digital Library

[40]

Weinshall, D., and Werman, M. 1997. On view likelihood and stability. IEEE Transactions on Pattern Analysis and Machine Intelligence 19, 2, 97--108.

Digital Library

[41]

Yee, H., Pattanaik, S., and Greenberg, D. P. 2001. Spatiotemporal sensitivity and visual attention for efficient rendering of dynamic environments. ACM Transactions on Graphics 20, 1, 39--65.

Digital Library

Cited By

Kim SKim Y(2024)A Novel Method Using 3D Interest Points to Place Markers on a Large Object in Augmented RealityApplied Sciences10.3390/app1402094114:2(941)Online publication date: 22-Jan-2024
https://doi.org/10.3390/app14020941
Roullier BMcQuade FAnjum ABower CLiu L(2024)Automated visual quality assessment for virtual and augmented reality based digital twinsJournal of Cloud Computing: Advances, Systems and Applications10.1186/s13677-024-00616-w13:1Online publication date: 26-Feb-2024
https://dl.acm.org/doi/10.1186/s13677-024-00616-w
Ding XChen ZLin WChen Z(2024)Towards 3D Colored Mesh Saliency: Database and BenchmarksIEEE Transactions on Multimedia10.1109/TMM.2023.331292426(3580-3591)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TMM.2023.3312924
Show More Cited By

Index Terms

Mesh saliency
1. Computing methodologies
  1. Computer graphics
    1. Shape modeling
2. Theory of computation
  1. Randomness, geometry and discrete structures
    1. Computational geometry

Recommendations

Tactile mesh saliency

While the concept of visual saliency has been previously explored in the areas of mesh and image processing, saliency detection also applies to other sensory stimuli. In this paper, we explore the problem of tactile mesh saliency, where we define ...
Mesh saliency
SIGGRAPH '05: ACM SIGGRAPH 2005 Papers

Research over the last decade has built a solid mathematical foundation for representation and analysis of 3D meshes in graphics and geometric modeling. Much of this work however does not explicitly incorporate models of low-level human visual ...
A Perceptual Metric Based on Salient Information Entropy for 3D Mesh Distortion
IIH-MSP '10: Proceedings of the 2010 Sixth International Conference on Intelligent Information Hiding and Multimedia Signal Processing

Visual degradation and distortion may be introduced during the 3D mesh simplification. The critical issue in all mesh simplification methods is how to evaluate it. Some geometric metrics without the consideration of human visual perception and perceptual ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 24, Issue 3

July 2005

826 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/1073204

Issue’s Table of Contents

Copyright © 2005 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2005

Published in TOG Volume 24, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

444
Total Citations
View Citations
3,877
Total Downloads

Downloads (Last 12 months)43
Downloads (Last 6 weeks)9

Reflects downloads up to 04 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kim SKim Y(2024)A Novel Method Using 3D Interest Points to Place Markers on a Large Object in Augmented RealityApplied Sciences10.3390/app1402094114:2(941)Online publication date: 22-Jan-2024
https://doi.org/10.3390/app14020941
Roullier BMcQuade FAnjum ABower CLiu L(2024)Automated visual quality assessment for virtual and augmented reality based digital twinsJournal of Cloud Computing: Advances, Systems and Applications10.1186/s13677-024-00616-w13:1Online publication date: 26-Feb-2024
https://dl.acm.org/doi/10.1186/s13677-024-00616-w
Ding XChen ZLin WChen Z(2024)Towards 3D Colored Mesh Saliency: Database and BenchmarksIEEE Transactions on Multimedia10.1109/TMM.2023.331292426(3580-3591)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TMM.2023.3312924
Chen XSun XZhao BTan DWu C(2024)Part segmentation method of point cloud considering optimal allocation and optimal mask based on deep learningSurvey Review10.1080/00396265.2024.2323289(1-15)Online publication date: 5-Mar-2024
https://doi.org/10.1080/00396265.2024.2323289
Xing YWang XLu LSharf ACohen-Or DTu C(2024)Shell stand: Stable thin shell models for 3D fabricationComputational Visual Media10.1007/s41095-024-0402-810:4(643-657)Online publication date: 24-Jun-2024
https://doi.org/10.1007/s41095-024-0402-8
Martin DFandos AMasia BSerrano A(2024)SAL3D: a model for saliency prediction in 3D meshesThe Visual Computer10.1007/s00371-023-03206-0Online publication date: 4-Jan-2024
https://doi.org/10.1007/s00371-023-03206-0
YOKOI YSHIMODA MKOEKIBA M(2023)Mesh evaluation method for shell elements using graph convolutional networkグラフ畳み込みネットワークによる有限要素シェルメッシュ評価法Transactions of the JSME (in Japanese)10.1299/transjsme.22-0033789:923(22-00337-22-00337)Online publication date: 2023
https://doi.org/10.1299/transjsme.22-00337
Shu ZGao LYi SWu FDing XWan TXin S(2023)Context-Aware 3D Points of Interest Detection via Spatial Attention MechanismACM Transactions on Multimedia Computing, Communications, and Applications10.1145/359702619:6(1-19)Online publication date: 12-Jul-2023
https://dl.acm.org/doi/10.1145/3597026
Chen MLau M(2023)Learning 3D Shape Aesthetics Globally and LocallyComputer Graphics Forum10.1111/cgf.1470241:7(579-588)Online publication date: 20-Mar-2023
https://doi.org/10.1111/cgf.14702
Chen GDai HZhou TShen JShao L(2023)Automatic Schelling Point Detection From MeshesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.314414329:6(2926-2939)Online publication date: 1-Jun-2023
https://dl.acm.org/doi/10.1109/TVCG.2022.3144143
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents