research-article

Open access

Geo-Metric: A Perceptual Dataset of Distortions on Faces

Authors:

Krzysztof Wolski,

Zhengyang Shen,

Kevin Mackenzie,

Alexandre ChapiroAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 41, Issue 6

Article No.: 215, Pages 1 - 13

https://doi.org/10.1145/3550454.3555475

Published: 30 November 2022 Publication History

Abstract

In this work we take a novel perception-centered approach to quantify distortions on 3D geometry of faces, to which humans are particularly sensitive. We generated a dataset, composed of 100 high-quality and demographically-balanced face scans. We then subjected these meshes to distortions that cover relevant use cases in computer graphics, and conducted a large-scale perceptual study to subjectively evaluate them. Our dataset consists of over 84,000 quality comparisons, making it the largest ever psychophysical dataset for geometric distortions. Finally, we demonstrated how our data can be used for applications like metrics, compression, and level-of-detail rendering.

References

[1]

Andrew D. Bagdanov, Alberto Del Bimbo, and Iacopo Masi. 2011. The Florence 2D/3D Hybrid Face Dataset. In Proceedings of the 2011 joint ACM workshop on Human gesture and behavior understanding. 79--80.

Digital Library

[2]

Volker Blanz and Thomas Vetter. 1999. A Morphable Model for the Synthesis of 3D Faces. In Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '99). ACM Press/Addison-Wesley Publishing Co., USA, 187--194.

Digital Library

[3]

James Booth, Anastasios Roussos, Evangelos Ververas, Epameinondas Antonakos, Stylianos Ploumpis, Yannis Panagakis, and Stefanos Zafeiriou. 2018. 3D Reconstruction of "In-the-Wild" Faces in Images and Videos. IEEE Transactions on Pattern Analysis and Machine Intelligence 40, 11 (2018), 2638--2652.

Digital Library

[4]

Mario Botsch, Mark Pauly, Leif Kobbelt, Pierre Alliez, Bruno Lévy, Stephan Bischoff, and Christian Rossl. 2007. Geometric Modeling Based on Polygonal Meshes. In ACM SIGGRAPH Course Notes.

Digital Library

[5]

Fergus W. Campbell and John G. Robson. 1968. Application of Fourier Analysis to the Visibility of Gratings. The Journal of physiology 197, 3 (1968), 551--566.

[6]

Chen Cao, Yanlin Weng, Shun Zhou, Yiying Tong, and Kun Zhou. 2014. FaceWarehouse: A 3D Facial Expression Database for Visual Computing. IEEE Transactions on Visualization and Computer Graphics 20, 3 (2014), 413--425.

Digital Library

[7]

P. Cignoni, C. Rocchini, and R. Scopigno. 1998. Metro: Measuring Error on Simplified Surfaces. Computer Graphics Forum 17, 2 (1998), 167--174.

[8]

Darren Cosker, Eva Krumhuber, and Adrian Hilton. 2011. A FACS Valid 3D Dynamic Action Unit Database with Applications to 3D Dynamic Morphable Facial Modeling. Proceedings of the IEEE International Conference on Computer Vision, 2296--2303.

Digital Library

[9]

D. Cudeiro, T. Bolkart, C. Laidlaw, A. Ranjan, and M. J. Black. 2019. Capture, Learning, and Synthesis of 3D Speaking Styles. In 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE Computer Society, Los Alamitos, CA, USA, 10093--10103.

[10]

Hang Dai, Nick Pears, William Smith, and Christian Duncan. 2019. Statistical Modeling of Craniofacial Shape and Texture. International Journal of Computer Vision 128, 2 (09 Nov 2019), 547--571.

Digital Library

[11]

Scott J. Daly. 1992. The Visible Differences Predictor: An Algorithm for the Assessment of Image Fidelity. In Human Vision, Visual Processing, and Digital Display III, Vol. 1666. International Society for Optics and Photonics, 2--15.

[12]

Herbert Aron David. 1963. The Method of Paired Comparisons. Vol. 12. London.

[13]

Michael Deering. 1995. Geometry Compression. In Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '95). Association for Computing Machinery, New York, NY, USA, 13--20.

Digital Library

[14]

Xiang Feng, Wanggen Wan, Richard Yi Da Xu, Stuart Perry, Pengfei Li, and Song Zhu. 2018. A Novel Spatial Pooling Method for 3D Mesh Quality Assessment Based on Percentile Weighting Strategy. Computers & Graphics 74 (2018), 12--22.

[15]

James A. Ferwerda, Peter Shirley, Sumanta N. Pattanaik, and Donald P. Greenberg. 1997. A Model of Visual Masking for Computer Graphics. In Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '97). ACM Press/Addison-Wesley Publishing Co., USA, 143--152.

Digital Library

[16]

Yudong Guo, Juyong Zhang, Jianfei Cai, Boyi Jiang, and Jianmin Zheng. 2018. CNN-Based Real-Time Dense Face Reconstruction with Inverse-Rendered Photo-Realistic Face Images. IEEE Transactions on Pattern Analysis and Machine Intelligence PP (05 2018), 1--1.

Digital Library

[17]

Alain Horé and Djemel Ziou. 2010. Image Quality Metrics: PSNR vs. SSIM. In 2010 20th International Conference on Pattern Recognition. 2366--2369.

Digital Library

[18]

Gordon Kindlmann, Erik Reinhard, and Sarah Creem. 2002. Face-Based Luminance Matching for Perceptual Colormap Generation. In IEEE Visualization, 2002. 299--306.

[19]

Venkat Krishnamurthy and Marc Levoy. 1996. Fitting Smooth Surfaces to Dense Polygon Meshes. In Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '96). Association for Computing Machinery, New York, NY, USA, 313--324.

Digital Library

[20]

Guillaume Lavoué. 2011. A Multiscale Metric for 3D Mesh Visual Quality Assessment. In Computer Graphics Forum, Vol. 30. Wiley Online Library, 1427--1437.

[21]

Guillaume Lavoué, Elisa Drelie Gelasca, Florent Dupont, Atilla Baskurt, and Touradj Ebrahimi. 2006. Perceptually Driven 3D Distance Metrics with Application to Watermarking. In Applications of Digital Image Processing XXIX, Vol. 6312. International Society for Optics and Photonics, 63120L.

[22]

Guillaume Lavoué, Mohamed Chaker Larabi, and Libor Váša. 2016. On the Efficiency of Image Metrics for Evaluating the Visual Quality of 3D Models. IEEE Transactions on Visualization and Computer Graphics 22, 8 (2016), 1987--1999.

Digital Library

[23]

Michael B. Lewis. 2001. The Lady's Not for Turning: Rotation of the Thatcher Illusion. Perception 30, 6 (2001), 769--774.

[24]

Charles Loop. 1987. Smooth Subdivision Surfaces Based on Triangles. Master's thesis, University of Utah, Department of Mathematics (1987). https://www.microsoft.com/en-us/research/publication/smooth-subdivision-surfaces-based-on-triangles/

[25]

David Luebke, Martin Reddy, Jonathan D. Cohen, Amitabh Varshney, Benjamin Watson, and Robert Huebner. 2003. Level of Detail for 3D Graphics. Morgan Kaufmann.

[26]

Rafał Mantiuk, Kil Joong Kim, Allan G. Rempel, and Wolfgang Heidrich. 2011. HDR-VDP-2: A Calibrated Visual Metric for Visibility and Quality Predictions in All Luminance Conditions. ACM Trans. Graph. 30, 4, Article 40 (jul 2011), 14 pages.

Digital Library

[27]

Rafał K. Mantiuk, Gyorgy Denes, Alexandre Chapiro, Anton Kaplanyan, Gizem Rufo, Romain Bachy, Trisha Lian, and Anjul Patney. 2021. FovVideoVDP: A Visible Difference Predictor for Wide Field-of-View Video. ACM Trans. Graph. 40, 4, Article 49 (jul 2021), 19 pages.

Digital Library

[28]

Georges Nader, Kai Wang, Franck Hétroy-Wheeler, and Florent Dupont. 2015. Just Noticeable Distortion Profile for Flat-Shaded 3D Mesh Surfaces. IEEE transactions on visualization and computer graphics 22, 11 (2015), 2423--2436.

Digital Library

[29]

Anass Nouri, Christophe Charrier, and Olivier Lézoray. 2016. Full-Reference Saliency-Based 3D Mesh Quality Assessment Index. In 2016 IEEE International Conference on Image Processing (ICIP). IEEE, 1007--1011.

[30]

Aude Oliva, Antonio Torralba, and Philippe G. Schyns. 2006. Hybrid Images. ACM Trans. Graph. 25, 3 (jul 2006), 527--532.

Digital Library

[31]

James P. O'Shea, Martin S. Banks, and Maneesh Agrawala. 2008. The Assumed Light Direction for Perceiving Shape from Shading. In Proceedings of the 5th Symposium on Applied Perception in Graphics and Visualization (Los Angeles, California) (APGV '08). Association for Computing Machinery, 135--142.

Digital Library

[32]

Pascal Paysan, Reinhard Knothe, Brian Amberg, Sami Romdhani, and Thomas Vetter. 2009. A 3D Face Model for Pose and Illumination Invariant Face Recognition. In IEEE international conference on advanced video and signal based surveillance. 296--301.

Digital Library

[33]

Maria Perez-Ortiz, Aliaksei Mikhailiuk, Emin Zerman, Vedad Hulusic, Giuseppe Valenzise, and Rafał K Mantiuk. 2019. From Pairwise Comparisons and Rating to a Unified Quality Scale. IEEE Transactions on Image Processing 29 (2019), 1139--1151.

[34]

Ken Perlin. 2002. Improving Noise. ACM Trans. Graph. 21, 3, 681--682.

Digital Library

[35]

Nikolay Ponomarenko, Lina Jin, Oleg Ieremeiev, Vladimir Lukin, Karen Egiazarian, Jaakko Astola, Benoit Vozel, Kacem Chehdi, Marco Carli, Federica Battisti, et al. 2015. Image Database TID2013: Peculiarities, Results and Perspectives. Signal processing: Image communication 30 (2015), 57--77.

Digital Library

[36]

Anurag Ranjan, Timo Bolkart, Soubhik Sanyal, and Michael J Black. 2018. Generating 3D Faces Using Convolutional Mesh Autoencoders. In Proceedings of the European Conference on Computer Vision. 704--720. http://arxiv.org/abs/1807.10267

Digital Library

[37]

Bernice E. Rogowitz and Holly E. Rushmeier. 2001. Are Image Quality Metrics Adequate to Evaluate the Quality of Geometric Objects?. In Human Vision and Electronic Imaging VI (Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series, Vol. 4299). 340--348.

[38]

Jeffrey A. Saunders and Benjamin T. Backus. 2006. Perception of Surface Slant From Oriented Textures. Journal of Vision 6, 9 (08 2006), 3--3.

[39]

Peter H Schönemann. 1966. A Generalized Solution of the Orthogonal Procrustes Problem. Psychometrika 31, 1 (1966), 1--10.

[40]

Ana Serrano, Bin Chen, Chao Wang, Michal Piovarči, Hans-Peter Seidel, Piotr Didyk, and Karol Myszkowski. 2021. The Effect of Shape and Illumination on Material Perception: Model and Applications. ACM Trans. Graph. 40, 4, Article 125 (jul 2021), 16 pages.

Digital Library

[41]

Hamid R. Sheikh, Zhou Wang, Lawrence Cormack, and Alan C Bovik. 2005. LIVE Image Quality Assessment Database Release 2. (2005). http://live.ece.utexas.edu/research/quality

[42]

Daniel J Simons and Ronald A Rensink. 2005. Change Blindness: Past, Present, and Future. Trends in Cognitive Sciences 9, 1 (2005), 16--20.

[43]

Olga Sorkine, Daniel Cohen-Or, and Sivan Toledo. 2003. High-Pass Quantization for Mesh Encoding. In Proceedings of the 2003 Eurographics/ACM SIGGRAPH Symposium on Geometry Processing (Aachen, Germany) (SGP '03). Eurographics Association, Goslar, DEU, 42--51.

[44]

Jennifer Sun and Pietro Perona. 1998. Where Is the Sun? Nature neuroscience 1, 3 (1998), 183--184.

[45]

Peter Thompson. 1980. Margaret Thatcher: A New Illusion. Perception 9, 4 (1980), 483--484.

[46]

United States Census Bureau. 2021. US census. https://www.census.gov/quickfacts/fact/table/US/PST045221 [Online; accessed 14-December-2021].

[47]

Libor Váša and Jan Rus. 2012. Dihedral Angle Mesh Error: A Fast Perception Correlated Distortion Measure for Fixed Connectivity Triangle Meshes. Comput. Graph. Forum 31, 5, 1715--1724.

Digital Library

[48]

Kai Wang, Fakhri Torkhani, and Annick Montanvert. 2012. A Fast Roughness-Based Approach to the Assessment of 3D Mesh Visual Quality. Computers & Graphics 36, 7 (2012), 808--818.

Digital Library

[49]

Andrew P. Witkin. 1987. Scale-Space Filtering. In Readings in Computer Vision. Elsevier, 329--332.

[50]

Nanyang Ye, Krzysztof Wolski, and Rafal K. Mantiuk. 2019. Predicting Visible Image Differences Under Varying Display Brightness and Viewing Distance. In 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 5429--5437.

[51]

Lijun Yin, Xiaochen Chen, Yi Sun, Tony Worm, and Michael Reale. 2008. A High-Resolution 3D Dynamic Facial Expression Database. In 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition. 1--6.

[52]

Lijun Yin, Xiaozhou Wei, Yi Sun, Jun Wang, and Matthew J. Rosato. 2006. A 3D Facial Expression Database For Facial Behavior Research. In International Conference on Automatic Face and Gesture Recognition. IEEE, 211--216.

[53]

Xing Zhang, Lijun Yin, Jeffrey F. Cohn, Shaun Canavan, Michael Reale, Andy Horowitz, and Peng Liu. 2013. A High-Resolution Spontaneous 3D Dynamic Facial Expression Database. In International Conference on Automatic Face and Gesture Recognition. IEEE, 1--6.

[54]

Wenyi Zhao, Rama Chellappa, P. Jonathon Phillips, and Azriel Rosenfeld. 2003. Face Recognition: A Literature Survey. ACM computing surveys 35, 4 (2003), 399--458.

Digital Library

[55]

Hao Zhu, Haotian Yang, Longwei Guo, Yidi Zhang, Yanru Wang, Mingkai Huang, Qiu Shen, Ruigang Yang, and Xun Cao. 2021. FaceScape: 3D Facial Dataset and Benchmark for Single-View 3D Face Reconstruction. arXiv preprint (2021).

Cited By

Chapiro AKim DAsano YMantiuk R(2024)AR-DAVID: Augmented Reality Display Artifact Video DatasetACM Transactions on Graphics10.1145/368796943:6(1-11)Online publication date: 19-Dec-2024
https://dl.acm.org/doi/10.1145/3687969
Chen YSaha AChapiro AHäne CBazin JQiu BZanetti SKatsavounidis IBovik A(2024)Subjective and Objective Quality Assessment of Rendered Human Avatar Videos in Virtual RealityIEEE Transactions on Image Processing10.1109/TIP.2024.346888133(5740-5754)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TIP.2024.3468881

Index Terms

Geo-Metric: A Perceptual Dataset of Distortions on Faces
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Perception

Recommendations

A Perceptual Metric Based on Salient Information Entropy for 3D Mesh Distortion
IIH-MSP '10: Proceedings of the 2010 Sixth International Conference on Intelligent Information Hiding and Multimedia Signal Processing

Visual degradation and distortion may be introduced during the 3D mesh simplification. The critical issue in all mesh simplification methods is how to evaluate it. Some geometric metrics without the consideration of human visual perception and perceptual ...
Perceptually based brush strokes for nonphotorealistic visualization

An important problem in the area of computer graphics is the visualization of large, complex information spaces. Datasets of this type have grown rapidly in recent years, both in number and in size. Images of the data stored in these collections must ...
Perceiving translucent materials
APGV '04: Proceedings of the 1st Symposium on Applied perception in graphics and visualization

Many common materials, including fruit, wax and human skin, are somewhat translucent. What makes an object look translucent or opaque? Here we use a recently developed computer graphics model of subsurface light transport [Jensen, et al., 2001] to study ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 41, Issue 6

December 2022

1428 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/3550454

Issue’s Table of Contents

Copyright © 2022 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 November 2022

Published in TOG Volume 41, Issue 6

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
680
Total Downloads

Downloads (Last 12 months)260
Downloads (Last 6 weeks)37

Reflects downloads up to 03 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Chapiro AKim DAsano YMantiuk R(2024)AR-DAVID: Augmented Reality Display Artifact Video DatasetACM Transactions on Graphics10.1145/368796943:6(1-11)Online publication date: 19-Dec-2024
https://dl.acm.org/doi/10.1145/3687969
Chen YSaha AChapiro AHäne CBazin JQiu BZanetti SKatsavounidis IBovik A(2024)Subjective and Objective Quality Assessment of Rendered Human Avatar Videos in Virtual RealityIEEE Transactions on Image Processing10.1109/TIP.2024.346888133(5740-5754)Online publication date: 1-Jan-2024
https://dl.acm.org/doi/10.1109/TIP.2024.3468881

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Figures

Tables

Media

View Issue’s Table of Contents