Empathy through Aesthetics: Using AI Stylization for Visual Anonymization of Interview Videos
Pages 63 - 68
Abstract
Faces are the primary source for identifying individuals, which need to be obstructed to achieve anonymization in images and videos. However, human faces are also one of the most important sources of emotional information, which can be lost during the standard anonymization techniques such as blacking out or blurring. The absence of the emotional signals from the face could have negative effects on the viewer in terms of the feeling of empathy towards the anonymized individual. In this paper, we present the use of AI-driven image stylization techniques as a solution for preserving the emotional facial cues in a video to evoke empathic behavior while ensuring anonymization. We show the effectiveness and shortcomings of our method by testing it against both standard anonymization and non-anonymized techniques. We conclude with next steps and future work to improve our technique.
References
[1]
[1] Adobe Photoshop. (2021, July 15). Adjust and exaggerate facial features. Adjust and exaggerate facial features | Adobe Photoshop tutorials. Retrieved Jan 30, 2022, from https://helpx.adobe.com/ca/photoshop/how-to/face-aware-liquify.html
[2]
[2] Besel, L. D., & Yuille, J. C. (2010). Individual differences in empathy: The role of facial expression recognition. Personality and individual differences, 49(2), 107-112.
[3]
[3] Bindemann, M., Burton, A. M., Hooge, I. T., Jenkins, R., & De Haan, E. H. (2005). Faces retain attention. Psychonomic bulletin & review, 12(6), 1048-1053.
[4]
[4] Blair, R. J. R. (2005). Responding to the emotions of others: Dissociating forms of empathy through the study of typical and psychiatric populations. Consciousness and cognition, 14(4), 698-718.
[5]
[5] Boyle, M., Edwards, C., & Greenberg, S. (2000). The effects of filtered video on awareness and privacy. Paper presented at the 1-10. https://doi.org/10.1145/358916.358935.
[6]
[6] Boyle, M., & Greenberg, S. (2005). The language of privacy: Learning from video media space analysis and design. ACM Transactions on Computer-Human Interaction (TOCHI), 12(2), 328-370.
[7]
[7] Cole, J. (2001). Empathy needs a face. Journal of Consciousness Studies, 8(5-6), 51-68.
[8]
[8] Christensen, R. H. B. (2019). ordinal - Regression Models for Ordinal Data. R package version 2019.12-10. https://CRAN.R-project.org/package=ordinal.
[9]
[9] Davis, M. H. (1980). A multidimensional approach to individual differences in empathy. JSAS Catalog of Selected Documents in Psychology, 10, 85.
[10]
[10] DiPaola, S., & Gabora, L. (2009). Incorporating characteristics of human creativity into an evolutionary art algorithm. Genetic Programming and Evolvable Machines, 10(2), 97-110.
[11]
[11] DiPaola, S. (2014). Using a contextual focus model for an automatic creativity algorithm to generate art work. Procedia Computer Science, 41, 212-219.
[12]
[12] DiPaola, S., Gabora, L., & McCaig, G. (2018). Informing artificial intelligence generative techniques using cognitive theories of human creativity. Procedia computer science, 145, 158-168.
[13]
[13] Ekman, P. (1993). Facial expression and emotion. American psychologist, 48(4), 384.
[14]
[14] Farah, M. J., Wilson, K. D., Drain, M., & Tanaka, J. N. (1998). What is" special" about face perception?. Psychological review, 105(3), 482.
[15]
[15] Field, A., Miles, J., & Field, Z. (2012). Discovering statistics using R. SAGE Publications.
[16]
[16] Freeman, J. B., Ambady, N., & Holcomb, P. J. (2010). The face-sensitive N170 encodes social category information. Neuroreport, 21(1), 24.
[17]
[17] Gery, I., Miljkovitch, R., Berthoz, S., & Soussignan, R. (2009). Empathy and recognition of facial expressions of emotion in sex offenders, non-sex offenders and normal controls. Psychiatry research, 165(3), 252-262.
[18]
[18] GDPR, 2016. Regulation (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95/46/EC (General Data Protection Regulation) Available at: https://gdpr-info.eu/ [Accessed 27 January 2022].
[19]
[19] Haxby JV, Hoffman EA, Gobbini MI. (2000). The distributed human neural system for face perception. Trends Cogn. Sci. 4:223–33.
[20]
[20] Hudson, S. E., & Smith, I. (1996). Techniques for addressing fundamental privacy and disruption tradeoffs in awareness support systems. In Proceedings of the 1996 ACM conference on Computer supported cooperative work (pp. 248-257).
[21]
[21] Hukkelås, H., Mester, R., & Lindseth, F. (2019, October). Deepprivacy: A generative adversarial network for face anonymization. In International Symposium on Visual Computing (pp. 565-578). Springer, Cham.
[22]
[22] Hummert ML. (2014). Age changes in facial morphology, emotional communication, and age stereotyping. In The Oxford Handbook of Emotion, Social Cognition, and Problem Solving in Adulthood, ed. P Verhaeghen, C Hertzog, pp. 47–60. Oxford, UK: Oxford Univ. Press.
[23]
[23] Jourabloo, A., Yin, X., & Liu, X. (2015). Attribute preserved face de-identification. Paper presented at the 278-285.
[24]
[24] Kadir, A., Hennessy, K., Yalcin, O., & DiPaola, S. (2017). Embodied Interactions with a Sufi Dhikr Ritual: Negotiating Privacy and Transmission of Intangible Cultural Heritage in “Virtual Sama”. Electronic Visualisation and the Arts (EVA 2017), 365-372.
[25]
[25] Kaisler RE, Leder H. (2016) Trusting the Looks of Others: Gaze Effects of Faces in Social Settings. Perception. 2016;45(8):875-892.
[26]
[26] Leder, H., Belke, B., Oeberst, A., & Augustin, D. (2004). A model of aesthetic appreciation and aesthetic judgments. British Journal of Psychology, 95(4), 489-508
[27]
[27] Leder, H., & Nadal, M. (2014). Ten years of a model of aesthetic appreciation and aesthetic judgments: The aesthetic episode - Developments and challenges in empirical aesthetics. British Journal of Psychology, 105(4), 443-464
[28]
[28] Menninghaus, W., Wagner, V., Wassiliwizky, E., Schindler, I., Hanich, J., Jacobsen, T., & Koelsch, S. (2019). What are aesthetic emotions? Psychological Review, 126(2), 171-195.
[29]
[29] McCaig, G., DiPaola, S., & Gabora, L. (2016, June). Deep Convolutional Networks as Models of Generalization and Blending Within Visual Creativity. In Proceedings of the Seventh International Conference on Computational Creativity.
[30]
[30] Neustaedter, C., Greenberg, S., Boyle, M.: Blur filtration fails to preserve privacy for home-based video conferencing. ACM Transactions on Computer-Human Interaction 13(1), 1–36 (mar 2006). https://doi.org/10.1145/1143518.1143519.
[31]
[31] Newton, E. M., Sweeney, L. and Malin, B. (2005) "Preserving privacy by de-identifying face images," in IEEE Transactions on Knowledge and Data Engineering, vol. 17, no. 2, pp. 232-243.
[32]
[32] Papademas, D. & The International Visual Sociology Association (2009) IVSA code of research ethics and guidelines. Visual Studies, 24, pp. 250–257.
[33]
[33] Padilla-López, J. R., Chaaraoui, A. A., & Flórez-Revuelta, F. (2015). Visual privacy protection methods: A survey. Expert Systems with Applications, 42(9), 4177–4195. https://doi.org/10.1016/j.eswa.2015.01.041
[34]
[34] R Core Team (2021). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. URL https://www.R-project.org/.
[35]
[35] Rhodes, M. G., & Anastasi, J. S. (2012). The own-age bias in face recognition: a meta-analytic and theoretical review. Psychological bulletin, 138(1), 146.
[36]
[36] Robinson, J. (2005). Deeper than reason: Emotion and its role in literature, music, and art. Oxford University Press
[37]
[37] Skov, M., & Nadal, M. (2020). There are no aesthetic emotions: Comment on Menninghaus et al. (2019). Psychological Review, 127(4), 640-649
[38]
[38] Shakeri, H., Nixon, M., & DiPaola, S. (2018). Saliency-based artistic abstraction with deep learning and regression trees. Electronic Imaging, 2018(14), 1-9.
[39]
[39] Tanaka, J. W., Kiefer, M., & Bukach, C. M. (2004). A holistic account of the own-race effect in face recognition: Evidence from a cross-cultural study. Cognition, 93(1), B1-B9.
[40]
[40] Telles, E. (2014). Pigmentocracies: Ethnicity, race, and color in Latin America. UNC Press Books.
[41]
[41] Willis, J., & Todorov, A. (2006). First impressions: Making up your mind after a 100-ms exposure to a face. Psychological science, 17(7), 592-598.
[42]
[42] Yeh, Z. T., & Tsai, C. F. (2014). Impairment on theory of mind and empathy in patients with stroke. Psychiatry and clinical neurosciences, 68(8), 612-620.
[43]
[43] Zebrowitz, L. A., & Montepare, J. M. (2008). Social psychological face perception: Why appearance matters. Social and personality psychology compass, 2(3), 1497-1517.
[44]
[44] Wiles, R., Coffey, A., Robinson, J., and Heath, S. (2012) Anonymisation and visual images: Issues of respect, ‘voice’ and protection. International Journal of Social Research Methodology, 15, pp. 41–53.
[45]
[45] Pauwels, L. (2008) Taking and using. Visual Communication Quarterly, 15, pp. 243–257.
[46]
[46] Prosser, J. (2000) The moral maze of image ethics. In H. Simons & R. Usher (eds.), Situated ethics in visual research. London: Routledge. pp. 116–132.
[47]
[47] Ekman, P., Friesen, W. V., O’Sullivan, M., & Scherer, K. (1980). Relative importance of face, body, and speech in judgments of personality and affect. Journal of personality and social psychology, 38(2), 270.
[48]
[48] Oosterhof, N. N., & Todorov, A. (2009). Shared perceptual basis of emotional expressions and trustworthiness impressions from faces. Emotion, 9(1), 128.
[49]
[49] Penton-Voak, I. S., Pound, N., Little, A. C., & Perrett, D. I. (2006). Personality judgments from natural and composite facial images: More evidence for a “kernel of truth” in social perception. Social cognition, 24(5), 607-640.
[50]
[50] Fauconnier, G., & Turner, M. (2002). The Way We Think: Conceptual Blending and the Mind”s Hidden Complexities. Basic Books.
Index Terms
- Empathy through Aesthetics: Using AI Stylization for Visual Anonymization of Interview Videos
Recommendations
IMR based Anonymization for Privacy Preservation in Data Mining
KMO '16: Proceedings of the The 11th International Knowledge Management in Organizations Conference on The changing face of Knowledge Management Impacting SocietyPrivacy Preserving Data Mining (PPDM) is a data mining research area that aims to protect individual's personal information from unsolicited or unauthorized disclosure. Privacy relates to personal information that a person would not wish others to know ...
An evolutionary feature set decomposition based anonymization for classification workloads: Privacy Preserving Data Mining
Privacy has become an important concern while publishing micro data about a population. The emerging area called privacy preserving data mining (PPDM) focus on individual privacy without compromising data mining results. An adversarial exploitation of ...
Identities Anonymization in Dynamic Social Networks
ICDM '11: Proceedings of the 2011 IEEE 11th International Conference on Data MiningPrivacy in social network data publishing is always an important concern. Nowadays most prior privacy protection techniques focus on static social networks. However, there are additional privacy disclosures in dynamic social networks due to the ...
Comments
Information & Contributors
Information
Published In
May 2024
75 pages
ISBN:9798400717888
DOI:10.1145/3661790
Copyright © 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 26 June 2024
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
EmpathiCH 2024
EmpathiCH 2024: Scrutinizing Empathy-Centric Design Beyond the Individual
May 11 - 18, 2024
HI, Honolulu, USA
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 10Total Downloads
- Downloads (Last 12 months)10
- Downloads (Last 6 weeks)4
Reflects downloads up to 02 Sep 2024
Other Metrics
Citations
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format