Improving face recognition with genealogical and contextual data
Pages 307 - 312
Abstract
The field of genealogy has embraced the move towards digitisation, with increasingly large quantities of historical photographs being digitised in an effort to both preserve and share with a wider audience. Genealogy software is prevalent, but while many programs support photograph management, none use face recognition to assist in the identification and tagging of individuals. Genealogy is in the unique position of possessing a rich source of context in the form of a family tree, that a face recognition engine can draw information from. We aim to improve the accuracy of face recognition results within a family photograph album through the use of a filter that uses available contextual information from a given family tree. We also use measures of co-occurrence, recurrence and relative physical distance of individuals within the album to accurately predict the identity of individuals. This novel use of genealogical data as context has provided encouraging results, with a 26% improvement in accuracy at hit list size 1 and a 21% improvement at size 5 over the use of face recognition alone, when identifying 348 faces against a database of 523 faces from a challenging dataset of 173 family photographs.
References
[1]
Anguelov, D., Lee, K., Gokturk, S., and Sumengen, B. Contextual identity recognition in personal photo albums. In Computer Vision and Pattern Recognition, 2007. CVPR '07. IEEE Conference on (june 2007), pp. 1--7.
[2]
Brenner, M., and Izquierdo, E. Graph-based recognition in photo collections using social semantics. In Proceedings of the 2011 ACM workshop on Social and behavioural networked media access (New York, NY, USA, 2011), SBNMA '11, ACM, pp. 47--52.
[3]
Carvalho, R. F., Chapman, S., and Ciravegna, F. Attributing semantics to personal photographs. Multimedia Tools Appl. 42, 1 (Mar. 2009), 73--96.
[4]
Chandramouli, K., and Izquierdo, E. Semantic structuring and retrieval of event chapters in social photo collections. In Proceedings of the international conference on Multimedia information retrieval (New York, NY, USA, 2010), MIR '10, ACM, pp. 507--516.
[5]
Chi-Yao, T., and Ming-Syan, C. Photo identity tag suggestion using only social network context on large-scale web services. In Multimedia and Expo (ICME), 2011 IEEE International Conference on (2011), pp. 1--4.
[6]
Elahi, N., Karlsen, R., and Younas, W. Image annotation by leveraging the social context. In Proceedings of the 5th International Conference on Ubiquitous Information Management and Communication (New York, NY, USA, 2011), ICUIMC '11, ACM, pp. 40:1--40:8.
[7]
Frijters, J. IKVM.NET, July 2012. http://www.ikvm.net/.
[8]
Harrah, M. gedcom4j: A Java library for processing GEDCOM genealogy files., June 2012. http://code.google.com/p/gedcom4j/.
[9]
Huang, L., Xia, T., Wan, J., Zhang, Y., and Lin, S. Personalized portraits ranking. In Proceedings of the 19th ACM international conference on Multimedia (New York, NY, USA, 2011), MM '11, ACM, pp. 1277--1280.
[10]
Imaoka, H., Hayasaka, A., Morishita, Y., Sato, A., and Hiroaki, T. Nec's face recognition technology and its applications. NEC Technical Journal 5, 3 (October 2010), 28--33.
[11]
Jingyu, C., Fang, W., Rong, X., Yuandong, T., and Xiaoou, T. EasyAlbum: an interactive photo annotation system based on face clustering and re-ranking, 2007.
[12]
Lee, Y. J., and Grauman, K. Face discovery with social context. In Proceedings of the British Machine Vision Conference (2011), BMVA Press, pp. 36.1--36.11. http://dx.doi.org/10.5244/C.25.36.
[13]
Lei, Z., Longbin, C., Mingjing, L., and Hongjiang, Z. Automated annotation of human faces in family albums, 2003.
[14]
Little, D., Krishna, S., Black, J., and Panchanathan, S. A Methodology for Evaluating Robustness of Face Recognition Algorithms with Respect to Variations in Pose Angle and Illumination Angle. In Acoustics, Speech, and Signal Processing, 2005. Proceedings. (ICASSP '05). IEEE International Conference on (2005), vol. 2, pp. 89--92.
[15]
Marc, D., Simon, K., Nathan, G., and Risto, S. From context to content: leveraging context to infer media metadata, 2004.
[16]
Naaman, M., Yeh, R. B., Garcia-Molina, H., and Paepcke, A. Leveraging Context to Resolve Identity in Photo Albums, 2005.
[17]
Nefian, A. V., and Hayes III, M. H. Hidden Markov models for face recognition. In Acoustics, Speech and Signal Processing, 1998. Proceedings of the 1998 IEEE International Conference on (1998), vol. 5, pp. 2721--2724 vol. 5.
[18]
Ng, W., Zheng, T.-M., Chan, P., and Yeung, D. Social relationship discovery and face annotation in personal photo collection. In Machine Learning and Cybernetics (ICMLC), 2011 International Conference on (july 2011), vol. 2, pp. 631--637.
[19]
Pentland, A., Moghaddam, B., and Starner, T. View-based and modular eigenspaces for face recognition. In Computer Vision and Pattern Recognition, 1994. Proceedings CVPR '94., 1994 IEEE Computer Society Conference on (1994), pp. 84--91.
[20]
Phillips, P. MBGC Still Face Challenge version 2 Preliminary Results. In MBGC Workshop (2009).
[21]
Sato, A., Inoue, A., Suzuki, T., and Hosoi, T. NeoFace: Development of face detection and recognition engine. NEC Research & Development 44, 3 (July 2003), 302--306.
[22]
Shimizu, K., Nitta, N., and Babaguchi, N. Learning people co-occurrence relations by using relevance feedback for retrieving group photos. In Proceedings of the 1st ACM International Conference on Multimedia Retrieval (New York, NY, USA, 2011), ICMR '11, ACM, pp. 57:1--57:8.
[23]
Söderberg, J., and Kakogianni, E. Automatic tag generation for photos using contextual information and description logics. In Content-Based Multimedia Indexing (CBMI), 2010 International Workshop on (2010), pp. 1--7.
[24]
Stone, Z., Zickler, T., and Darrell, T. Autotagging facebook: Social network context improves photo annotation. In Computer Vision and Pattern Recognition Workshops, 2008. CVPRW '08. IEEE Computer Society Conference on (june 2008), pp. 1--8.
[25]
Turk, M. A., and Pentland, A. P. Face recognition using eigenfaces. In Computer Vision and Pattern Recognition, 1991. Proceedings CVPR '91., IEEE Computer Society Conference on (1991), pp. 586--591.
[26]
Wright, S. Coefficients of Inbreeding and Relationship. The American Naturalist 56, 645 (1922), 330--338.
[27]
Wu, P., and Tang, F. Improving face clustering using social context. In Proceedings of the international conference on Multimedia (New York, NY, USA, 2010), MM '10, ACM, pp. 907--910.
[28]
Zhao, W., Chellappa, R., Phillips, P. J., and Rosenfeld, A. Face recognition: A literature survey. ACM Comput. Surv. 35, 4 (2003), 399--458.
Index Terms
- Improving face recognition with genealogical and contextual data
Recommendations
Age-Invariant Face Recognition
One of the challenges in automatic face recognition is to achieve temporal invariance. In other words, the goal is to come up with a representation and matching scheme that is robust to changes due to facial aging. Facial aging is a complex process that ...
Face recognition under varying illumination using gradientfaces
In this correspondence, we propose a novel method to extract illumination insensitive features for face recognition under varying lighting called the Gradientfaces. Theoretical analysis shows Gradientfaces is an illumination insensitive measure, and ...
Automatic face analysis system based on face recognition and facial physiognomy
ICHIT'06: Proceedings of the 1st international conference on Advances in hybrid information technologyAn automatic face analysis system is proposed which uses face recognition and facial physiognomy. It first detects human's face, extracts its features, and classifies the shape of facial features. It will analyze the person's facial physiognomy and then ...
Comments
Information & Contributors
Information
Published In
November 2012
547 pages
Copyright © 2012 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
- HRS: Hoare Research Software Ltd.
- Google Inc.
- Dept. of Information Science, Univ.of Otago: Department of Information Science, University of Otago, Dunedin, New Zealand
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 26 November 2012
Check for updates
Author Tags
Qualifiers
- Poster
Conference
IVCNZ '12
Sponsor:
- HRS
- Dept. of Information Science, Univ.of Otago
Acceptance Rates
Overall Acceptance Rate 55 of 74 submissions, 74%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 123Total Downloads
- Downloads (Last 12 months)2
- Downloads (Last 6 weeks)0
Reflects downloads up to 25 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in