poster

Consumer image retrieval by estimating relation tree from family photo collections

Authors:

Tong Zhang,

Hui Chao,

Chris Willis,

Dan TretterAuthors Info & Claims

CIVR '10: Proceedings of the ACM International Conference on Image and Video Retrieval

Pages 143 - 150

https://doi.org/10.1145/1816041.1816065

Published: 05 July 2010 Publication History

Get Access

Abstract

In this paper, we propose an approach to automatically estimate relationship among people in a family image collection based on results from face analyses technologies including automated face recognition and clustering, demographic assessment, and face similarity measurement, as well as contextual information such as people co-appearance, people's relative positions in photos and image timestamps. As the result, a relation tree can be estimated which provides important semantic information regarding people involved in a photo collection and has numerous applications in photo sharing and browsing, social networking, etc. The methods for deriving and integrating information from photos and the process for estimating a relation tree are described. Experimental results on two typical consumer photo collections and examples of using these results in consumer image retrieval are presented.

References

[1]

R. Rowe, G. Creamer, S. Hershkop and S. Stolfo. Automated social hierarchy detection through email network analysis. Proc. of the 9^th WebKDD and 1^st SNA-KDD Workshop on Web Mining and Social Network Analysis, pages 109--117, San Jose, California, USA, 2007.

Digital Library

Google Scholar

[2]

S. Golder. Measuring social networks with digital photograph collections. Proceedings of the 19^th ACM Conference on Hypertext and Hypermedia, pages 43--47, June 2008.

Digital Library

Google Scholar

[3]

P. Wu and D. Tretter. Close & Closer: social cluster and closeness from photo collections. Proceedings of ACM Conf. on Multimedia, pages 709--712, Beijing, Oct. 2009.

Digital Library

Google Scholar

[4]

A. C. Gallagher and T. Chen. Using context to recognize people in consumer images. IPSJ Trans. on Computer Vision and Applications, 1:115--126, 2009.

Crossref

Google Scholar

[5]

L. Gu, T. Zhang and X. Ding. Clustering consumer photos based on face recognition. Proceedings of IEEE Conf. on Multimedia and Expo, pages 1998--2001, Beijing, July 2007.

Crossref

Google Scholar

[6]

T. Zhang, J. Xiao, D. Wen and X. Ding. Face based image navigation and search. Proceedings of ACM Conf. on Multimedia, pages 597--600, Beijing, Oct. 2009.

Digital Library

Google Scholar

[7]

W. Gao and H. Ai. Face gender classification on consumer images in a multiethnic environment. Proceedings of the 3rd IAPR International Conference on Biometrics, University of Sassari, Italy, June 2--5, 2009.

Digital Library

Google Scholar

[8]

F. Gao, H. Ai. Face age classification on consumer images with Gabor feature and fuzzy LDA method. Proceedings of the 3rd IAPR International Conference on Biometrics, University of Sassari, Italy, June 2--5, 2009.

Digital Library

Google Scholar

[9]

C. Liu and H. Wechsler. Gabor feature based classification using the enhanced Fisher linear discriminant model for face recognition. IEEE Trans. on Image Processing, 11(4):467--476, April 2002.

Digital Library

Google Scholar

[10]

P. Belhumeur, J. Hespanha, et al. Eigenfaces vs. Fisherfaces: recognition using class specific linear projection. Proc. European Conf. on Computer Vision, pages 45--58, 1996.

Digital Library

Google Scholar

Cited By

View all

Lin TLi THuang C(2019)Spatial Face Context with Age and Background Cues for Group Photo Retrieval2019 20th IEEE/ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD)10.1109/SNPD.2019.8935746(108-113)Online publication date: Jul-2019
https://doi.org/10.1109/SNPD.2019.8935746
Choi CLee YYoon S(2016)Discriminative subgraphs for discovering family photosComputational Visual Media10.1007/s41095-016-0054-42:3(257-266)Online publication date: 16-Jun-2016
https://doi.org/10.1007/s41095-016-0054-4
Chiu YHsu RHuang C(2014)Spatial Face Context with Gender Information for Group Photo Similarity AssessmentProceedings of the 2014 22nd International Conference on Pattern Recognition10.1109/ICPR.2014.462(2673-2678)Online publication date: 24-Aug-2014
https://dl.acm.org/doi/10.1109/ICPR.2014.462
Show More Cited By

Index Terms

Consumer image retrieval by estimating relation tree from family photo collections
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision tasks
2. Information systems
  1. Information retrieval
    1. Document representation

Recommendations

Building dynamic relation tree from photo collections
ICME '11: Proceedings of the 2011 IEEE International Conference on Multimedia and Expo

Recognizing people and identifying their relations from images have significant social and business values. In this paper, we present an automated workflow that derives a relation tree for major characters in a photo collection by integrating ...
Dynamic estimation of family relations from photos
MMM'11: Proceedings of the 17th international conference on Advances in multimedia modeling - Volume Part II

In this paper, we present an approach to estimate dynamic relations among major characters in family photo collections. This is a fully automated procedure which first identifies major characters in photo collections through face clustering. Then, based ...
Photo to Family Tree: Deep Kinship Understanding for Nuclear Family Photos
ASMMC-MMAC'18: Proceedings of the Joint Workshop of the 4th Workshop on Affective Social Multimedia Computing and first Multi-Modal Affective Computing of Large-Scale Multimedia Data

Multi-person kinship recognition is complicated and challenging as an extension of existing studies on recognizing kinship in pairwise face images independently, with little existing literature. In this paper, we extend kinship recognition from two ...

Comments

Information & Contributors

Information

Published In

CIVR '10: Proceedings of the ACM International Conference on Image and Video Retrieval

July 2010

492 pages

ISBN:9781450301176

DOI:10.1145/1816041

Conference Chairs:
Shipeng Li
Microsoft Research Asia, China
,
Xinbo Gao
Xidian University, China
,
Nicu Sebe
University of Trento, Italy

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

SIGIR: ACM Special Interest Group on Information Retrieval

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 July 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Poster

Conference

CIVR' 10

Sponsor:

SIGMM

CIVR' 10: International Conference on Image and Video Retrieval

July 5 - 7, 2010

Xi'an, China

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
308
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)2

Reflects downloads up to 31 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Lin TLi THuang C(2019)Spatial Face Context with Age and Background Cues for Group Photo Retrieval2019 20th IEEE/ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD)10.1109/SNPD.2019.8935746(108-113)Online publication date: Jul-2019
https://doi.org/10.1109/SNPD.2019.8935746
Choi CLee YYoon S(2016)Discriminative subgraphs for discovering family photosComputational Visual Media10.1007/s41095-016-0054-42:3(257-266)Online publication date: 16-Jun-2016
https://doi.org/10.1007/s41095-016-0054-4
Chiu YHsu RHuang C(2014)Spatial Face Context with Gender Information for Group Photo Similarity AssessmentProceedings of the 2014 22nd International Conference on Pattern Recognition10.1109/ICPR.2014.462(2673-2678)Online publication date: 24-Aug-2014
https://dl.acm.org/doi/10.1109/ICPR.2014.462
Brenner MIzquierdo E(2013)Gender-aided people recognition in photo collections2013 IEEE 15th International Workshop on Multimedia Signal Processing (MMSP)10.1109/MMSP.2013.6659260(035-039)Online publication date: Sep-2013
https://doi.org/10.1109/MMSP.2013.6659260
Chiu YLi CHuang CChung PChen T(2013)Efficient graph based spatial face context representation and matching2013 IEEE International Conference on Acoustics, Speech and Signal Processing10.1109/ICASSP.2013.6638004(2001-2005)Online publication date: May-2013
https://doi.org/10.1109/ICASSP.2013.6638004
Cavalcanti CGomes HDe Queiroz J(2013)A survey on automatic techniques for enhancement and analysis of digital photographyJournal of the Brazilian Computer Society10.1007/s13173-013-0102-119:3(341-359)Online publication date: 26-Mar-2013
https://doi.org/10.1007/s13173-013-0102-1
Raad EChbeir RDipanda A(2013)Discovering relationship types between users using profiles and shared photos in a social networkMultimedia Tools and Applications10.1007/s11042-011-0853-764:1(141-170)Online publication date: 1-May-2013
https://dl.acm.org/doi/10.1007/s11042-011-0853-7
Brenner MIzquierdo E(2013)Mining People’s Appearances to Improve Recognition in Photo CollectionsAdvances in Multimedia Modeling10.1007/978-3-642-35725-1_17(185-195)Online publication date: 2013
https://doi.org/10.1007/978-3-642-35725-1_17
Chen YHsu WLiao HBabaguchi NAizawa KSmith JSatoh SPlagemann THua XYan R(2012)Discovering informative social subgraphs and predicting pairwise relationships from group photosProceedings of the 20th ACM international conference on Multimedia10.1145/2393347.2393439(669-678)Online publication date: 29-Oct-2012
https://dl.acm.org/doi/10.1145/2393347.2393439
Zhang TChao HTretter D(2011)Dynamic estimation of family relations from photosProceedings of the 17th international conference on Advances in multimedia modeling - Volume Part II10.5555/1950054.1950063(65-76)Online publication date: 5-Jan-2011
https://dl.acm.org/doi/10.5555/1950054.1950063
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Building dynamic relation tree from photo collections

Dynamic estimation of family relations from photos

Photo to Family Tree: Deep Kinship Understanding for Nuclear Family Photos

Comments

Published In

Sponsors

In-Cooperation

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Other Metrics

Article Metrics

Other Metrics

Cited By

Login options

Full Access

PDF

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Building dynamic relation tree from photo collections

Dynamic estimation of family relations from photos

Photo to Family Tree: Deep Kinship Understanding for Nuclear Family Photos

Comments

Information

Published In

Sponsors

In-Cooperation

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations