Article

Leveraging ontologies, context and social networks to automate photo annotation

Authors:

Fergal Monaghan,

David O'SullivanAuthors Info & Claims

SAMT'07: Proceedings of the semantic and digital media technologies 2nd international conference on Semantic Multimedia

Pages 252 - 255

Published: 05 December 2007 Publication History

Abstract

This paper presents an approach to semi-automate photo annotation. Instead of using content-recognition techniques this approach leverages context information available at the scene of the photo such as time and location in combination with existing photo annotations to provide suggestions to the user. An algorithm exploits a number of technologies including Global Positioning System (GPS), Semantic Web, Web services and Online Social Networks, considering all information and making a best-effort attempt to suggest both people and places depicted in the photo. The user then selects which of the suggestions are correct to annotate the photo. This process accelerates the photo annotation process dramatically which in turn aids photo search for a wide range of query tools that currently trawl the millions of photos on the Web.

References

[1]

Infotrends: Worldwide camera phone sales to reach nearly 150 million in 2004, capturing 29 billion digital images. Technical report (2004).

Google Scholar

[2]

Infotrends: Worldwide consumer digital camera sales to reach nearly 53 million in 2004. Technical report (2003).

Google Scholar

[3]

Naaman, M., Harada, S., Wangy, Q., Garcia-Molina, H.: Context data in georeferenced digital photo collections. In: MM 2004. International Conference on Multimedia, New York, NY (2004).

Digital Library

Google Scholar

[4]

O'Toole, A.J., Phillips, P.J., Jiang, F., Ayyad, J., Penard, N., Abdi, H.: Face recognition algorithms surpass humans matching faces over changes in illumination. IEEE Transactions on Pattern Analysis and Machine Intelligence 29(9), 1642-1646 (2007).

Digital Library

Google Scholar

[5]

Nowack, B.: Confoto: Browsing and annotating conference photos on the semantic web. Web Semantics: Science, Services, and Agents on the World Wide Web 4(4), 263-266 (2006).

Digital Library

Google Scholar

[6]

Naaman, M.: Leveraging Geo-Referenced Digital Photographs. PhD thesis, Stanford University (2005).

Digital Library

Google Scholar

Cited By

View all

Firmino ASouza Baptista CFigueirêdo HPereira ESousa Pereira Amorim B(2019)Automatic and semi-automatic annotation of people in photography using shared eventsMultimedia Tools and Applications10.1007/s11042-018-6715-978:10(13841-13875)Online publication date: 1-May-2019
https://dl.acm.org/doi/10.1007/s11042-018-6715-9
Andrade DMaia LFigueirêdo HViana WTrinta FSouza Baptista C(2018)Photo annotationMultimedia Tools and Applications10.1007/s11042-016-4281-677:1(423-457)Online publication date: 1-Jan-2018
https://dl.acm.org/doi/10.1007/s11042-016-4281-6
McParlane PJose J(2013)Exploiting time in automatic image taggingProceedings of the 35th European conference on Advances in Information Retrieval10.1007/978-3-642-36973-5_44(520-531)Online publication date: 24-Mar-2013
https://dl.acm.org/doi/10.1007/978-3-642-36973-5_44
Show More Cited By

Recommendations

Photo annotation: a survey

Due to the large number of photos that are currently being generated, it is very important to have techniques to organize, search for, and retrieve such images. Photo annotation plays a key role in these mechanisms because it can link raw data (photos) ...
From usage to annotation: analysis of personal photo albums for semantic photo understanding
WSM '09: Proceedings of the first SIGMM workshop on Social media

With photo albums we aim to capture personal events such as weddings, vacations, and parties of family and friends. By arranging photo prints, captions and paper souvenirs such as tickets over the pages of a photo book we tell a story to capture and ...
Semantics, content, and structure of many for the creation of personal photo albums
MM '07: Proceedings of the 15th ACM international conference on Multimedia

Photos are often a means to remember personal events, and the creation of photo albums is the attempt to preserve our memories in a nice book. For a long time people have been creating such photo albums on the basis of prints from analog photos arranged ...

Comments

Information & Contributors

Information

Published In

SAMT'07: Proceedings of the semantic and digital media technologies 2nd international conference on Semantic Multimedia

December 2007

305 pages

ISBN:354077033X

Editors:
Bianca Falcidieno
Consiglio Nazionale delle Ricerche, Istituto per la Matematica Applicata e Tecnologie Informatiche, Genova, Italy
,
Michela Spagnuolo
Consiglio Nazionale delle Ricerche, Istituto per la Matematica Applicata e Tecnologie Informatiche, Genova, Italy
,
Yannis Avrithis
National Technical University of Athens, School of Electrical and Computer Engineering, Image, Video and Multimedia Systems Laboratory, Athens, Greece
,
Ioannis Kompatsiaris
Informatics and Telematics Institute, Thessaloniki, Greece
,
Paul Buitelaar
DFKI GmbH, Language Technology Lab, Saarbruecken, Germany

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 05 December 2007

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
5
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Firmino ASouza Baptista CFigueirêdo HPereira ESousa Pereira Amorim B(2019)Automatic and semi-automatic annotation of people in photography using shared eventsMultimedia Tools and Applications10.1007/s11042-018-6715-978:10(13841-13875)Online publication date: 1-May-2019
https://dl.acm.org/doi/10.1007/s11042-018-6715-9
Andrade DMaia LFigueirêdo HViana WTrinta FSouza Baptista C(2018)Photo annotationMultimedia Tools and Applications10.1007/s11042-016-4281-677:1(423-457)Online publication date: 1-Jan-2018
https://dl.acm.org/doi/10.1007/s11042-016-4281-6
McParlane PJose J(2013)Exploiting time in automatic image taggingProceedings of the 35th European conference on Advances in Information Retrieval10.1007/978-3-642-36973-5_44(520-531)Online publication date: 24-Mar-2013
https://dl.acm.org/doi/10.1007/978-3-642-36973-5_44
Hynes GReynolds VHauswirth M(2009)A context lifecycle for web-based context management servicesProceedings of the 4th European conference on Smart sensing and context10.5555/1813042.1813049(51-65)Online publication date: 16-Sep-2009
https://dl.acm.org/doi/10.5555/1813042.1813049
de Figueirêdo HFernandes Rde Menezes Lde Souza Baptista CLacerda Yde Paiva AKotsis GTaniar DPardede E(2009)A context-aware solution to annotate people in mobile devicesProceedings of the 7th International Conference on Advances in Mobile Computing and Multimedia10.1145/1821748.1821775(113-120)Online publication date: 14-Dec-2009
https://dl.acm.org/doi/10.1145/1821748.1821775
Sandhaus PBoll SBoll SHoi SLuo JJin RKing IXu D(2009)From usage to annotationProceedings of the first SIGMM workshop on Social media10.1145/1631144.1631151(27-34)Online publication date: 23-Oct-2009
https://dl.acm.org/doi/10.1145/1631144.1631151

Abstract

References

Cited By

Recommendations

Photo annotation: a survey

From usage to annotation: analysis of personal photo albums for semantic photo understanding

Semantics, content, and structure of many for the creation of personal photo albums

Comments

Information

Published In

Sponsors

Publisher

Publication History

Author Tags

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations