Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/1743384.1743472acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
poster

Semantic structuring and retrieval of event chapters in social photo collections

Published: 29 March 2010 Publication History

Abstract

The phenomenal growth of multimedia content on the web over the last couple of decades has paved the way for content management systems integrating intelligent information retrieval and indexing techniques. Also, in order to improve the performance of retrieval techniques while searching and navigating the database, many relevance feedback algorithms are implemented, in which the subjective semantics of individual users are included in the image search. Following the recent developments in social networking, there is an emerging interest to share experiences online with friends using multimedia data. As the experiences to be shared among social peers vary from a simple social gathering to a tourism visit with a group of peers, there is a critical need for intelligent content management tools driven by a social perspective. Addressing the challenges related to socially-driven content management, the objective of this paper is twofold. First, we investigate techniques to intelligently structure multimedia content to enable efficient browsing of photo albums. The proposed structuring schemes exploit EXIF metadata, visual content and social peer relationships. Second, we propose a retrieval model based on social context to identify users with similar interests. The retrieval model aims to allow increased interaction among social peers. The proposed techniques have been evaluated against tourism pictures captured across Europe.

References

[1]
K. Chandramouli, Image Classification using Particle Swarm Optimisation, PhD thesis, Queen Mary, University of London, January 2009.
[2]
M. Cooper, J. Foote, A. Girgensohn, and L. Wilcox, Temporal event clustering for digital photo collections, In Proc. of ACM Multimedia, pages 364--373, 2003.
[3]
R. Eberhart and Y. Shi, Tracking and optimizing dynamic systems with particle swarms, Evolutionary Computation, 2001. Proceedings of the 2001 Congress, 2001.
[4]
A. Graham, H. Garcia-Molina, A. Paepcke, and T. Winograd, Time as the essence for photo browsing through personal digital libraries, In Proc. of ACM/IEEE Conference on Digital Libraries, pages 326--335, 2002.
[5]
J. J. Hopfield, Neural networks and physical systems with emergent collective computational abilities, Proc. Natl. Acad. Sci., 79:2554--2558, 1982.
[6]
M. Inoue, Image retrieval: Research and use in the information explosion, Progress in Informations, 6:3--14, 2009.
[7]
J. Kennedy and R. C. Eberhart, Swarm intelligence, Morgan Kaufmann, 2001.
[8]
T. Kliegr, K. Chandramouli, J. Nemrava, V. Svátek, and E. Izquierdo, Combining captions and visual analysis for image concept classification, In MDM/KDD'08: Proceedings of the 9h International Workshop on Multimedia Data Mining. ACM, 2008.
[9]
T. Kohonen, The self organizing map, Proceedings of IEEE, 78(4):1464--1480, September 1990.
[10]
A. Loui and A. Savakis, Automatic image event segmentation and quality screening for albuming applications, In Proc. of IEEE Conference on Multimedia and Expo, pages 1125--1128, 2000.
[11]
T. Mei, B. Wang, X. S. Hua, H. Q. Zhou, and S. Li, Probabilistic multimodality fusion for event based home photo clustering, IEEE International Conference on Multimedia and Expo, pages 1757--1760, 2006.
[12]
M. Mitchell, An introduction to Genetic Algorithms, MIT Press, Cambridge, MA, 1996.
[13]
M. Naaman, Y. J. Song, A. Paepcke, and H. G. Molina, Automatic organisation for digital photographs with geographic coordinates, In Proc. of ACM/IEEE Conference on Digital Libraries, pages 141--150, 2004.
[14]
Picasa, http://picasa.google.com.
[15]
A. Pigeau and M. Gelgon, Building and tracking hierarchical geographicsl and temporal partitions for image collection management on mobile devices, In Proc. of ACM Multimedia, pages 141--150, 2005.
[16]
J. Platt, Autoalbum: Clustering digital photographs using probabilistic model merging, In Proc. of IEEE Workshop on content-based Access of Image and Video, pages 96--100, 2000.
[17]
J. C. Platt, M. Czerwinski, and B. Field, Phototoc: Automatic clustering for browsing personal photographs, In Technical Report, 2003.
[18]
A. Rae, Social context aiding image search, In Poster, 2008.
[19]
C. Reynolds, Flocks, herds and schools: a distributed behavioural model, In Computer Graphics, pages 25--34, 1987.
[20]
D. E. Rumelhart, G. E. Hinton, and R. J. Williams, Learning internal representations by error propagation, Parallel Distributed Processing: Explorations in the Microstructure of Cognition, 1:318--362, 1986.
[21]
B. Shu and B. Bederson, Semi-automatic image annotation using event and torso identification, Technical report, Computer Science Department, University of Maryland, College Park MD, 2004.
[22]
R. Xu and D. W. II, Survey of clustering algorithms, IEEE Trans. Neural Network, 6(3):645--678.
[23]
M. Zhao, Y. Teo, T. C. S. Liu, and R. Jain, Automatic person annotation of family photo album, In International Conference on Image and Video Retrieval, pages 163--172, 2006.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MIR '10: Proceedings of the international conference on Multimedia information retrieval
March 2010
600 pages
ISBN:9781605588155
DOI:10.1145/1743384
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 March 2010

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. exif metadata
  2. image retrieval
  3. metadata fusion
  4. particle swarm optimisation
  5. social context
  6. user generated content

Qualifiers

  • Poster

Conference

MIR '10
Sponsor:
MIR '10: International Conference on Multimedia Information Retrieval
March 29 - 31, 2010
Pennsylvania, Philadelphia, USA

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 26 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2012)Improving face recognition with genealogical and contextual dataProceedings of the 27th Conference on Image and Vision Computing New Zealand10.1145/2425836.2425897(307-312)Online publication date: 26-Nov-2012
  • (2011)Semantic analysis and retrieval in personal and social photo collectionsMultimedia Tools and Applications10.1007/s11042-010-0673-151:1(5-33)Online publication date: 1-Jan-2011
  • (2011)Automatic image semantic interpretation using social action and tagging dataMultimedia Tools and Applications10.1007/s11042-010-0650-851:1(213-246)Online publication date: 1-Jan-2011
  • (2010)Concept based interactive retrieval for social environmentProceedings of the 2010 ACM workshop on Social, adaptive and personalized multimedia interaction and access10.1145/1878061.1878067(15-20)Online publication date: 29-Oct-2010

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media