research-article

The social camera: a case-study in contextual image recommendation

Authors:

Kevin McCarthy,

Barry SmythAuthors Info & Claims

IUI '11: Proceedings of the 16th international conference on Intelligent user interfaces

Pages 13 - 22

https://doi.org/10.1145/1943403.1943408

Published: 13 February 2011 Publication History

Abstract

The digital camera revolution has changed the world of photography and now most people have access to, and even regularly carry, a digital camera. Often these cameras have been designed with simplicity in mind: they harness a variety of sophisticated technologies in order to automatically take care of all manner of complex settings (aperture, shutter speed, flash etc.) for point-and-shoot ease, these assistive features are usually incorporated directly into the cameras interface. However, there is little or no support for the end-user when it comes to helping them to compose or frame a scene. To this end we describe a novel recommendation process which uses a variety of intelligent and assistive interfaces to guide the user in taking relevant compositions given their current location and scene context. This application has been implemented on the Android platform and we describe its core user interaction, recommendation technologies and demonstrate its effectiveness in a number of real-world scenarios. Specifically we report on the results of a live-user trial of the technology in a real-world tourist setting.

References

[1]

William Bares and Byungwoo Kim. Generating virtual camera compositions. In Proceedings of the 6th international conference on Intelligent user interfaces, IUI '01, pages 9--12, New York, NY, USA, 2001. ACM.

Digital Library

[2]

Victoria Bellotti, Bo Begole, and Ed H Chi et al. Activity-based serendipitous recommendations with the magitti mobile leisure guide. In Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, CHI '08, pages 1157--1166, New York, NY, USA, 2008. ACM.

Digital Library

[3]

M. Brown and D.G. Lowe. Recognising panoramas. In Computer Vision, 2003. Proceedings. Ninth IEEE International Conference on, pages 1218--1225 vol.2, oct. 2003.

Digital Library

[4]

M Davis, M Smith, J Canny, N Good, and S King. Towards context-aware face recognition. Proceedings of the 13th annual ACM international conference on Multimedia, pages 483--486, 2005.

Digital Library

[5]

Anind K. Dey. Understanding and using context. Personal Ubiquitous Computer., 5:4--7, January 2001.

Digital Library

[6]

Fredo Durand and Richard Szeliski. Guest editors' introduction: Computational photography. IEEE Computer Graphics and Applications, 27:21--22, 2007.

Digital Library

[7]

Alexei (Alyosha) Efros, Ramesh Raskar, and Steve Seitz. Next billion cameras. In ACM SIGGRAPH 2009 Courses, SIGGRAPH '09, pages 17:1--17:131, New York, NY, USA, 2009. ACM.

Digital Library

[8]

M. Gaubatz and R. Ulichney. Automatic red-eye detection and correction. In Image Processing. 2002. Proceedings. 2002 International Conference on, volume 1, pages I--804 -- I--807 vol.1, Dec. 2002.

[9]

Maria Håkansson, Sara Ljungblad, Lalya Gaye, and Lars Erik Holmquist. Snapshots from a study of context photography. In CHI '06 extended abstracts on Human factors in computing systems, CHI '06, pages 333--338, New York, NY, USA, 2006. ACM.

Digital Library

[10]

M. L. Kherfi, D. Ziou, and A. Bernardi. Image Retrieval from the World Wide Web: Issues, Techniques, and Systems. ACM Computing Surveys (CSUR), 36(1), 2004.

Digital Library

[11]

Ying Liu, Dengsheng Zhang, Guojun Lu, and Wei-Ying Ma. A survey of content-based image retrieval with high-level semantics. Pattern Recogn., 40:262--282, January 2007.

Digital Library

[12]

D.G. Lowe. Object recognition from local scale-invariant features. In Computer Vision, 1999. The Proceedings of the Seventh IEEE International Conference on, volume 2, pages 1150--1157 vol.2, August 1999.

Digital Library

[13]

Andrés Lucero, Marion Boberg, and Severi Uusitalo. Image space: capturing, sharing and contextualizing personal pictures in a simple and playful way. In Proceedings of the International Conference on Advances in Computer Enterntainment Technology, ACE '09, pages 215--222, New York, NY, USA, 2009. ACM.

Digital Library

[14]

Umberto Panniello, Alexander Tuzhilin, Michele Gorgoglione, Cosimo Palmisano, and Anto Pedone. Experimental comparison of pre- vs. post-filtering approaches in context-aware recommender systems. ACM Conference On Recommender Systems, pages 265--268, 2009.

Digital Library

[15]

Moon-Hee Park, Jin-Hyuk Hong, and Sung-Bae Cho. Ubiquitous Intelligence and Computing, volume 4611 of Lecture Notes in Computer Science. Springer Berlin Heidelberg, Berlin, Heidelberg, 2007.

[16]

Benjamin Proß, Johannes Schöning, and Antonio Krüger. iPiccer: automatically retrieving and inferring tagged location information from web repositories. ACM International Conference Proceeding Series, pages 1--2, 2009.

Digital Library

[17]

Linda; Shapiro and George Stockman. Query types: Query by example: Using a example image to define what to search for. Computer Vision. Upper Saddle River, NJ: Prentice Hall., New York, 2001.

[18]

C. T. Shen, J. C. Liu, S. W. Shih, and J. S. Hong. Towards intelligent photo composition-automatic detection of unintentional dissection lines in environmental portrait photos. Expert Systems with Applications: An International Journal, 36(5):9024--9030, 2009.

Digital Library

[19]

Arnold W. M. Smeulders, Marcel Worring, Simone Santini, Amarnath Gupta, and Ramesh Jain. Content-based image retrieval at the end of the early years. IEEE Trans. Pattern Anal. Mach. Intell., 22:1349--1380, December 2000.

Digital Library

[20]

Mark van Setten, Stanislav Pokraev, and Johan Koolwaaij. Context-Aware Recommendations in the Mobile Tourist Application COMPASS. In Adaptive Hypermedia and Adaptive Web-Based Systems, volume 3137, pages 515--548. Springer Berlin / Heidelberg, 2004.

[21]

Luis von Ahn. Human computation. In Computing Research that Changed the World: Reflections and Perspectives, CRASS '09, pages 4:1--4:23, Washington, D.C., 2009. Computing Research Association.

[22]

Ghim-Eng Yap, Ah-Hwee Tan, and Hwee-Hwa Pang. Dynamically-optimized context in recommender systems. In Proceedings of the 6th international conference on Mobile data management, MDM '05, pages 265--272, New York, NY, USA, 2005. ACM.

Digital Library

[23]

Lu Yuan, Jian Sun, Long Quan, and Heung-Yeung Shum. Image deblurring with blurred/noisy image pairs. ACM Trans. Graph., 26, July 2007.

Digital Library

[24]

Richard S Zakia. Perception and Imaging. Focal Press, 1997.

Cited By

Rutkowski TRutkowski T(2021)IntroductionExplainable Artificial Intelligence Based on Neuro-Fuzzy Modeling with Applications in Finance10.1007/978-3-030-75521-8_1(1-21)Online publication date: 8-Jun-2021
https://doi.org/10.1007/978-3-030-75521-8_1
Wang JJing XYan ZFu YPedrycz WYang L(2020)A Survey on Trust Evaluation Based on Machine LearningACM Computing Surveys10.1145/340829253:5(1-36)Online publication date: 28-Sep-2020
https://dl.acm.org/doi/10.1145/3408292
Deldjoo YSchedl MCremonesi PPasi G(2020)Recommender Systems Leveraging Multimedia ContentACM Computing Surveys10.1145/340719053:5(1-38)Online publication date: 28-Sep-2020
https://dl.acm.org/doi/10.1145/3407190
Show More Cited By

Index Terms

The social camera: a case-study in contextual image recommendation
1. Computing methodologies
  1. Computer graphics
    1. Graphics systems and interfaces
      1. Virtual reality
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
  2. Interaction design
    1. Interaction design process and methods
      1. Interface design prototyping

Recommendations

Simple, Accurate, and Robust Projector-Camera Calibration
3DIMPVT '12: Proceedings of the 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission

Structured-light systems are simple and effective tools to acquire 3D models. Built with off-the-shelf components, a data projector and a camera, they are easy to deploy and compare in precision with expensive laser scanners. But such a high precision ...
Baseline and Triangulation Geometry in a Standard Plenoptic Camera

In this paper, we demonstrate light field triangulation to determine depth distances and baselines in a plenoptic camera. Advances in micro lenses and image sensors have enabled plenoptic cameras to capture a scene from different viewpoints with ...
Retinal Viewfinder: Preliminary Study of Retinal Projection-Based Electric Viewfinder for Camera Devices
Human-Computer Interaction. Technological Innovation
Abstract
This paper presents a prototype of a new type of electronic viewfinder (EVF) that uses a retinal projection system. A viewfinder that enables users to preview an image is one of the characteristics and important interfaces of a camera. However, ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

IUI '11: Proceedings of the 16th international conference on Intelligent user interfaces

February 2011

504 pages

ISBN:9781450304191

DOI:10.1145/1943403

General Chairs:
Pearl Pu
EPFL, Switzerland
,
Michael Pazzani
Rutgers University, USA
,
Program Chairs:
Elisabeth André
Augsburg University, Germany
,
Doug Riecken
CCLS Columbia University, USA

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 February 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

IUI '11

Sponsor:

IUI '11: 16th International Conference on Intelligent User Interfaces

February 13 - 16, 2011

CA, Palo Alto, USA

Acceptance Rates

Overall Acceptance Rate 746 of 2,811 submissions, 27%

Upcoming Conference

IUI '25

Sponsor:
sigai
sigai

30th International Conference on Intelligent User Interfaces

March 24 - 27, 2025

Cagliari , Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

25
Total Citations
View Citations
635
Total Downloads

Downloads (Last 12 months)19
Downloads (Last 6 weeks)0

Reflects downloads up to 30 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Rutkowski TRutkowski T(2021)IntroductionExplainable Artificial Intelligence Based on Neuro-Fuzzy Modeling with Applications in Finance10.1007/978-3-030-75521-8_1(1-21)Online publication date: 8-Jun-2021
https://doi.org/10.1007/978-3-030-75521-8_1
Wang JJing XYan ZFu YPedrycz WYang L(2020)A Survey on Trust Evaluation Based on Machine LearningACM Computing Surveys10.1145/340829253:5(1-36)Online publication date: 28-Sep-2020
https://dl.acm.org/doi/10.1145/3408292
Deldjoo YSchedl MCremonesi PPasi G(2020)Recommender Systems Leveraging Multimedia ContentACM Computing Surveys10.1145/340719053:5(1-38)Online publication date: 28-Sep-2020
https://dl.acm.org/doi/10.1145/3407190
Völkel SSchneegass CEiband MBuschek DPaternò FOliver NConati CSpano LTintarev N(2020)What is "intelligent" in intelligent user interfaces?Proceedings of the 25th International Conference on Intelligent User Interfaces10.1145/3377325.3377500(477-487)Online publication date: 17-Mar-2020
https://dl.acm.org/doi/10.1145/3377325.3377500
Eickmeyer KHeuvel JKawarabayashi KKreutzer SMendez PPilipczuk MQuiroz DRabinovich RSiebertz S(2020)Model-Checking on Ordered StructuresACM Transactions on Computational Logic10.1145/336001121:2(1-28)Online publication date: 2-Mar-2020
https://dl.acm.org/doi/10.1145/3360011
Burkhardt SKramer S(2019)A Survey of Multi-Label Topic ModelsACM SIGKDD Explorations Newsletter10.1145/3373464.337347421:2(61-79)Online publication date: 26-Nov-2019
https://dl.acm.org/doi/10.1145/3373464.3373474
Zhou XZafarani R(2019)Network-based Fake News DetectionACM SIGKDD Explorations Newsletter10.1145/3373464.337347321:2(48-60)Online publication date: 26-Nov-2019
https://dl.acm.org/doi/10.1145/3373464.3373473
Feng SCarapelle CGil OQuaas K(2019)MTL and TPTL for One-Counter MachinesACM Transactions on Computational Logic10.1145/337278921:2(1-34)Online publication date: 20-Dec-2019
https://dl.acm.org/doi/10.1145/3372789
Lusk CJones M(2019)Cake CamProceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services10.1145/3338286.3340123(1-9)Online publication date: 1-Oct-2019
https://dl.acm.org/doi/10.1145/3338286.3340123
Rawat YKankanhalli M(2017)ClickSmartIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2016.255565827:1(149-158)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.1109/TCSVT.2016.2555658
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents