research-article

User interaction techniques for multimedia retrieval

Authors:

Chamin Morikawa and

Gamhewage C. de SilvaAuthors Info & Claims

HCCE '12: Proceedings of the 2012 Joint International Conference on Human-Centered Computer Environments

March 2012

Pages 68 - 75

https://doi.org/10.1145/2160749.2160765

Published: 08 March 2012 Publication History

Abstract

We present a set of novel user interaction techniques for fast and efficient multimedia querying and retrieval. Three new types of visual queries are proposed for retrieving different types of multimedia. Iconic queries facilitate editorial image retrieval and social multimedia retrieval. Simple sketches on a map form spatial queries for retrieving location-based multimedia. Sketches on an interactive calendar form queries for temporal multimedia retrieval. We also propose an interactive querying strategy that combines multiple search dimensions, to facilitate easier refinement of searches. We outline two applications that use the proposed interaction techniques and querying strategy. The users found these techniques and applications easy to learn and use.

References

[1]

C. Bird, P. Elliott, and E. Griffiths. User interfaces for content-based image retrieval. In Intelligent Image Databases, IEE Colloq. on, pages 8/1--8/4, may 1996.

[2]

K. S. Candan, W. Li, and M. L. Priya. Similarity-based ranking and query processing in multimedia databases. Data Knowl. Eng., 35(3):259--298, December 2000.

Digital Library

[3]

Corbis. Stock photography, footage and rights: Corbis, 2011.

[4]

R. Datta, D. Joshi, J. Li, and J. S. Wang. Image retrieval: Ideas, influences, and trends of the new age. ACM Computing Surveys, 40(2):1--60, 2008.

Digital Library

[5]

G. de Silva, T. Yamasaki, and K. Aizawa. Sketch-based spatial queries for retrieving human locomotion patterns from continuously archived gps data. IEEE Transactions on Multimedia, 11(7):1240--1253, November 2009.

Digital Library

[6]

G. C. De Silva and K. Aizawa. Visual querying with iconic sketches for face image retrieval. In HCI International 2009, San Diego, CA, USA, July 2009.

[7]

M. J. Egenhofer. Query processing in spatial-query-by-sketch. Journal of Visual Languages and Computing, 8:403--424, 1997.

[8]

S. fu Chang, W. Chen, and H. Sundaram. Videoq: A fully automated video retrieval system using motion sketches. In Proc. 4 th IEEE Workshop on Applications of Computer Vision, pages 27--0, 1998.

Digital Library

[9]

A. Girgensohn, J. Adcock, and L. Wilcox. Leveraging face recognition technology to find and organize photos. In In Proceedings of the 6th ACM SIGMM international workshop on MIR, pages 99--106, 2004.

Digital Library

[10]

Google. Options panel on the search results page. In http://www.google.com/support/websearch/bin/answer.py?hl=en&answer=142143, 2011.

[11]

E. Hamilton. Jpeg file interchange format. In C-cube Microsystems, Milpitas. CA95035, 1992.

[12]

L.-J. Hove. Evaluating use of interfaces for visual query specification. In Norwegian NOKOBIT 2007 Conference, 2007.

[13]

G. Images. Getty images: Stock photography, editorial photos, footage and music, 2011.

[14]

M. Kopczynski. Efficient spatial queries with sketches. In IfromI06, pages 597--600, 2006.

[15]

K. Rodden. Evaluating similarity based visualizations as interfaces for image browsing. In Technical Report UCAM-CL-TR-543, University of Cambridge, 2002.

[16]

M. Rouw. Meaningful image-spaces and project photoindex, masters thesis. In Utrecht schools of the arts, Hilversum, the Netherlands, 2005.

[17]

J. Ruiz-del Solar and P. Navarrete. Faceret: An interactive face retrieval system based on self organizing maps. In Proceedings of the International Conference on Image and Video Retrieval, CIVR '02, pages 157--164, London, UK, UK, 2002.

Digital Library

[18]

S. Westman and P. Oittinen. Image retrieval by end-users and intermediaries in a journalistic work context. In Proceedings of the 1st international conference on Information interaction in context, IIiX, pages 102--110, New York, NY, USA, 2006. ACM.

Digital Library

[19]

Z. Zha, L. Yang, T. Mei, M. Wang, and Z. Wang. Visual query suggestion. In Seventeenth ACM international Conference on Multimedia, pages 15--24, Beijing, China, October 2009.

Digital Library

[20]

J. Zhang and A. Lee. etree: A browse and query interface for online communities. http://www.scientificcommons.org/43518033, 2008.

[21]

T. Zhang, J. Xiao, D. Wen, and X. Ding. Face based image navigation and search. In Seventeenth ACM international Conference on Multimedia, pages 597--600, Beijing, China, October 2009.

Digital Library

[22]

Y. Zheng, L. Liu, L. Wang, and X. Xie. Learning transportation modes from raw gps data for geographic application on the web. In Proceedings of International conference on World Wild Web (WWW 2008), pages 247--256, Beijing, China, 2008.

Digital Library

Cited By

Huang YMa CWang HItoh TBottoni PTakahashi S(2015)Exploring the Benefits of Text and Sketch in Video Retrieval of Complex QueriesProceedings of the 8th International Symposium on Visual Information Communication and Interaction10.1145/2801040.2801063(115-120)Online publication date: 24-Aug-2015
https://dl.acm.org/doi/10.1145/2801040.2801063
Barroso RPonciano-Silva MTraina ABueno R(2015)Speeding up the combination of multiple descriptors for different boundary conditions2015 Latin American Computing Conference (CLEI)10.1109/CLEI.2015.7359983(1-11)Online publication date: Oct-2015
https://doi.org/10.1109/CLEI.2015.7359983
Al Kabary ISchuldt HGeva STrotman ABruza PClarke CJärvelin K(2014)Enhancing sketch-based sport video retrieval by suggesting relevant motion pathsProceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval10.1145/2600428.2609551(1227-1230)Online publication date: 3-Jul-2014
https://dl.acm.org/doi/10.1145/2600428.2609551

Index Terms

User interaction techniques for multimedia retrieval
1. Human-centered computing
  1. Human computer interaction (HCI)
2. Information systems
  1. Information retrieval

Recommendations

Multimedia Interfaces: Don't Move My Cheese!

The author notes ways to be more consistent and practical when designing an interface.He also provides a concrete example of a less-than-perfect user interface on a phone/fax/answering machine.

Read More
Multimodal Multimedia Retrieval with vitrivr
ICMR '19: Proceedings of the 2019 on International Conference on Multimedia Retrieval

The steady growth of multimedia collections - both in terms of size and heterogeneity - necessitates systems that are able to conjointly deal with several types of media as well as large volumes of data. This is especially true when it comes to ...
Read More
Where Is the User in Multimedia Retrieval?

What started as a field with an emphasis on optimally serving users' interactive information needs has now become dominated by methods that focus on improving the mean average precision (MAP) of a clearly defined task disconnected from its application. ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

HCCE '12: Proceedings of the 2012 Joint International Conference on Human-Centered Computer Environments

March 2012

277 pages

ISBN:9781450311915

DOI:10.1145/2160749

General Chairs:
Alexander Vazhenin
University of Aizu, Japan
,
Jens Herder
University of Applied Sciences, Duesseldorf, Germany
,
Kenjiro Miura
Shizuoka University, Japan

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Shizuoka University in Hamamatsu: Shizuoka University in Hamamatsu
University of Aizu: University of Aizu

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 March 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

HCCE '12

Sponsor:

Shizuoka University in Hamamatsu
University of Aizu

HCCE '12: The Joint International Conference on Human-Centered Computer Environments

March 8 - 13, 2012

Aizu-Wakamatsu, Japan

Acceptance Rates

HCCE '12 Paper Acceptance Rate 48 of 81 submissions, 59%;

Overall Acceptance Rate 48 of 81 submissions, 59%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
331
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Other Metrics

View Author Metrics

Citations

Cited By

Huang YMa CWang HItoh TBottoni PTakahashi S(2015)Exploring the Benefits of Text and Sketch in Video Retrieval of Complex QueriesProceedings of the 8th International Symposium on Visual Information Communication and Interaction10.1145/2801040.2801063(115-120)Online publication date: 24-Aug-2015
https://dl.acm.org/doi/10.1145/2801040.2801063
Barroso RPonciano-Silva MTraina ABueno R(2015)Speeding up the combination of multiple descriptors for different boundary conditions2015 Latin American Computing Conference (CLEI)10.1109/CLEI.2015.7359983(1-11)Online publication date: Oct-2015
https://doi.org/10.1109/CLEI.2015.7359983
Al Kabary ISchuldt HGeva STrotman ABruza PClarke CJärvelin K(2014)Enhancing sketch-based sport video retrieval by suggesting relevant motion pathsProceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval10.1145/2600428.2609551(1227-1230)Online publication date: 3-Jul-2014
https://dl.acm.org/doi/10.1145/2600428.2609551

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents