research-article

I-SEARCH: a multimodal search engine based on rich unified content description (RUCoD)

Authors:

Anne Verroust-Blondet,

Apostolos Axenopoulos,

Dimitrios TzovarasAuthors Info & Claims

WWW '12 Companion: Proceedings of the 21st International Conference on World Wide Web

Pages 291 - 294

https://doi.org/10.1145/2187980.2188031

Published: 16 April 2012 Publication History

Get Access

Abstract

In this paper, we report on work around the I-SEARCH EU (FP7 ICT STREP) project whose objective is the development of a multimodal search engine. We present the project's objectives, and detail the achieved results, amongst which a Rich Unified Content Description format.

References

[1]

Apple iPhone 4S -- Ask Siri to help you get things done. Avail. at http://www.apple.com/iphone/features/siri.html.

Google Scholar

[2]

Google Voice Actions for Android, 2011. Avail. at http://www.google.com/mobile/voice-actions/.

Google Scholar

[3]

Google Voice Search -- Inside Google Search, 2011. Avail. at http://www.google.com/insidesearch/voicesearch.html.

Google Scholar

[4]

A. Bozzon, M. Brambilla, Fraternali, et al. PHAROS: an audiovisual search platform. In Proceedings of the 32nd Int. ACM SIGIR Conf. on Research and Development in Information Retrieval, SIGIR '09, pages 841--841, New York, NY, USA, 2009. ACM.

Digital Library

Google Scholar

[5]

P. Daras, A. Axenopoulos, V. Darlagiannis, et al. Introducing a Unified Framework for Content Object Description. Int. Journal of Multimedia Intelligence and Security (IJMIS). Accepted for publication. Avail. at http://www.lsi.upc.edu/ tsteiner/papers/2010/rucod-specification-ijmis2010.pdf, 2010.

Google Scholar

[6]

A. Emtage, B. Heelan, and J. P. Deutsch. Archie, 1990. Avail. at http://archie.icm.edu.pl/archie-adv_eng.html.

Google Scholar

[7]

J. Etzold, A. Brousseau, P. Grimm, and T. Steiner. Context-aware Querying for Multimodal Search Engines. In 18th Int. Conf. on MultiMedia Modeling (MMM 2012), Klagenfurt, Austria, January 4--6, 2012. http://www.lsi.upc.edu/tsteiner/papers/2012/context-aware-querying-mmm2012.pdf.

Digital Library

Google Scholar

[8]

G. R. Frederick. Just Say "Britney Spears": Multi-Modal Search and On-Device Portals, Mar. 2009. Avail. at http://java.sun.com/developer/technicalArticles/javame/odp/multimodal-odp/.

Google Scholar

[9]

A. Gruenstein, I. McGraw, and I. Badr. The WAMI Toolkit for Developing, Deploying, and Evaluating Web-accessible Multimodal Interfaces. In ICMI, pages 141--148, 2008.

Digital Library

Google Scholar

[10]

L. Hoste, B. Dumas, and B. Signer. Mudra: A Unified Multimodal Interaction Framework. 2011. Avail. at http://wise.vub.ac.be/sites/default/files/publications/ICMI2011.pdf.

Digital Library

Google Scholar

[11]

D. R. James A. Larson, T.V. Raman. W3C Multimodal Interaction Framework. Technical report, May 2003. Avail. at http://www.w3.org/TR/mmi-framework/.

Google Scholar

[12]

P. Letessier, O. Buisson, and A. Joly. Consistent visual words mining with adaptive sampling. In ICMR, Trento, Italy, 2011.

Digital Library

Google Scholar

[13]

G. Little. Smiley Slider. Avail. at http://glittle.org/smiley-slider/.

Google Scholar

Cited By

View all

Rashid UBhatti M(2017)A framework to explore results in multiple media information aggregated searchMultimedia Tools and Applications10.1007/s11042-017-4769-876:24(25787-25826)Online publication date: 1-Dec-2017
https://dl.acm.org/doi/10.1007/s11042-017-4769-8
Ceri SBozzon ABrambilla MDella Valle EFraternali PQuarteroni SCeri SBozzon ABrambilla MDella Valle EFraternali PQuarteroni S(2013)Multimedia SearchWeb Information Retrieval10.1007/978-3-642-39314-3_13(207-221)Online publication date: 2013
https://doi.org/10.1007/978-3-642-39314-3_13
Axenopoulos ADaras PMalassiotis SCroce VLazzaro MEtzold JGrimm PMassari ACamurri ASteiner TTzovaras D(2012)I-SEARCHThe Future Internet10.5555/2340856.2340871(130-141)Online publication date: 1-Jan-2012
https://dl.acm.org/doi/10.5555/2340856.2340871
Show More Cited By

Index Terms

I-SEARCH: a multimodal search engine based on rich unified content description (RUCoD)
1. Information systems
  1. Information retrieval

Recommendations

One size does not fit all: multimodal search on mobile and desktop devices with the I-SEARCH search engine
ICMR '12: Proceedings of the 2nd ACM International Conference on Multimedia Retrieval

In this paper, we report on work around the I-SEARCH EU (FP7 ICT STREP) project whose objective is the development of a multimodal search engine targeted at mobile and desktop devices. Each of these device classes has its specific hardware capabilities ...
Multimodal spatial reference in mediated environments: users' preferences and the pragmatics of pointing and talking
CHI EA '06: CHI '06 Extended Abstracts on Human Factors in Computing Systems

This paper describes the current results and future developments of a project on multimodal spatial reference in mediated environments. The database consists of video-recorded sessions, with 120 participants in three experimental designs, contrasting ...
Speech and face-to-face communication - An introduction

This issue focuses on face-to-face speech communication. Research works have demonstrated that this communicative situation is essential to language acquisition and development (e.g. naming). Face-to-face communication is in fact much more than speaking ...

Comments

Information & Contributors

Information

Published In

WWW '12 Companion: Proceedings of the 21st International Conference on World Wide Web

April 2012

1250 pages

ISBN:9781450312301

DOI:10.1145/2187980

General Chairs:
Alain Mille
Université de Lyon, France
,
Fabien Gandon
INRIA, France
,
Jacques Misselis
HP, France
,
Program Chairs:
Michael Rabinovich
Case Western Reserve University, USA
,
Steffen Staab
University of Koblenz-Landau, Germany

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

SIGWEB: ACM Special Interest Group on Hypertext, Hypermedia, and Web

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 April 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

WWW 2012

Sponsor:

Univ. de Lyon

WWW 2012: 21st World Wide Web Conference 2012

April 16 - 20, 2012

Lyon, France

Acceptance Rates

Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
184
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)1

Reflects downloads up to 23 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Rashid UBhatti M(2017)A framework to explore results in multiple media information aggregated searchMultimedia Tools and Applications10.1007/s11042-017-4769-876:24(25787-25826)Online publication date: 1-Dec-2017
https://dl.acm.org/doi/10.1007/s11042-017-4769-8
Ceri SBozzon ABrambilla MDella Valle EFraternali PQuarteroni SCeri SBozzon ABrambilla MDella Valle EFraternali PQuarteroni S(2013)Multimedia SearchWeb Information Retrieval10.1007/978-3-642-39314-3_13(207-221)Online publication date: 2013
https://doi.org/10.1007/978-3-642-39314-3_13
Axenopoulos ADaras PMalassiotis SCroce VLazzaro MEtzold JGrimm PMassari ACamurri ASteiner TTzovaras D(2012)I-SEARCHThe Future Internet10.5555/2340856.2340871(130-141)Online publication date: 1-Jan-2012
https://dl.acm.org/doi/10.5555/2340856.2340871
Steiner TLazzaro MNucci FCroce VSutton LMassari ACamurri ASpiller SVerroust-Blondet AJoyeux LIp HRui Y(2012)One size does not fit allProceedings of the 2nd ACM International Conference on Multimedia Retrieval10.1145/2324796.2324863(1-2)Online publication date: 5-Jun-2012
https://dl.acm.org/doi/10.1145/2324796.2324863
Axenopoulos ADaras PMalassiotis SCroce VLazzaro MEtzold JGrimm PMassari ACamurri ASteiner TTzovaras D(2012)I-SEARCH: A Unified Framework for Multimodal Search and RetrievalThe Future Internet10.1007/978-3-642-30241-1_12(130-141)Online publication date: 2012
https://doi.org/10.1007/978-3-642-30241-1_12

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

One size does not fit all: multimodal search on mobile and desktop devices with the I-SEARCH search engine

Multimodal spatial reference in mediated environments: users' preferences and the pragmatics of pointing and talking

Speech and face-to-face communication - An introduction

Comments

Information

Published In

Sponsors

In-Cooperation

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations