Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/2393347.2396345acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
poster

Sketch-based image retrieval on mobile devices using compact hash bits

Published: 29 October 2012 Publication History

Abstract

The advent of touch panels in mobile devices has provided a good platform for mobile sketch search. However, most of the previous sketch image retrieval systems usually adopt an inverted index structure on large-scale image database, which is formidable to be operated in the limited memory of mobile devices. In this paper, we propose a novel approach to address these challenges. First, we effectively utilize distance transform (DT) features to bridge the gap between query sketches and natural images. Then these high-dimensional DT features are further projected to more compact binary hash bits. The experimental results show that our method achieves very competitive retrieval performance with MindFinder approach [3] but only requires much less memory storage (e.g., our method only requires 3% of total memory storage of MindFinder in 2.1 million images). Due to its low consumption of memory, the whole system can independently operate on the mobile devices.

References

[1]
M. Eitz, K. Hildebrand, T. Boubekeur and M. Alexa, An evaluation of descriptors for large-scale image retrieval from sketched feature lines, in Computers & Graphics, 2010
[2]
Y. Cao, C. Wang, L. Zhang, and L. Zhang, Edgel Inverted Index for Large-Scale Sketch-based Image Search, in CVPR 2011.
[3]
P. Dollar, Z. Tu, and S. Belongie, Supervised Learning of Edges and Object Boundaries, in CVPR 2006.
[4]
P. Li, T. J. Hastie and K. W. Church, Very sparse random projections, in KDD 2006.
[5]
J. Harel, C. Koch, and P. Perona, Graph-Based Visual Saliency, in NIPS 2006.
[6]
R. Hecht-Nielsen. Context vectors: general purpose approximate meaning representations self-organized from raw data, in Computational Intelligence: Imitating Life, 1994
[7]
Y. J. Lee, C. L. Zitnick, and M. Cohen, ShadowDraw: Real-Time User Guidance for Freehand Drawing, in SIGGRAPH 2011.
[8]
M. Y. Liu, O. Tuzel, A. Veeraraghavan, and R. Chellappa, Fast Directional Chamfer Matching, in CVPR 2010.

Cited By

View all
  • (2023)AdaCLIP: Towards Pragmatic Multimodal Video RetrievalProceedings of the 31st ACM International Conference on Multimedia10.1145/3581783.3612161(5623-5633)Online publication date: 26-Oct-2023
  • (2019)A survey on freehand sketch recognition and retrievalImage and Vision Computing10.1016/j.imavis.2019.06.01089:C(67-87)Online publication date: 1-Sep-2019
  • (2019)Sketch recognition using transfer learningMultimedia Tools and Applications10.1007/s11042-018-7067-178:12(17095-17112)Online publication date: 1-Jun-2019
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MM '12: Proceedings of the 20th ACM international conference on Multimedia
October 2012
1584 pages
ISBN:9781450310895
DOI:10.1145/2393347
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 October 2012

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. hash
  2. sketch

Qualifiers

  • Poster

Conference

MM '12
Sponsor:
MM '12: ACM Multimedia Conference
October 29 - November 2, 2012
Nara, Japan

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)2
  • Downloads (Last 6 weeks)0
Reflects downloads up to 31 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2023)AdaCLIP: Towards Pragmatic Multimodal Video RetrievalProceedings of the 31st ACM International Conference on Multimedia10.1145/3581783.3612161(5623-5633)Online publication date: 26-Oct-2023
  • (2019)A survey on freehand sketch recognition and retrievalImage and Vision Computing10.1016/j.imavis.2019.06.01089:C(67-87)Online publication date: 1-Sep-2019
  • (2019)Sketch recognition using transfer learningMultimedia Tools and Applications10.1007/s11042-018-7067-178:12(17095-17112)Online publication date: 1-Jun-2019
  • (2019)Retrieval by Classification: Discriminative Binary Embedding for Sketch-Based Image RetrievalPattern Recognition and Computer Vision10.1007/978-3-030-31726-3_2(15-26)Online publication date: 31-Oct-2019
  • (2018)MMH: Multi-Modal Hash for Instant Mobile Video Search2018 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR)10.1109/MIPR.2018.00018(57-62)Online publication date: Apr-2018
  • (2018)MATRACKMultimedia Tools and Applications10.1007/s11042-017-4368-877:2(1997-2012)Online publication date: 1-Jan-2018
  • (2017)Deep Sketch Hashing: Fast Free-Hand Sketch-Based Image Retrieval2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR)10.1109/CVPR.2017.247(2298-2307)Online publication date: Jul-2017
  • (2017)A Hash Based Method for Large Scale Nonparallel Support Vector Machines PredictionProcedia Computer Science10.1016/j.procs.2017.05.133108(1281-1291)Online publication date: 2017
  • (2017)Combining pixel domain and compressed domain index for sketch based image retrievalMultimedia Tools and Applications10.1007/s11042-017-4758-y76:21(22019-22042)Online publication date: 1-Nov-2017
  • (2017)Sketch-based manga retrieval using manga109 datasetMultimedia Tools and Applications10.1007/s11042-016-4020-z76:20(21811-21838)Online publication date: 1-Oct-2017
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media