Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3474085.3475498acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
research-article

Weighted Gaussian Loss based Hamming Hashing

Published: 17 October 2021 Publication History

Abstract

Recently, deep Hamming hashing methods have been proposed for Hamming space retrieval which enables constant-time search by hash table lookups instead of linear scan. When carrying out Hamming space retrieval, for each query datapoint, there is a Hamming ball centered on the query datapoint, and only the datapoints within the Hamming ball are returned as the relevant ones, while those beyond are discarded directly. Thus, to further enhance the retrieval performance, it is a key point for the Hamming hashing methods to decrease the dissimilar datapoints within the Hamming ball. However, nearly all existing Hamming hashing methods cannot effectively penalize the dissimilar pairs within the Hamming ball to push them out. To tackle this problem, in this paper, we propose a novel Weighted Gaussian Loss based Hamming Hashing, called WGLHH, which introduces a weighted Gaussian loss to optimize hashing model. Specifically, the weighted Gaussian loss consists of three parts: a novel Gaussian-distribution based loss, a novel badly-trained-pair attention mechanism and a quantization loss. The Gaussian-distribution based loss is proposed to effectively penalize the dissimilar pairs within the Hamming ball. The badly-trained-pair attention mechanism is proposed to assign a weight for each data pair, which puts more weight on data pairs whose corresponding hash codes cannot preserve original similarity well, and less on those having already handled well. The quantization loss is used to reduce the quantization error. By incorporating the three parts, the proposed weighted Gaussian loss will penalize significantly on the dissimilar pairs within the Hamming ball to generate more compact hashing codes. Extensive experiments on two benchmark datasets show that the proposed method outperforms the state-of-the-art baselines in image retrieval task.

References

[1]
Yue Cao, Mingsheng Long, Bin Liu, and Jianmin Wang. 2018. Deep cauchy hashing for hamming space retrieval. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1229--1237.
[2]
Zhangjie Cao, Mingsheng Long, Jianmin Wang, and Philip S Yu. 2017. Hashnet: Deep learning to hash by continuation. In Proceedings of the IEEE international conference on computer vision. 5608--5617.
[3]
Sepehr Eghbali and Ladan Tahvildari. 2019. Deep Spherical Quantization for Image Search. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 11690--11699.
[4]
Venice Erin Liong, Jiwen Lu, Yap-Peng Tan, and Jie Zhou. 2017. Cross-modal deep variational hashing. In Proceedings of the IEEE International Conference on Computer Vision. 4077--4085.
[5]
Yunchao Gong, Svetlana Lazebnik, Albert Gordo, and Florent Perronnin. 2012. Iterative quantization: A procrustean approach to learning binary codes for large-scale image retrieval. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 35, 12 (2012), 2916--2929.
[6]
Long-Kai Huang, J. Chen, and Sinno Jialin Pan. 2019. Accelerate Learning of Deep Hashing With Gradient Attention. 2019 IEEE/CVF International Conference on Computer Vision (ICCV) (2019), 5270--5279.
[7]
Shanshan Huang, Yichao Xiong, Ya Zhang, and Jia Wang. 2017. Unsupervised Triplet Hashing for Fast Image Retrieval. In Proceedings of the on Thematic Workshops of ACM Multimedia 2017. ACM, 84--92.
[8]
Herve Jegou, Matthijs Douze, and Cordelia Schmid. 2010. Product quantization for nearest neighbor search. IEEE transactions on pattern analysis and machine intelligence, Vol. 33, 1 (2010), 117--128.
[9]
Rong Kang, Yue Cao, Mingsheng Long, Jianmin Wang, and Philip S Yu. 2019. Maximum-Margin Hamming Hashing. In Proceedings of the IEEE International Conference on Computer Vision. 8252--8261.
[10]
Ning Li, Chao Li, Cheng Deng, Xianglong Liu, and Xinbo Gao. 2018. Deep joint semantic-embedding hashing. In IJCAI. 2397--2403.
[11]
Wu-Jun Li, Sheng Wang, and Wang-Cheng Kang. 2016. Feature learning based deep supervised hashing with pairwise labels. In Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence. AAAI Press, 1711--1717.
[12]
Kevin Lin, Jiwen Lu, Chu-Song Chen, and Jie Zhou. 2016. Learning compact binary descriptors with unsupervised deep neural networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 1183--1192.
[13]
Tsung-Yi Lin, Michael Maire, Serge Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Dollár, and C Lawrence Zitnick. 2014. Microsoft coco: Common objects in context. In European conference on computer vision. Springer, 740--755.
[14]
Zijia Lin, Guiguang Ding, Mingqing Hu, and Jianmin Wang. 2015. Semantics-preserving hashing for cross-view retrieval. In Proceedings of the IEEE conference on computer vision and pattern recognition. 3864--3872.
[15]
Wei Liu, Jun Wang, Sanjiv Kumar, and Shih-Fu Chang. 2011. Hashing with Graphs. In ICML .
[16]
Xiaoqiang Lu, Yaxiong Chen, and X. Li. 2020. Discrete Deep Hashing With Ranking Optimization for Image Retrieval. IEEE Transactions on Neural Networks and Learning Systems, Vol. 31 (2020), 2052--2063.
[17]
Xin Luo, P. Zhang, Zi Huang, L. Nie, and Xin-Shun Xu. 2019. Discrete Hashing With Multiple Supervision. IEEE Transactions on Image Processing, Vol. 28 (2019), 2962--2975.
[18]
Mohammad Norouzi, Ali Punjani, and David J Fleet. 2012. Fast search in hamming space with multi-index hashing. In 2012 IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 3108--3115.
[19]
Olga Russakovsky, Jia Deng, Hao Su, Jonathan Krause, Sanjeev Satheesh, Sean Ma, Zhiheng Huang, Andrej Karpathy, Aditya Khosla, Michael Bernstein, et al. 2015. Imagenet large scale visual recognition challenge. International journal of computer vision, Vol. 115, 3 (2015), 211--252.
[20]
Fumin Shen, Chunhua Shen, Wei Liu, and Heng Tao Shen. 2015. Supervised discrete hashing. In Proceedings of the IEEE conference on computer vision and pattern recognition. 37--45.
[21]
Yuming Shen, Jie Qin, Jiaxin Chen, Mengyang Yu, Li Liu, Fan Zhu, Fumin Shen, and Ling Shao. 2020. Auto-Encoding Twin-Bottleneck Hashing. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2818--2827.
[22]
Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014).
[23]
Jingkuan Song, T. He, L. Gao, Xing Xu, and H. Shen. 2017. Deep Region Hashing for Efficient Large-scale Instance Search from Images. ArXiv, Vol. abs/1701.07901 (2017).
[24]
Rong-Cheng Tu, Xian-Ling Mao, Bo-Si Feng, Bing-Bing Bian, and Yu-shu Ying. 2018. Object Detection based Deep Unsupervised Hashing. arXiv preprint arXiv:1811.09822 (2018).
[25]
Rong-Cheng Tu, Xian-Ling Mao, Jia-Nan Guo, Wei Wei, and Heyan Huang. 2021. Partial-Softmax Loss based Deep Hashing. Proceedings of The Web Conference 2021 (2021).
[26]
Rong-Cheng Tu, Xian-Ling Mao, and Wei Wei. 2020. MLS3RDUH: Deep Unsupervised Hashing via Manifold based Local Semantic Similarity Structure Reconstructing. In Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence .
[27]
Dan Wang, Heyan Huang, Chi Lu, Bo-Si Feng, Liqiang Nie, Guihua Wen, and Xian-Ling Mao. 2017. Supervised deep hashing for hierarchical labeled data. arXiv preprint arXiv:1704.02088 (2017).
[28]
Yair Weiss, Antonio Torralba, and Rob Fergus. 2009. Spectral hashing. In Advances in neural information processing systems. 1753--1760.
[29]
Cheng Yan, Guansong Pang, Xiao Bai, Chunhua Shen, Jun Zhou, and Edwin Hancock. 2019. Deep Hashing by Discriminating Hard Examples. In Proceedings of the 27th ACM International Conference on Multimedia. 1535--1542.
[30]
Erkun Yang, Cheng Deng, Tongliang Liu, Wei Liu, and Dacheng Tao. 2018. Semantic structure-based unsupervised deep hashing. In Proceedings of the 27th International Joint Conference on Artificial Intelligence. 1064--1070.
[31]
Erkun Yang, Tongliang Liu, Cheng Deng, Wei Liu, and Dacheng Tao. 2019 a. DistillHash: Unsupervised Deep Hashing by Distilling Data Pairs. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2946--2955.
[32]
Huei-Fang Yang, Cheng-Hao Tu, and Chu-Song Chen. 2019 b. Adaptive Labeling for Deep Learning to Hash. 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) (2019), 621--628.
[33]
Ting Yao, Fuchen Long, Tao Mei, and Yong Rui. 2016. Deep Semantic-Preserving and Ranking-Based Hashing for Image Retrieval. In IJCAI. 3931--3937.
[34]
Li Yuan, Tao Wang, Xiaopeng Zhang, Francis EH Tay, Zequn Jie, Wei Liu, and Jiashi Feng. 2020. Central Similarity Quantization for Efficient Image and Video Retrieval. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 3083--3092.
[35]
Kun Zhan, J. Guan, Yi Yang, and Qun Wu. 2016. Unsupervised discriminative hashing. J. Vis. Commun. Image Represent., Vol. 40 (2016), 847--851.
[36]
Peichao Zhang, Wei Zhang, Wu-Jun Li, and Minyi Guo. 2014. Supervised hashing with latent factor models. In Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval. ACM, 173--182.
[37]
Z. Zhang, Guo-Sen Xie, Y. Li, Sheng Li, and Zi Huang. 2019. SADIH: Semantic-Aware DIscrete Hashing. ArXiv, Vol. abs/1904.01739 (2019).
[38]
Han Zhu, Mingsheng Long, Jianmin Wang, and Yue Cao. 2016. Deep hashing network for efficient similarity retrieval. In Thirtieth AAAI Conference on Artificial Intelligence.

Cited By

View all
  • (2024)Progressive Similarity Preservation Learning for Deep Scalable Product QuantizationIEEE Transactions on Multimedia10.1109/TMM.2023.330655626(3034-3045)Online publication date: 2024
  • (2024)Look Into Gradients: Learning Compact Hash Codes for Out-of-Distribution RetrievalIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2024.342526836:12(8730-8743)Online publication date: Dec-2024
  • (2024)Similarity Transitivity Broken-Aware Multi-Modal HashingIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2024.339649236:11(7003-7014)Online publication date: Nov-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MM '21: Proceedings of the 29th ACM International Conference on Multimedia
October 2021
5796 pages
ISBN:9781450386517
DOI:10.1145/3474085
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 October 2021

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. hamming hashing
  2. image retrieval
  3. weighted gaussian loss

Qualifiers

  • Research-article

Funding Sources

Conference

MM '21
Sponsor:
MM '21: ACM Multimedia Conference
October 20 - 24, 2021
Virtual Event, China

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)39
  • Downloads (Last 6 weeks)6
Reflects downloads up to 23 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Progressive Similarity Preservation Learning for Deep Scalable Product QuantizationIEEE Transactions on Multimedia10.1109/TMM.2023.330655626(3034-3045)Online publication date: 2024
  • (2024)Look Into Gradients: Learning Compact Hash Codes for Out-of-Distribution RetrievalIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2024.342526836:12(8730-8743)Online publication date: Dec-2024
  • (2024)Similarity Transitivity Broken-Aware Multi-Modal HashingIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2024.339649236:11(7003-7014)Online publication date: Nov-2024
  • (2024)ROSE: Relational and Prototypical Structure Learning for Universal Domain Adaptive HashingIEEE Transactions on Information Forensics and Security10.1109/TIFS.2024.344431919(7690-7704)Online publication date: 2024
  • (2024)Unsupervised Deep Hashing With Fine-Grained Similarity-Preserving Contrastive Learning for Image RetrievalIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2023.332044434:5(4095-4108)Online publication date: May-2024
  • (2024)Unsupervised Deep Triplet Hashing for Image RetrievalIEEE Signal Processing Letters10.1109/LSP.2024.340435031(1489-1493)Online publication date: 2024
  • (2023)Towards Efficient Coarse-grained Dialogue Response SelectionACM Transactions on Information Systems10.1145/359760942:2(1-32)Online publication date: 27-Sep-2023
  • (2023)Unsupervised Hashing with Semantic Concept MiningProceedings of the ACM on Management of Data10.1145/35886831:1(1-19)Online publication date: 30-May-2023
  • (2023)Data-Aware Proxy Hashing for Cross-modal RetrievalProceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3539618.3591660(686-696)Online publication date: 19-Jul-2023
  • (2023)DIOR: Learning to Hash With Label Noise Via Dual Partition and Contrastive LearningIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2023.331210936:4(1502-1517)Online publication date: 5-Sep-2023
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media