Zero-shot Hand-held Objects Recognition Based on Global Feature Relationships: Zero-shot Hand-held Objects Recognition Based on Global Feature Relationships
Article No.: 1, Pages 1 - 5
Abstract
In recent years, there have been frequent terrorist attacks both at home and abroad. Accurate detection of a wide variety of handheld objects is a problem that needs an urgent solution. To better exploit the effects of handheld movements on handheld object recognition, this paper proposes a zero-shot hand-held object recognition based on global feature relations that comprise two modules: an image processing module and a semantic relations module. The image processing module learns the visual classifier of the input image to obtain the classification weights. The semantic relations module propagates structural knowledge through semantic learning through graph convolution operations on the knowledge graph and obtains the classification weights for all categories. Results indicate that this method significantly improves the recognition rate compared to traditional handheld object recognition methods.
References
[1]
Ren S, He K, Girshick R, Faster r-cnn: Towards real-time object detection with region proposal networks[J]. Advances in neural information processing systems, 2015, 28.
[2]
J. Redmon, S. Divvala, R. Girshick, You only look once: Unified, realtime object detection[C]. Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, 779788.
[3]
Liu W, Anguelov D, Erhan D, Ssd: Single shot multibox detector[C]//European conference on computer vision. Springer, Cham, 2016: 21-37.
[4]
M. Norouzi, T. Mikolov, S. Bengio, Zeroshot learning by convex combination of semantic embeddings[J]. arXiv preprint arXiv:1312.5650, 2013.
[5]
S. Changpinyo, W.L. Chao, F. Sha. Predicting visual exemplars of unseen classes for zeroshot learning[C]. Proceedings of the IEEE international conference on computer vision, 2017, 3476-3485.
[6]
S. Changpinyo, W.L. Chao, B. Gong, Synthesized classifiers for zeroshot learning[C]. Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, 5327-5336.
[7]
M. Kampffmeyer, Y. Chen, X. Liang, Rethinking knowledge graph propagation for zeroshot learning[C]. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2019, 1148711496.
[8]
J. Deng, W. Dong, R. Socher, Imagenet: A largescale hierarchical image database[C]. 2009 IEEE conference on computer vision and pattern recognition, 2009, 248255.
[9]
X. Wang, Y. Ye, A. Gupta. Zeroshot recognition via semantic embeddings and knowledge graphs[C]. Proceedings of the IEEE conference on computer vision and pattern recognition, 2018, 68576866 .
[10]
J. Pennington, R. Socher, C. D. Manning. Glove: Global vectors for word representation[C]. Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), 2014, 15321543 .
[11]
B. Perozzi, R. AlRfou, S. Skiena. Deepwalk: Online learning of social representations[C]. Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining, 2014, 701710 .
[12]
T. Mikolov, K. Chen, G. Corrado, Efficient estimation of word representations in vector space[J]. arXiv preprint arXiv:1301.3781, 2013.
[13]
F. Agostinelli, M. Hoffman, P. Sadowski, Learning activation functions to improve deep neural networks[J]. arXiv preprint arXiv:1412.6830, 2014.
[14]
A. Frome, G. Corrado, J. Shlens, Devise: A deep visualsemantic embedding model[J].,2013.
[15]
S. Gupta, J. Malik. Visual semantic role labeling[J]. arXiv preprint arXiv:1505.04474, 2015.
[16]
Y.W. Chao, Y. Liu, X. Liu, Learning to detect humanobject interactions[C]. 2018 IEEE winter conference on applications of computer vision (wacv), 2018, 381389.
Recommendations
Zero-Shot Object Recognition Using Semantic Label Vectors
CRV '15: Proceedings of the 2015 12th Conference on Computer and Robot VisionWe consider the problem of zero-shot recognition of object categories from images. Given a set of object categories (called "known classes") with training images, our goal is to learn a system to recognize another non-overlapping set of object ...
One-shot learning for RGB-D hand-held object recognition
ICIMCS '18: Proceedings of the 10th International Conference on Internet Multimedia Computing and ServiceWith the advance of computer technology and smart device, many applications, such as face recognition and object recognition, have been developed to facilitate human-computer interaction (HCI) efficiently. In this respect, the hand-held object ...
Transductive Zero-Shot Action Recognition by Word-Vector Embedding
The number of categories for action recognition is growing rapidly and it has become increasingly hard to label sufficient training data for learning conventional models for all categories. Instead of collecting ever more data and labelling them ...
Comments
Information & Contributors
Information
Published In
September 2022
367 pages
ISBN:9781450396714
DOI:10.1145/3570236
Copyright © 2022 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 27 January 2023
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
ICIIP '22
ICIIP '22: 2022 7th International Conference on Intelligent Information Processing
September 29 - 30, 2022
Bucharest, Romania
Acceptance Rates
Overall Acceptance Rate 87 of 367 submissions, 24%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 61Total Downloads
- Downloads (Last 12 months)14
- Downloads (Last 6 weeks)2
Reflects downloads up to 09 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format