Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3282286.3282299acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicgspConference Proceedingsconference-collections
research-article

Deep Neural Networks Optimization Based On Deconvolutional Networks

Published: 06 October 2018 Publication History

Abstract

Feature extraction is the most important part of the whole object recognition and target detection system. Convolutional Networks have evolved to the state-of-the-art technique for computer vision tasks owing to the predominant feature extraction capability. However, the working process of Convolutional Networks is invisible, which makes it difficult to optimize the model. To evaluate a Convolutional Network, we introduce a novel way to project the activities back to the input pixel space, revealing what input pattern originally caused a specific activation in the feature maps. Using this visualization technique, we take the feature extraction of sunflower seed image containing an impurity as an example, and attempt to change the architecture of traditional Convolutional Networks in order to extract better specific features for target images. After a series of improvements, we got a new Convolutional Network which is more conducive to the target images feature extraction and the number of parameters is less than before, which is conducive to the transplantation of the small system. Our model can be docking the state-of-the-art recognition networks according to different application scenarios, so as to structure a complete automatic recognition system.

References

[1]
Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: CVPR (2005).
[2]
Lowe, D.: Distinctive image features from scale-invariant keypoints. In: IJCV (2004).
[3]
Girshick, R., Donahue, J., Darrell, T., Malik, J.: Rich feature hierarchies for accurate object detection and semantic segmentation. In: CVPR (2014).
[4]
LeCun, Y., Boser, B., Denker, J.S., Henderson, D., Howard, R.E., Hubbard, W., Jackel, L.D.: Handwritten digit recognition with a back-propagation network. In: NIPS (1990).
[5]
Krizhevsky, A., Sutskever, I., Hinton, G.: ImageNet classification with deep convolutional neural networks. In: NIPS (2012).
[6]
He, K., Gkioxari, G., Dollár, P., & Girshick, R.: Mask R-CNN. In: ICCV (2017).
[7]
Redmon, J., Divvala, S., Girshick, R., Farhadi, A.: You only look once: Unified, real-time object detection. In: CVPR (2016).
[8]
Song, H., Huizi, M., William, J.D.: Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding. In: ICLR (2016).
[9]
Zeiler, M., & Fergus, R. Visualizing and understanding convolutional networks. In D. J. Fleet, T. Pajdla, B. Schiele, and T. Tuytelaars, editors, ECCV, volume 8689 of Lecture Notes in Computer Science, pages 818--833. Springer, (2014).
[10]
Hinton, G.E., Osindero, S., Teh, Y.: A fast learning algorithm for deep belief nets. Neural Computation 18, 1527--1554 (2006).
[11]
LeCun, Y., Bengio, Y., Hinton, G.E.: Deep learning. Nature volume 521, pages 436--444. In: Nature (2015).
[12]
Zeiler, M., Krishnan, D., Taylor, G., Fergus, R.: Deconvolutional networks. In: CVPR (2010).
[13]
Zeiler, M., Taylor, G., Fergus, R.: Adaptive deconvolutional networks for mid and high level feature learning. In: ICCV (2011).
[14]
TensorFlow Homepage, https://www.tensorflow.org/, last accessed 2018/3/23.
[15]
Chinese community of TensorFlow, http://www.tensorfly.cn/, last accessed 2018/4/15.
[16]
Sermanet, P., Eigen, D., Zhang, X., Mathieu, M., Fergus, R., LeCun, Y.: OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks. In: ICLR (2014).
[17]
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. In: ICLR (2015).

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
ICGSP '18: Proceedings of the 2nd International Conference on Graphics and Signal Processing
October 2018
119 pages
ISBN:9781450363860
DOI:10.1145/3282286
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

  • Griffith University
  • City University of Hong Kong: City University of Hong Kong

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 October 2018

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Convolutional Networks
  2. Model Optimization
  3. Visualization

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

ICGSP'18

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 67
    Total Downloads
  • Downloads (Last 12 months)1
  • Downloads (Last 6 weeks)0
Reflects downloads up to 04 Oct 2024

Other Metrics

Citations

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media