Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.5555/3199700.3199821acmconferencesArticle/Chapter ViewAbstractPublication PagesiccadConference Proceedingsconference-collections
research-article

Edge segmentation: empowering mobile telemedicine with compressed cellular neural networks

Published: 13 November 2017 Publication History

Abstract

With the need for increased care and welfare of the rapidly aging population, mobile telemedicine is becoming popular for providing remote health care to increase the quality of life. Recently, image analysis is being actively applied for medical diagnosis and treatment, in which image segmentation is of the fundamental importance for other image processing such as visualization and detection. However, given the tasks challenges in transmitting large volume of high-resolution images and the real-time constraints that are commonly present for mobile telemedicine, image segmentation is best done at the "edge", i.e., locally so that only segmentation results are communicated. A powerful approach to medical image segmentation is cellular neural network (CeNN), which can achieve very high accuracy through proper training. However, CeNNs typically involve extensive computations in a recursive manner. As an example, to simply process an image of 1920x1080 pixels requires 4-8 Giga floating point multiplications (for 3x3 templates and 50-100 iterations), which needs to be done in a timely manner for real-time medical image segmentation. Such a demand is too high for most low power mobile computing platforms in IoTs. This paper presents a compressed CeNN framework for computation reduction in CeNNs, which is the first in the literature. It involves various techniques such as early exit and parameter quantization, which significantly reduces computation demands while maintaining an acceptable performance.

References

[1]
S. J. Carey, D. R. Barr, B. Wang, A. Lopich, and P. Dudek. Mixed signal simd processor array vision chip for real-time image processing. Analog Integrated Circuits and Signal Processing, 77(3):385--399, 2013.
[2]
S.-H. Chae, D. Moon, D. G. Lee, and S. B. Pan. Medical image segmentation for mobile electronic patient charts using numerical modeling of iot. Journal of Applied Mathematics, 2014, 2014.
[3]
H.-C. Chen, Y.-C. Hung, C.-K. Chen, T.-L. Liao, and C.-K. Chen. Image-processing algorithms realized by discrete-time cellular neural networks and their circuit implementations. Chaos, Solitans & Fractals, 29(5):1100-1108, 2006.
[4]
L. O. Chua and T. Roska. Cellular neural networks and visual computing: foundations and applications. Cambridge university press, 2002.
[5]
M. Courbariaux, I. Hubara, D. Soudry, R. El-Yaniv, and Y. Bengio. Binarized neural networks: Training deep neural networks with weights and activations constrained to+ 1 or-1. arXiv preprint arXiv.1602.02830, 2016.
[6]
F. Dohler, F. Mormann, B. Weber, C. E. Elger, and K. Lehnertz. A cellular neural network based method for classification of magnetic resonance images: towards an automated detection of hippocampal sclerosis. Journal of neuroscience methods, 170(2):324--331, 2008.
[7]
M. Duraisamy and F. M. M. Jane. Cellular neural network based medical image segmentation using artificial bee colony algorithm. In Green Computing Communication and Electrical Engineering (ICCCCEE), 2014 International Conference on, pages 1--6. IEEE, 2014.
[8]
H. Harrer and I.A. Nossek. Discrete-time cellular neural networks. International Journal of Circuit Theory and Applications, 20(5):453--467, 1992.
[9]
H. Harrer, J. A Nossek, T. Roska, and L. O. Chua. A current-mode dtcnn universal chip. In Circuits and Systems, 1994. ISCAS'94., 1994 IEEE International Symposium on, volume 4, pages 135--138. IEEE, 1994.
[10]
I. Hubara, M. Courbariaux, D. Soudry, R. El-Yaniv, and Y. Bengio. Binarized neural networks. In Advances in Neural Information Processing Systems, pages 4107--4115, 2016.
[11]
K. Karacs, G. Cserey, Zarndy, P. Szolgay, C. Rekeczky, L. Kek, V. Szab, G. Pazienza. and T. Roska. Software library for cellular wave computing engines. Cellular Sensory and Wave Computing Laboratory of the Computer and Automation Research Institute, 2010.
[12]
S. Lee, M. Kim, K. Kim, J.-Y. Kim, and H.-J. Yoo. 24-gops 4.5-mm2 digital cellular neural network for rapid visual attention in an object-recognition soc. IEEE transactions on neural networks, 22(1):64--73, 2011.
[13]
H. Li, X. Liao, C. Li, H. Huang, and C. Li. Edge detection of noisy images based on cellular neural networks. Communications in Nonlinear Science and Numerical Simulation, 16(9):3746--3759, 2011.
[14]
M. Magdalena and U. G. B. Bujnowska-Fedak. Use of telemedicine-based care for the aging and elderly: promises and pitfalls. Smart homecare Technology & telehealth, 3:91--105, 2015.
[15]
D. Manatunga, H. Kim, and S. Mukhopadhyay. Sp-cnn: A scalable and programmable cnn-based accelerator. IEEE Micro, 35(5):42--50, 2015.
[16]
G. Manganaro, P. Arena, and L. Fortuna. Cellular neural networks: chaos, complexity and VLSI processing, volume 1. Springer Science & Business Media, 2012.
[17]
J. J. Martnez, J. Garrigs, J. Toledo, and J. M. Ferrndez. An efficient and expandable hardware implementation of multilayer cellular neural networks. Neurocomputing, 114:54--62, 2013.
[18]
J. Muller, R. Wittig, J. Muller, and R. Tetzlaff. An improved cellular nonlinear network architecture for binary and greyscale image processing. IEEE Transactions on Circuits and Systems II: Express Briefs, 2016.
[19]
R. Porter, J. Frigo, A. Conti, N. Harvey, G. Kenyon, and M. Gokhale. A reconfigurable computing framework for multi-scale cellular image processing. Microprocessors and Microsystems, 31(8):546--563, 2007.
[20]
S. Potluri, A. Fasih, L. K. Vutukuru, F. Al Machot, and K. Kyamakya. Cnn based high performance computing for real time image processing on gpu. In Nonlinear Dynamics and Synchronization (INDS) & 16th Int'l Symposium on Theoretical Electrical Engineering (ISTET), 2011 Joint 3rd Int'l Workshop on, pages 1--7. IEEE, 2011.
[21]
M. Rastegari, V. Ordonez, J. Redmon. and A. Farhadi. Xnor-net: Imagenet classification using binary convolutional neural networks. In European Conference on Computer Vision, pages 525--542. Springer, 2016.
[22]
A Rodrguez-Vzquez, G. Lin-Cernbrano, L. Carranza, E. Roca-Moreno, R. Carmona-Galn, F. Jimnez-Garrido, R. Domnguez-Castro, and S. E. Meana. Ace16k: the third generation of mixed-signal simd-cnn ace chips toward vsocs. IEEE Transactions on Circuits and Systems I: Regular Papers, 51(5):851--863, 2004.
[23]
R. Rouhi, M. Jafari, S. Kasaei, and P. Keshavarzian. Benign and malignant breast tumors classification based on region growing and cnn segmentation. Expert Systems with Applications, 42(3):990--1002, 2015.
[24]
H. Song, P. Jeff, T. John, and W. J. Dally. Deep compression: Compressing deep neural networks with pruning, trained quantization and huffman coding. In 4th International Conference on Learning Representations, 2016.
[25]
J. Suckling, J. Parker, D. Dance, S. Astley, I. Hutt, C. Boggis, I. Ricketts, E. Stamatakis, N. Cemeaz, S. Kok, et al. The mammographic image analysis society digital mammogram database. In Exerpta Medica. International Congress Series, volume 1069, pages 375--378, 1994.
[26]
H. Wong, V. Betz, and J. Rose. Comparing fpga vs. custom cmos and the impact on processor microarchitecture. In Proceedings of the 19th ACM/SIGDA international symposium on Field programmable gate arrays, pages 5--14. ACM, 2011.
[27]
J. Wu, C. Leng, Y. Wang, Q. Hu, and J. Cheng. Quantized convolutional neural networks for mobile devices. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 4820--4828, 2016.
[28]
N. Yildiz, E. Cesur, K. Kayaer, V. Tavsanoglu, and M. Alpay. Architecture of a fully pipelined real-time cellular neural network emulator. IEEE Transactions on Circuits and Systems I: Regular Papers, 62(1):130--138, 2015.
[29]
N. Yildiz, E. Cesur, and V. Tavsanoglu. On the way to a third generation realtime cellular neural network processor. CNNA 2016, 2016.
[30]
A. Zhou, A. Yao, Y. Guo, L. Xu, and Y. Chen. Incremental network quantization: Towards lossless cnns with low-precision weights. In 5th International Conference on Learning Representations, 2017.

Cited By

View all
  • (2021)Quantization of Deep Neural Networks for Accurate Edge ComputingACM Journal on Emerging Technologies in Computing Systems10.1145/345121117:4(1-11)Online publication date: 30-Jun-2021
  • (2020)Low Overhead Online Data Flow Tracking for Intermittently Powered Non-Volatile FPGAsACM Journal on Emerging Technologies in Computing Systems10.1145/337139216:3(1-20)Online publication date: 1-Jul-2020
  • (2019)A Mixed Signal Architecture for Convolutional Neural NetworksACM Journal on Emerging Technologies in Computing Systems10.1145/330411015:2(1-26)Online publication date: 26-Mar-2019
  • Show More Cited By
  1. Edge segmentation: empowering mobile telemedicine with compressed cellular neural networks

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      ICCAD '17: Proceedings of the 36th International Conference on Computer-Aided Design
      November 2017
      1077 pages

      Sponsors

      In-Cooperation

      • IEEE-EDS: Electronic Devices Society

      Publisher

      IEEE Press

      Publication History

      Published: 13 November 2017

      Check for updates

      Qualifiers

      • Research-article

      Conference

      ICCAD '17
      Sponsor:

      Acceptance Rates

      Overall Acceptance Rate 457 of 1,762 submissions, 26%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)3
      • Downloads (Last 6 weeks)1
      Reflects downloads up to 05 Nov 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2021)Quantization of Deep Neural Networks for Accurate Edge ComputingACM Journal on Emerging Technologies in Computing Systems10.1145/345121117:4(1-11)Online publication date: 30-Jun-2021
      • (2020)Low Overhead Online Data Flow Tracking for Intermittently Powered Non-Volatile FPGAsACM Journal on Emerging Technologies in Computing Systems10.1145/337139216:3(1-20)Online publication date: 1-Jul-2020
      • (2019)A Mixed Signal Architecture for Convolutional Neural NetworksACM Journal on Emerging Technologies in Computing Systems10.1145/330411015:2(1-26)Online publication date: 26-Mar-2019
      • (2019)XFERProceedings of the 2019 ACM/SIGDA International Symposium on Field-Programmable Gate Arrays10.1145/3289602.3293988(305-305)Online publication date: 20-Feb-2019
      • (2018)Efficient Hardware Implementation of Cellular Neural Networks with Incremental Quantization and Early ExitACM Journal on Emerging Technologies in Computing Systems10.1145/326481714:4(1-20)Online publication date: 1-Dec-2018

      View Options

      Get Access

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media