Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/2463209.2488741acmconferencesArticle/Chapter ViewAbstractPublication PagesdacConference Proceedingsconference-collections
research-article

Digital-assisted noise-eliminating training for memristor crossbar-based analog neuromorphic computing engine

Published: 29 May 2013 Publication History

Abstract

The invention of neuromorphic computing architecture is inspired by the working mechanism of human-brain. Memristor technology revitalized neuromorphic computing system design by efficiently executing the analog Matrix-Vector multiplication on the memristor-based crossbar (MBC) structure. However, programming the MBC to the target state can be very challenging due to the difficulty to real-time monitor the memristor state during the training. In this work, we quantitatively analyzed the sensitivity of the MBC programming to the process variations and input signal noise. We then proposed a noise-eliminating training method on top of a new crossbar structure to minimize the noise accumulation during the MBC training and improve the trained system performance, i.e., the pattern recall rate. A digital-assisted initialization step for MBC training is also introduced to reduce the training failure rate as well as the training time. Experimental results show that our noise-eliminating training method can improve the pattern recall rate. For the tested patterns with 128 x 128 pixels our technique can reduce the MBC training time by 12.6% ~ 14.1% for the same pattern recognition rate, or improve the pattern recall rate by 18.7% ~ 36.2% for the same training time.

References

[1]
H. Chen, S. Saighi, et al. Real-Time Simulation of Biologically Realistic Stochastic Neurons in VLSI. In IEEE Trans. on Neural Networks, pages 1511--1517, 2010.
[2]
L. Chua. Memristor-the Missing Circuit Element. In IEEE Trans. on Circuit Theory, pages 507--519, 1971.
[3]
M. Hu et al. Hardware Realization of BSB Recall Function Using Memristor Crossbar. In DAC, pages 498--503, 2012.
[4]
S. H. Jo. Nanoscale Memristor Device as Synapse in Neuromorphic Systems. In Nano Letters, pages 1297--1301, 2010.
[5]
K. Kim et al. A Functional Hybrid Memristor Crossbar-Array/CMOS System for Data Storage and Neuromorphic Applications. In Nano Letters, pages 389-395, 2012.
[6]
J. Klein et al. Hight fault tolerance in neural crossbar. In DTIS, pages 1--6, 2010.
[7]
R. Kumar, D. Tullsen, et al. Heterogeneous chip multiprocessors. In Computer, pages 32--38, 2005.
[8]
F. Moreno et al. Reconfigurable Hardware Architecture of a Shape Recognition System Based on Specialized Tiny Neural Networks With Online Training. In IEEE Trans. on Industrial Electronics, pages 3253--3263, 2009.
[9]
S. Yu, Y. Wu, and P. Wong. Investigating the Switching Dynamics and Multilevel Capability of Bipolar Metal Oxide Resistive Switching Memory. In APL, pages 103514--3, 2011.
[10]
T. Yu et al. Analog VLSI Biophysical Neurons and Synapses With Programmable Membrane Kinetics. In IEEE Trans. on Biomedical Circuits and Systems, pages 139--148, 2010.
[11]
F. Zhuo et al. Multigrid on GPU: Tackling Power Grid Analysis on parallel SIMT platforms. In International Conference on Computer-Aided Design (ICCAD), pages 647--654, 2008.

Cited By

View all
  • (2024)Realization of Future Neuro-Biological Architecture in Power Efficient Memristors of Fe3O4/WS2 Hybrid NanocompositesNano Energy10.1016/j.nanoen.2024.109272(109272)Online publication date: Jan-2024
  • (2023)Electric-Controlled Resistive Switching and Different Synaptic Behaviors in p⁺-Si/n-ZnO Heterojunction MemristorIEEE Transactions on Electron Devices10.1109/TED.2023.324293070:4(1648-1652)Online publication date: Apr-2023
  • (2022)Performance Improvement of Memristor-Based Echo State Networks by Optimized Programming SchemeIEEE Electron Device Letters10.1109/LED.2022.316583143:6(866-869)Online publication date: Jun-2022
  • Show More Cited By

Index Terms

  1. Digital-assisted noise-eliminating training for memristor crossbar-based analog neuromorphic computing engine

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    DAC '13: Proceedings of the 50th Annual Design Automation Conference
    May 2013
    1285 pages
    ISBN:9781450320719
    DOI:10.1145/2463209
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    In-Cooperation

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 29 May 2013

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. memristor
    2. neuromorphic computing
    3. pattern recognition

    Qualifiers

    • Research-article

    Conference

    DAC '13
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 1,770 of 5,499 submissions, 32%

    Upcoming Conference

    DAC '25
    62nd ACM/IEEE Design Automation Conference
    June 22 - 26, 2025
    San Francisco , CA , USA

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)16
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 16 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Realization of Future Neuro-Biological Architecture in Power Efficient Memristors of Fe3O4/WS2 Hybrid NanocompositesNano Energy10.1016/j.nanoen.2024.109272(109272)Online publication date: Jan-2024
    • (2023)Electric-Controlled Resistive Switching and Different Synaptic Behaviors in p⁺-Si/n-ZnO Heterojunction MemristorIEEE Transactions on Electron Devices10.1109/TED.2023.324293070:4(1648-1652)Online publication date: Apr-2023
    • (2022)Performance Improvement of Memristor-Based Echo State Networks by Optimized Programming SchemeIEEE Electron Device Letters10.1109/LED.2022.316583143:6(866-869)Online publication date: Jun-2022
    • (2022)A crossbar array of magnetoresistive memory devices for in-memory computingNature10.1038/s41586-021-04196-6601:7892(211-216)Online publication date: 12-Jan-2022
    • (2022) Tunable Resistive Switching in 2D MXene Ti 3 C 2 Nanosheets for Non-Volatile Memory and Neuromorphic Computing ACS Applied Materials & Interfaces10.1021/acsami.2c1400614:39(44614-44621)Online publication date: 22-Sep-2022
    • (2021)Architecting for Artificial Intelligence with Emerging NanotechnologyACM Journal on Emerging Technologies in Computing Systems10.1145/344597717:3(1-33)Online publication date: 12-Aug-2021
    • (2020)Impact of Memristor Defects in a Neuromorphic Radionuclide Identification System2020 IEEE International Symposium on Circuits and Systems (ISCAS)10.1109/ISCAS45731.2020.9180669(1-5)Online publication date: Oct-2020
    • (2020)Automated Design of Neuromorphic Networks for Scientific Applications at the Edge2020 International Joint Conference on Neural Networks (IJCNN)10.1109/IJCNN48605.2020.9207412(1-7)Online publication date: Jul-2020
    • (2020)A Low Power Integrate and Fire Neuron Circuit for Spiking Neural Network2020 International Conference on Electronics, Information, and Communication (ICEIC)10.1109/ICEIC49074.2020.9051292(1-5)Online publication date: Jan-2020
    • (2020)An STT-MRAM based reconfigurable computing-in-memory architecture for general purpose computingCCF Transactions on High Performance Computing10.1007/s42514-020-00038-52:3(272-281)Online publication date: 29-Jul-2020
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media