research-article

Approximate Memristive In-Memory Hamming Distance Circuit

Authors:

Mohammad M. A. Taha,

Christof TeuscherAuthors Info & Claims

ACM Journal on Emerging Technologies in Computing Systems (JETC), Volume 16, Issue 2

Article No.: 18, Pages 1 - 14

https://doi.org/10.1145/3371391

Published: 13 March 2020 Publication History

Abstract

Hamming Distance (HD) is a popular similarity measure that is used widely in pattern matching applications, DNA sequencing, and binary error-correcting codes. In this article, we extend our previous work to prove that our HD circuit is scalable, tolerant to memristor model variability, and tolerant to device-to-device variation. We showed that the operation of our circuit under non-ideal fabrication conditions changes slightly, decreasing the correct classification rates for the MNIST handwritten digits dataset by <1%. Our circuit’s operation is independent of the memristor model used, as long as the model allows a reverse current. Because we leverage in-memory parallel computing, our circuit is n× faster than other HD circuits, where n is the number of HDs to be computed, and it consumes ≈100× − 1,000× less power compared to other memristive and CMOS HD circuits. Used in a full HD Associative Content Addressable Memory (ACAM), the proposed HD circuit consumes only 2.2% of the total system power. Our state-of-the-art, low-power, and fast HD circuit is relevant for a wide range of applications.

References

[1]

J. Borghetti, G. Snider, P. Kuekes, J. Yang, D. Stewart, and R. Williams. 2010. “Memristive” switches enable “stateful” logic operations via material implication. Nature 464, (2010), 873--876.

[2]

R. Carvajal, J. Ramirez-Angula, and J. Tombs. 2000. High-speed high-precision voltage-mode MIN/MAX circuits in CMOS technology. In Proceedings of the 2000 IEEE International Symposium on Circuits and Systems (ISCAS) 5 (2000), 13--16.

[3]

Y. Cassuto and K. Crammer. 2015. In-memory Hamming similarity computation in resistive arrays. In Proceedings of the 2015 IEEE International Symposium on Information Theory (ISIT). 819--823.

[4]

L. Chua. 1971. Memristor-the missing circuit element. IEEE Transactions on Circuit Theory 18, 5 (1971), 507--519.

[5]

D. Fan, M. Sharad, A. Sengupta, and K. Roy. 2016. Hierarchical temporal memory based on spin-neurons and resistive memory for energy-efficient brain-inspired computing. IEEE Transactions on Neural Networks and Learning Systems 27, 9 (2016), 1907--1919.

[6]

G. Forney. 1966. Generalized minimum distance decoding. IEEE Transactions on Information Theory 12, 2 (1966), 125--131.

Digital Library

[7]

N. Ge, J. Yoon, M. Hu, E. Merced-Grafals, N. Davila, J. Strachan, Z. Li, H. Holder, Q. Xia, X. Zhou Williams, R. S., and J. Yang. 2017. An efficient analog Hamming distance comparator realized with a unipolar memristor array: A showcase of physical computing. Scientific Reports 7, Article 40135 (2017).

[8]

A. Gupta and Y. Singh. 2011. Analysis of Hamming network and MAXNET of neural network method in the string recognition. In Proceedings of the 2011 International Conference on Communication Systems and Network Technologies (CSNT). 38--42.

Digital Library

[9]

J. Huang, G. Zhou, X. Zhou, and R. Zhang. 2018. A new FPGA architecture of FAST and BRIEF algorithm for on-board corner detection and matching. Sensors 18, 4 (2018), 1014.

[10]

S. Jo, K. Kim, and W. Lu. 2009. High-density crossbar arrays based on a Si memristive system. Nano Letters 9, 2, (2009), 870--874.

[11]

R. Kaplan, L. Yavits, and R. Ginosar. 2019. RASSA: Resistive pre-alignment accelerator for approximate DNA long read mapping. IEEE Micro 39, 4, (2019), 44--54.

Digital Library

[12]

E. Lehtonen, J. Tissari, J. Poikonen, M. Laiho, and L. Koskinen. 2014. A cellular computing architecture for parallel memristive stateful logic. Microelectronics Journal 45, 11 (2014), 1438--1449.

Digital Library

[13]

J. Li, R. K. Montoye, M. Ishii, and L. Chang. 2014. 1 Mb 0.41 µm² 2T-2R cell nonvolatile TCAM with two-bit encoding and clocked self-referenced sensing. IEEE Journal of Solid-State Circuits 49, 4 (2014), 896--907.

[14]

H. Mattausch, T. Gyohten, Y. Soda, and T. Koide. 2002. Compact associative-memory architecture with fully parallel search capability for the minimum Hamming distance. IEEE Journal of Solid-State Circuits 37, 2 (2002), 218--227.

[15]

D. Querlioz, W. Zhao, P. Dollfus, J. Olivier, O. Bichler, and C. Gamrat. 2012. Bioinspired networks with nanoscale memristive devices that combine the unsupervised and supervised learning approaches. In Proceedings of the 2012 IEEE/ACM International Symposium on Nanoscale Architectures (NANOARCH). 203--210.

[16]

A. Rahimi, A. Ghofrani, K. T. Cheng, L. Benini, and R. K. Gupta. 2015. Approximate associative memristive memory for energy-efficient GPUs. In Proceedings of the 2015 Design, Automation Test in Europe Conference Exhibition (DATE). 1497--1502.

[17]

Sandia National Laboratories. 2016. Xyce Simulator. Retrieved from https://xyce.sandia.gov.

[18]

M. Sharad, D. Fan, and K. Roy. 2013. Ultra low power associative computing with spin neurons and resistive crossbar memory. In Proceedings of the 50^th ACM/EDA/IEEE Annual Design Automation Conference (DAC). 1--6.

[19]

P. Sheridan, C. Du, and W. Lu. 2016. Feature extraction using memristor networks. IEEE Transactions on Neural Networks and Learning Systems 27, 11 (2016), 2327--2336.

[20]

A. M. Steane. 1996. Error correcting codes in quantum theory. Physical Review Letters 77, 5 (1996), 793--797.

[21]

D. B. Strukov, G. S. Snider, D. R. Stewart, and R. S. Williams. 2008. The missing memristor found. Nature 453, (2008), 80--83.

[22]

M. M. A. Taha, W. Chavez, and C. Teuscher. 2017. Spatial and temporal probabilistic inference using a memristive associative memory. International Journal of Unconventional Computing 13, 2 (2017), 97--115.

[23]

M. M. A. Taha, W. Woods, and C. Teuscher. 2016. Approximate in-memory Hamming distance calculation with a memristive associative memory. In Proceedings of the 2016 IEEE/ACM International Symposium on Nanoscale Architectures (NANOARCH), 159--164.

[24]

W. Woods, M. M. A. Taha, D. Tran, J. Bürger, and C. Teuscher. 2015. Memristor panic—A survey of different device models in crossbar architectures. In Proceedings of the 2015 IEEE/ACM International Symposium on Nanoscale Architectures (NANOARCH). 106--111.

[25]

Y. Yang and W. Lu. 2013. Nanoscale resistive switching devices: Mechanisms and modeling. Nanoscale 5, 21 (2013), 10076--10092.

[26]

L. Yann, L. Bottou, Y. Bengio, and P. Haffner. 1998. Gradient-based learning applied to document recognition. In Proceedings of the IEEE 86, 11 (1998), 2278--2323.

[27]

O. Yusuke, I. Makoto, and A. Kunihiro. 2004. Hierarchical multi-chip architecture for high capacity scalability of fully parallel Hamming-distance associative memories. IEICE Transactions on Electronics 87, 11 (2004), 1847--1855.

[28]

X. Zhu, X. Yang, C. Wu, J. Wu, and X. Yi. 2013. Hamming network circuits based on CMOS/memristor hybrid design. IEICE Electronics Express 10, 12 (2013).

[29]

F. Zokaee, H. R. Zarandi, and L. Jiang. 2018. AligneR: A process-in-memory architecture for short read alignment in ReRAMs. IEEE Computer Architecture Letters 17, 2 (2018), 237--240.

Digital Library

[30]

F. Merrikh-Bayat, B. Hoskins, and D. B. Strukov. 2015. Phenomenological modeling of memristive devices. Applied Physics A 118 (2015), 779--786.

[31]

R. Berdan, C. Lim, A. Khiat, C. Papavasiliou, and T. Prodromakis. 2014. A memristor SPICE model accounting for volatile characteristics of practical ReRAM. IEEE Electron Device Letters 35, 1 (2014), 135--137.

[32]

S. Jo, T. Chang, I. Ebong, B. B. Bhadviya, P. Mazumder, and W. Lu. 2010. Nanoscale memristor device as synapse in neuromorphic systems. Nano Letters 10, 4 (2010), 1397--1301.

Cited By

Merlin IGarzón EFish AYavits L(2024)DIPER: Detection and Identification of Pathogens Using Edit Distance-Tolerant Resistive CAMIEEE Transactions on Computers10.1109/TC.2023.331582973:10(2463-2473)Online publication date: 1-Oct-2024
https://dl.acm.org/doi/10.1109/TC.2023.3315829
Xue PZhang CWen ZYu FPark ENourani V(2024)Climate variability impacts on runoff projection in the 21st century based on the applicability assessment of multiple GCMs: A case study of the Lushi Basin, ChinaJournal of Hydrology10.1016/j.jhydrol.2024.131383(131383)Online publication date: May-2024
https://doi.org/10.1016/j.jhydrol.2024.131383
Garzón EYavits LTeman ALanuzza M(2023)Approximate Content-Addressable Memories: A ReviewChips10.3390/chips20200052:2(70-82)Online publication date: 30-Mar-2023
https://doi.org/10.3390/chips2020005
Show More Cited By

Index Terms

Approximate Memristive In-Memory Hamming Distance Circuit
1. Hardware
  1. Emerging technologies

Recommendations

Approximate Memristive In-memory Computing
Special Issue ESWEEK 2017, CASES 2017, CODES + ISSS 2017 and EMSOFT 2017

The bottleneck between the processing elements and memory is the biggest issue contributing to the scalability problem in computing. In-memory computation is an alternative approach that combines memory and processor in the same location, and eliminates ...
The intractability of computing the Hamming distance

Given a string x and a language L, the Hamming distance of x to L is the minimum Hamming distance of x to any string in L. The edit distance of a string to a language is analogously defined.First, we prove that there is a language in AC⁰ such that both ...
A Low-Power Variation-Aware Adaptive Write Scheme for Access-Transistor-Free Memristive Memory

Recent advances in access-transistor-free memristive crossbars have demonstrated the potential of memristor arrays as high-density and ultra-low-power memory. However, with considerable variations in the write-time characteristics of individual ...

Comments

Information & Contributors

Information

Published In

cover image ACM Journal on Emerging Technologies in Computing Systems

ACM Journal on Emerging Technologies in Computing Systems Volume 16, Issue 2

April 2020

261 pages

ISSN:1550-4832

EISSN:1550-4840

DOI:10.1145/3375712

Editor:
Zhaojun Bai
University of California at Davis, USA

Issue’s Table of Contents

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Journal Family

ACM Journals for the Design of Smart and Connected Systems

Publication History

Published: 13 March 2020

Accepted: 01 November 2019

Revised: 01 September 2019

Received: 01 March 2019

Published in JETC Volume 16, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

Semiconductor Research Corporation

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
446
Total Downloads

Downloads (Last 12 months)61
Downloads (Last 6 weeks)2

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Merlin IGarzón EFish AYavits L(2024)DIPER: Detection and Identification of Pathogens Using Edit Distance-Tolerant Resistive CAMIEEE Transactions on Computers10.1109/TC.2023.331582973:10(2463-2473)Online publication date: 1-Oct-2024
https://dl.acm.org/doi/10.1109/TC.2023.3315829
Xue PZhang CWen ZYu FPark ENourani V(2024)Climate variability impacts on runoff projection in the 21st century based on the applicability assessment of multiple GCMs: A case study of the Lushi Basin, ChinaJournal of Hydrology10.1016/j.jhydrol.2024.131383(131383)Online publication date: May-2024
https://doi.org/10.1016/j.jhydrol.2024.131383
Garzón EYavits LTeman ALanuzza M(2023)Approximate Content-Addressable Memories: A ReviewChips10.3390/chips20200052:2(70-82)Online publication date: 30-Mar-2023
https://doi.org/10.3390/chips2020005
Soleimani PCapson DLi K(2023)A Partitioned CAM Architecture with FPGA Acceleration for Binary Descriptor MatchingACM Transactions on Reconfigurable Technology and Systems10.1145/362474917:1(1-21)Online publication date: 5-Oct-2023
https://dl.acm.org/doi/10.1145/3624749
Jahshan ZMerlin IGarzón EYavits L(2023)DASH-CAM: Dynamic Approximate SearcH Content Addressable Memory for genome classificationProceedings of the 56th Annual IEEE/ACM International Symposium on Microarchitecture10.1145/3613424.3614262(1453-1465)Online publication date: 28-Oct-2023
https://dl.acm.org/doi/10.1145/3613424.3614262
Garzón EGolman RLanuzza MTeman AYavits L(2023)A Low-Complexity Sensing Scheme for Approximate Matching Content-Addressable MemoryIEEE Transactions on Circuits and Systems II: Express Briefs10.1109/TCSII.2023.328625770:10(3867-3871)Online publication date: Oct-2023
https://doi.org/10.1109/TCSII.2023.3286257
Mema AThomann SGenssler PAmrouch H(2023)FDSOI-Based Analog Computing for Ultra-Efficient Hamming Distance Similarity CalculationIEEE Transactions on Circuits and Systems I: Regular Papers10.1109/TCSI.2023.326783770:7(2679-2688)Online publication date: Jul-2023
https://doi.org/10.1109/TCSI.2023.3267837
Garzón ELanuzza MTeman AYavits L(2023) AM 4 : MRAM Crossbar Based CAM/TCAM/ACAM/AP for In-Memory Computing IEEE Journal on Emerging and Selected Topics in Circuits and Systems10.1109/JETCAS.2023.324322213:1(408-421)Online publication date: Mar-2023
https://doi.org/10.1109/JETCAS.2023.3243222
Hanhan RGarzón EJahshan ZTeman ALanuzza MYavits LSalapura VZahran MChong FTang L(2022)EDAMProceedings of the 49th Annual International Symposium on Computer Architecture10.1145/3470496.3527424(495-507)Online publication date: 18-Jun-2022
https://dl.acm.org/doi/10.1145/3470496.3527424
Amri AWibawa AWulandari D(2022)Comparison of Computerized and Manual Assessment of Dyslexia Children Test using Text Processing2022 International Seminar on Intelligent Technology and Its Applications (ISITIA)10.1109/ISITIA56226.2022.9855317(157-162)Online publication date: 20-Jul-2022
https://doi.org/10.1109/ISITIA56226.2022.9855317
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Issue’s Table of Contents