Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

NAVIS

Published: 10 May 2017 Publication History

Abstract

This software presents diverse utilities to develop the first post-processing layer using the neuromorphic auditory sensor's (NAS) information. The NAS used implements a cascade filters architecture in FPGA, imitating the behavior of the basilar membrane and inner hair cells, working with the sound information decomposed into its frequency components as spike streams. The neuromorphic hardware interface Address-Event-Representation (AER) is used to propagate auditory information out of the NAS, emulating the auditory vestibular nerve. Using the packetized information (aedat files) generated with jAER software plus an AER to USB computer interface, NAVIS implements a set of graphs that allows to represent the auditory information as cochleograms, histograms, sonograms, etc. It can also split the auditory information into different sets depending on the activity level of the spike streams. The main contribution of this software tool is its capability to apply complex audio post-processing treatments and representations, which is a novelty for spike-based systems in the neuromorphic community. This software will help neuromorphic engineers to build sets for the training of spiking neural networks (SNN).

References

[1]
P. Lichtsteiner, A 128128 120dB 15s latency asynchronous temporal contrast vision sensor, IEEE J. Solid-State Circuits, 43 (2008) 566-576.
[2]
R. Serrano-Gotarredona, On real-time AER 2-D convolutions hardware for neuromorphic spike-based cortical processing, IEEE Trans. Neural Netw., 19 (2008) 1196-1219.
[3]
A. Jimnez-Fernndez, Building blocks for spikes signal processing, IJCNN (2010).
[4]
A. Jimnez-Fernndez, A neuro-inspired spike-based PID motor controller for multi-motor robots with low cost FPGAs, Sensors, 12 (2012) 3831-3856.
[5]
A. Jimenez-Fernandez, A binaural Neuromorphic auditory sensor for FPGA: a spike signal processing approach, IEEE Trans. Neural Netw. (2016).
[6]
K. Boahen, Point-to-point connectivity between neuromorphic chips using address events, IEEE Trans. Circuits Syst. II Analog Digit. Signal Process., 47 (2000) 416-434.
[7]
T. Bekolay, Nengo: a Python tool for building large-scale functional brain models., Front. Neuroinform (2014).
[8]
D. Goodman, R. Brette, Brian: a simulator for spiking neural networks in Python., Front. Neuroinform. (2008).
[9]
T.Delbrck, jAER Open Source Project,2007. {Online}. Available: http://sourceforge.net/p/jaer/wiki/Home/.
[10]
R. Berner, A 5 Meps $100 USB20.0 address-event monitor-Sequencer interface, IEEE ISCAS (2007).
[11]
E. Painkras, SpiNNaker: a 1-W 18-Core System-on-Chip for Massively-Parallel Neural Network Simulation, IEEE J. Solid-State Circuits, 48 (2013) 1943-1953.
[12]
"Audacity."http://www.audacityteam.org.
[13]
J.Dominguez-Morales, NAVIS Tool Wiki.https://github.com/jpdominguez/NAVIS-Tool/wiki/Software-architecture.
[14]
LINQ:.NETLanguage-Integrated Query.https://msdn.microsoft.com/en-us/library/bb308959.aspx.

Cited By

View all
  • (2023)Interfacing PDM MEMS Microphones with PFM Spiking Systems: Application for Neuromorphic Auditory SensorsNeural Processing Letters10.1007/s11063-022-10936-055:2(1281-1292)Online publication date: 1-Apr-2023

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Neurocomputing
Neurocomputing  Volume 237, Issue C
May 2017
401 pages

Publisher

Elsevier Science Publishers B. V.

Netherlands

Publication History

Published: 10 May 2017

Author Tags

  1. Address-Event-Representation
  2. Auditory sensor
  3. Neuromorphic engineering
  4. Spiking neural networks

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 14 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2023)Interfacing PDM MEMS Microphones with PFM Spiking Systems: Application for Neuromorphic Auditory SensorsNeural Processing Letters10.1007/s11063-022-10936-055:2(1281-1292)Online publication date: 1-Apr-2023

View Options

View options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media