Event Camera Data Classification Using Spiking Networks with Spike-Timing-Dependent Plasticity

Abstract

We present an optimization-based theory describing spiking cortical ensembles equipped with Spike-Timing-Dependent Plasticity (STDP) learning, as empirically observed in the visual cortex. Using this generic framework, we build a class of global and action-based feature descriptors for event-based cameras that we assess on the N-MNIST and the IBM DVS128 Gesture datasets. We report significant accuracy improvements compared to state-of-the-art STDP-based systems (+9.3% on N-MNIST, +7.74% on IBM DVS128 Gesture). In addition to ultralow-power learning in neuromorphic edge devices, our work contributes towards a biologically-plausible, optimization-based theory of cortical vision.