A scalable implementation of the recursive least-squares algorithm for training spiking neural networks

Our Research / Publications

janelia7_blocks-janelia7_biblio_header | block

Frontiers in Neuroinformatics. 2023 Jun 27;. doi: 10.3389/fninf.2023.1099510

View Article on

A scalable implementation of the recursive least-squares algorithm for training spiking neural networks Darshan Lab

Arthur Benjamin, Kim Christopher, Chen Susu, Preibisch Stephan, Darshan Ran

janelia7_blocks-janelia7_biblio_abstract | block

Abstract

Training spiking recurrent neural networks on neuronal recordings or behavioral tasks has become a prominent tool to study computations in the brain. With an increasing size and complexity of neural recordings, there is a need for fast algorithms that can scale to large datasets. We present optimized CPU and GPU implementations of the recursive least-squares algorithm in spiking neural networks. The GPU implementation allows training networks to reproduce neural activity of an order of millions neurons at order of magnitude times faster than the CPU implementation. We demonstrate this by applying our algorithm to reproduce the activity of > 66, 000 recorded neurons of a mouse performing a decision-making task. The fast implementation enables efficient training of large-scale spiking models, thus allowing for in-silico study of the dynamics and connectivity underlying multi-area computations.