Advances in fluorescence microscopy enable monitoring larger brain areas in-vivo with finer time resolution. The resulting data rates require reproducible analysis pipelines that are reliable, fully automated, and scalable to datasets generated over the course of months. We present CaImAn, an open-source library for calcium imaging data analysis. CaImAn provides automatic and scalable methods to address problems common to pre-processing, including motion correction, neural activity identification, and registration across different sessions of data collection. It does this while requiring minimal user intervention, with good scalability on computers ranging from laptops to high-performance computing clusters. CaImAn is suitable for two-photon and one-photon imaging, and also enables real-time analysis on streaming data. To benchmark the performance of CaImAn we collected and combined a corpus of manual annotations from multiple labelers on nine mouse two-photon datasets. We demonstrate that CaImAn achieves near-human performance in detecting locations of active neurons

The ability of animals to accumulate sensory information across time is fundamental to decision-making. Using a mouse behavioral paradigm where navigational decisions are based on accumulating pulses of visual cues, I compared neural activity in primary visual (V1) to secondary visual and retrosplenial cortices. Even in V1, only a small fraction of neurons had sensory-like responses to cues. Instead, all areas were grossly similar in how neural populations contained a large variety of task-related information from sensory to cognitive, including cue timings, accumulated counts, place/time, decision and reward outcome. Across-trial influences were prevalent, possibly relevant to how animal behavior incorporates past contexts. Intriguingly, all these variables also modulated the amplitudes of sensory responses. While previous work often modeled the accumulation process as integration, the observed scaling of sensory responses by accumulated counts instead suggests a recursive process where sensory responses are gradually amplified. I show that such a multiplicative feedback-loop algorithm better explains psychophysical data than integration, particularly in how the performance transitions into following Weber-Fechner's Law only at high counts.

Studies of perceptual decision-making have often assumed that the main role of sensory cortices is to provide sensory input to downstream processes that accumulate and drive behavioral decisions. We performed a systematic comparison of neural activity in primary visual (V1) to secondary visual and retrosplenial cortices, as mice performed a task where they should accumulate pulsatile visual cues through time to inform a navigational decision. Even in V1, only a small fraction of neurons had sensory-like responses to cues. Instead, in all areas neurons were sequentially active, and contained information ranging from sensory to cognitive, including cue timings, evidence, place/time, decision and reward outcome. Per-cue sensory responses were amplitude-modulated by various cognitive quantities, notably accumulated evidence. This inspired a multiplicative feedback-loop circuit hypothesis that proposes a more intricate role of sensory areas in the accumulation process, and furthermore explains a surprising observation that perceptual discrimination deviates from Weber-Fechner Law.Highlights / eTOC BlurbMice made navigational decisions based on accumulating pulsatile visual cuesThe bulk of neural activity in visual cortices was sequential and beyond-sensoryAccumulated pulse-counts modulated sensory (cue) responses, suggesting feedbackA feedback-loop neural circuit explains behavioral deviations from Weber’s LawHighlights / eTOC BlurbIn a task where navigation was informed by accumulated pulsatile visual evidence, neural activity in visual cortices predominantly coded for cognitive variables across multiple timescales, including outside of a visual processing context. Even sensory responses to visual pulses were amplitude-modulated by accumulated pulse counts and other variables, inspiring a multiplicative feedback-loop circuit hypothesis that in turn explained behavioral deviations from Weber-Fechner Law.

Recent work has highlighted that many types of variables are represented in each neocortical area. How can these many neural representations be organized together without interference, and coherently maintained/updated through time? We recorded from large neural populations in posterior cortices as mice performed a complex, dynamic task involving multiple interrelated variables. The neural encoding implied that correlated task variables were represented by uncorrelated modes in an information-coding subspace. We show via theory that this can enable optimal decoding directions to be insensitive to neural noise levels. Across posterior cortex, principles of efficient coding thus applied to task-specific information, with neural-population modes as the encoding unit. Remarkably, this encoding function was multiplexed with rapidly changing, sequential neural dynamics, yet reliably followed slow changes in task-variable correlations through time. We can explain this as due to a mathematical property of high-dimensional spaces that the brain might exploit as a temporal scaffold.