Main Menu (Mobile)- Block

Main Menu - Block

janelia7_blocks-janelia7_secondary_menu | block
More in this page
janelia7_blocks-janelia7_fake_breadcrumb | block
Stringer Lab / Publications
general_search_page-panel_pane_1 | views_panes

24 Publications

Showing 1-10 of 24 results
02/27/24 | Distinct streams for supervised and unsupervised learning in the visual cortex
Lin Zhong , Scott Baptista , Rachel Gattoni , Jon Arnold , Daniel Flickinger , Carsen Stringer , Marius Pachitariu
bioRxiv. 2024 Feb 27:. doi: 10.1101/2024.02.25.581990

Representation learning in neural networks may be implemented with supervised or unsupervised algorithms, distinguished by the availability of feedback. In sensory cortex, perceptual learning drives neural plasticity, but it is not known if this is due to supervised or unsupervised learning. Here we recorded populations of up to 90,000 neurons simultaneously from the primary visual cortex (V1) and higher visual areas (HVA), while mice learned multiple tasks as well as during unrewarded exposure to the same stimuli. Similar to previous studies, we found that neural changes in task mice were correlated with their behavioral learning. However, the neural changes were mostly replicated in mice with unrewarded exposure, suggesting that the changes were in fact due to unsupervised learning. The neural plasticity was concentrated in the medial HVAs and obeyed visual, rather than spatial, learning rules. In task mice only, we found a ramping reward prediction signal in anterior HVAs, potentially involved in supervised learning. Our neural results predict that unsupervised learning may accelerate subsequent task learning, a prediction which we validated with behavioral experiments.

View Publication Page
02/12/24 | Cellpose3: one-click image restoration for improved cellular segmentation.
Stringer C, Pachitariu M
bioRxiv. 2024 Feb 12:. doi: 10.1101/2024.02.10.579780

Generalist methods for cellular segmentation have good out-of-the-box performance on a variety of image types. However, existing methods struggle for images that are degraded by noise, blurred or undersampled, all of which are common in microscopy. We focused the development of Cellpose3 on addressing these cases, and here we demonstrate substantial out-of-the-box gains in segmentation and image quality for noisy, blurry or undersampled images. Unlike previous approaches, which train models to restore pixel values, we trained Cellpose3 to output images that are well-segmented by a generalist segmentation model, while maintaining perceptual similarity to the target images. Furthermore, we trained the restoration models on a large, varied collection of datasets, thus ensuring good generalization to user images. We provide these tools as “one-click” buttons inside the graphical interface of Cellpose as well as in the Cellpose API.

View Publication Page
01/30/24 | Distributed fMRI dynamics predict distinct EEG rhythms across sleep and wakefulness.
Leandro P. L. Jacob , Sydney M. Bailes , Stephanie D. Williams , Carsen Stringer , Laura D. Lewis
bioRxiv. 2024 Jan 30:. doi: 10.1101/2024.01.29.577429

The brain exhibits rich oscillatory dynamics that vary across tasks and states, such as the EEG oscillations that define sleep. These oscillations play critical roles in cognition and arousal, but the brainwide mechanisms underlying them are not yet described. Using simultaneous EEG and fast fMRI in subjects drifting between sleep and wakefulness, we developed a machine learning approach to investigate which brainwide fMRI dynamics predict alpha (8-12 Hz) and delta (1-4 Hz) rhythms. We predicted moment-by-moment EEG power from fMRI activity in held-out subjects, and found that information about alpha power was represented by a remarkably small set of regions, segregated in two distinct networks linked to arousal and visual systems. Conversely, delta rhythms were diffusely represented on a large spatial scale across the cortex. These results identify distributed networks that predict delta and alpha rhythms, and establish a computational framework for investigating fMRI brainwide dynamics underlying EEG oscillations.

View Publication Page
11/20/23 | Facemap: a framework for modeling neural activity based on orofacial tracking
Atika Syeda , Lin Zhong , Renee Tung , Will Long , Marius Pachitariu , Carsen Stringer
Nature Neuroscience. 2023 Nov 20:. doi: 10.1038/s41593-023-01490-6

Recent studies in mice have shown that orofacial behaviors drive a large fraction of neural activity across the brain. To understand the nature and function of these signals, we need better computational models to characterize the behaviors and relate them to neural activity. Here we developed Facemap, a framework consisting of a keypoint tracking algorithm and a deep neural network encoder for predicting neural activity. We used the Facemap keypoints as input for the deep neural network to predict the activity of ∼50,000 simultaneously-recorded neurons and in visual cortex we doubled the amount of explained variance compared to previous methods. Our keypoint tracking algorithm was more accurate than existing pose estimation tools, while the inference speed was several times faster, making it a powerful tool for closed-loop behavioral experiments. The Facemap tracker was easy to adapt to data from new labs, requiring as few as 10 annotated frames for near-optimal performance. We used Facemap to find that the neuronal activity clusters which were highly driven by behaviors were more spatially spread-out across cortex. We also found that the deep keypoint features inferred by the model had time-asymmetrical state dynamics that were not apparent in the raw keypoint data. In summary, Facemap provides a stepping stone towards understanding the function of the brainwide neural signals and their relation to behavior.

View Publication Page
11/01/23 | Vagal sensory neurons mediate the Bezold-Jarisch reflex and induce syncope.
Lovelace JW, Ma J, Yadav S, Chhabria K, Shen H, Pang Z, Qi T, Sehgal R, Zhang Y, Bali T, Vaissiere T, Tan S, Liu Y, Rumbaugh G, Ye L, Kleinfeld D, Stringer C, Augustine V
Nature. 2023 Nov 01;623(7986):387-396. doi: 10.1038/s41586-023-06680-7

Visceral sensory pathways mediate homeostatic reflexes, the dysfunction of which leads to many neurological disorders. The Bezold-Jarisch reflex (BJR), first described in 1867, is a cardioinhibitory reflex that is speculated to be mediated by vagal sensory neurons (VSNs) that also triggers syncope. However, the molecular identity, anatomical organization, physiological characteristics and behavioural influence of cardiac VSNs remain mostly unknown. Here we leveraged single-cell RNA-sequencing data and HYBRiD tissue clearing to show that VSNs that express neuropeptide Y receptor Y2 (NPY2R) predominately connect the heart ventricular wall to the area postrema. Optogenetic activation of NPY2R VSNs elicits the classic triad of BJR responses-hypotension, bradycardia and suppressed respiration-and causes an animal to faint. Photostimulation during high-resolution echocardiography and laser Doppler flowmetry with behavioural observation revealed a range of phenotypes reflected in clinical syncope, including reduced cardiac output, cerebral hypoperfusion, pupil dilation and eye-roll. Large-scale Neuropixels brain recordings and machine-learning-based modelling showed that this manipulation causes the suppression of activity across a large distributed neuronal population that is not explained by changes in spontaneous behavioural movements. Additionally, bidirectional manipulation of the periventricular zone had a push-pull effect, with inhibition leading to longer syncope periods and activation inducing arousal. Finally, ablating NPY2R VSNs specifically abolished the BJR. Combined, these results demonstrate a genetically defined cardiac reflex that recapitulates characteristics of human syncope at physiological, behavioural and neural network levels.

View Publication Page
08/07/23 | Learning produces a hippocampal cognitive map in the form of an orthogonalized state machine.
Weinan Sun , Johan Winnubst , Maanasa Natrajan , Chongxi Lai , Koichiro Kajikawa , Michalis Michaelos , Rachel Gattoni , Carsen Stringer , Daniel Flickinger , James E. Fitzgerald , Nelson Spruston
bioRxiv. 2023 Aug 07:. doi: 10.1101/2023.08.03.551900

Cognitive maps confer animals with flexible intelligence by representing spatial, temporal, and abstract relationships that can be used to shape thought, planning, and behavior. Cognitive maps have been observed in the hippocampus, but their algorithmic form and the processes by which they are learned remain obscure. Here, we employed large-scale, longitudinal two-photon calcium imaging to record activity from thousands of neurons in the CA1 region of the hippocampus while mice learned to efficiently collect rewards from two subtly different versions of linear tracks in virtual reality. The results provide a detailed view of the formation of a cognitive map in the hippocampus. Throughout learning, both the animal behavior and hippocampal neural activity progressed through multiple intermediate stages, gradually revealing improved task understanding and behavioral efficiency. The learning process led to progressive decorrelations in initially similar hippocampal neural activity within and across tracks, ultimately resulting in orthogonalized representations resembling a state machine capturing the inherent structure of the task. We show that a Hidden Markov Model (HMM) and a biologically plausible recurrent neural network trained using Hebbian learning can both capture core aspects of the learning dynamics and the orthogonalized representational structure in neural activity. In contrast, we show that gradient-based learning of sequence models such as Long Short-Term Memory networks (LSTMs) and Transformers do not naturally produce such representations. We further demonstrate that mice exhibited adaptive behavior in novel task settings, with neural activity reflecting flexible deployment of the state machine. These findings shed light on the mathematical form of cognitive maps, the learning rules that sculpt them, and the algorithms that promote adaptive behavior in animals. The work thus charts a course toward a deeper understanding of biological intelligence and offers insights toward developing more robust learning algorithms in artificial intelligence.

View Publication Page
07/28/23 | Rastermap: a discovery method for neural population recordings
Carsen Stringer , Lin Zhong , Atika Syeda , Fengtong Du , Marius Pachitariu
bioRxiv. 2023 Jul 28:. doi: 10.1101/2023.07.25.550571

Neurophysiology has long progressed through exploratory experiments and chance discoveries. Anecdotes abound of researchers setting up experiments while listening to spikes in real time and observing a pattern of consistent firing when certain stimuli or behaviors happened. With the advent of large-scale recordings, such close observation of data has become harder because high-dimensional spaces are impenetrable to our pattern-finding intuitions. To help ourselves find patterns in neural data, our lab has been openly developing a visualization framework known as “Rastermap” over the past five years. Rastermap takes advantage of a new global optimization algorithm for sorting neural responses along a one-dimensional manifold. Displayed as a raster plot, the sorted neurons show a variety of activity patterns, which can be more easily identified and interpreted. We first benchmark Rastermap on realistic simulations with multiplexed cognitive variables. Then we demonstrate it on recordings of tens of thousands of neurons from mouse visual and sensorimotor cortex during spontaneous, stimulus-evoked and task-evoked epochs, as well as on whole-brain zebrafish recordings, widefield calcium imaging data, population recordings from rat hippocampus and artificial neural networks. Finally, we illustrate high-dimensional scenarios where Rastermap and similar algorithms cannot be used effectively.

View Publication Page
01/07/23 | Solving the spike sorting problem with Kilosort
Marius Pachitariu , Shashwat Sridhar , Carsen Stringer
bioRxiv. 2023 Jan 07:. doi: 10.1101/2023.01.07.523036

Spike sorting is the computational process of extracting the firing times of single neurons from recordings of local electrical fields. This is an important but hard problem in neuroscience, complicated by the non-stationarity of the recordings and the dense overlap in electrical fields between nearby neurons. To solve the spike sorting problem, we have continuously developed over the past eight years a framework known as Kilosort. This paper describes the various algorithmic steps introduced in different versions of Kilosort. We also report the development of Kilosort4, a new version with substantially improved performance due to new clustering algorithms inspired by graph-based approaches. To test the performance of Kilosort, we developed a realistic simulation framework which uses densely sampled electrical fields from real experiments to generate non-stationary spike waveforms and realistic noise. We find that nearly all versions of Kilosort outperform other algorithms on a variety of simulated conditions, and Kilosort4 performs best in all cases, correctly identifying even neurons with low amplitudes and small spatial extents in high drift conditions.

View Publication Page
11/07/22 | Cellpose 2.0: how to train your own model.
Pachitariu M, Stringer C
Nature Methods. 2022 Nov 07;19(12):1634-41. doi: 10.1038/s41592-022-01663-4

Pretrained neural network models for biological segmentation can provide good out-of-the-box results for many image types. However, such models do not allow users to adapt the segmentation style to their specific needs and can perform suboptimally for test images that are very different from the training images. Here we introduce Cellpose 2.0, a new package that includes an ensemble of diverse pretrained models as well as a human-in-the-loop pipeline for rapid prototyping of new custom models. We show that models pretrained on the Cellpose dataset can be fine-tuned with only 500-1,000 user-annotated regions of interest (ROI) to perform nearly as well as models trained on entire datasets with up to 200,000 ROI. A human-in-the-loop approach further reduced the required user annotation to 100-200 ROI, while maintaining high-quality segmentations. We provide software tools such as an annotation graphical user interface, a model zoo and a human-in-the-loop pipeline to facilitate the adoption of Cellpose 2.0.

View Publication Page
10/17/22 | Omnipose: a high-precision morphology-independent solution for bacterial cell segmentation.
Cutler KJ, Stringer C, Lo TW, Rappez L, Stroustrup N, Brook Peterson S, Wiggins PA, Mougous JD
Nature Methods. 2022 Oct 17:. doi: 10.1038/s41592-022-01639-4

Advances in microscopy hold great promise for allowing quantitative and precise measurement of morphological and molecular phenomena at the single-cell level in bacteria; however, the potential of this approach is ultimately limited by the availability of methods to faithfully segment cells independent of their morphological or optical characteristics. Here, we present Omnipose, a deep neural network image-segmentation algorithm. Unique network outputs such as the gradient of the distance field allow Omnipose to accurately segment cells on which current algorithms, including its predecessor, Cellpose, produce errors. We show that Omnipose achieves unprecedented segmentation performance on mixed bacterial cultures, antibiotic-treated cells and cells of elongated or branched morphology. Furthermore, the benefits of Omnipose extend to non-bacterial subjects, varied imaging modalities and three-dimensional objects. Finally, we demonstrate the utility of Omnipose in the characterization of extreme morphological phenotypes that arise during interbacterial antagonism. Our results distinguish Omnipose as a powerful tool for characterizing diverse and arbitrarily shaped cell types from imaging data.

View Publication Page