Main Menu (Mobile)- Block

Main Menu - Block

janelia7_blocks-janelia7_fake_breadcrumb | block
Lee Tzumin Lab / Publications
general_search_page-panel_pane_1 | views_panes

46 Publications

Showing 1-10 of 46 results
Your Criteria:
    03/15/24 | Social state gates vision using three circuit mechanisms in Drosophila
    Catherine E. Schretter , Tom Hindmarsh Sten , Nathan Klapoetke , Mei Shao , Aljoscha Nern , Marisa Dreher , Daniel Bushey , Alice A. Robie , Adam L. Taylor , Kristin M. Branson , Adriane Otopalik , Vanessa Ruta , Gerald M. Rubin
    bioRxiv. 2024-03-15:. doi: 10.1101/2024.03.15.585289

    Animals are often bombarded with visual information and must prioritize specific visual features based on their current needs. The neuronal circuits that detect and relay visual features have been well-studied. Yet, much less is known about how an animal adjusts its visual attention as its goals or environmental conditions change. During social behaviors, flies need to focus on nearby flies. Here, we study how the flow of visual information is altered when female Drosophila enter an aggressive state. From the connectome, we identified three state-dependent circuit motifs poised to selectively amplify the response of an aggressive female to fly-sized visual objects: convergence of excitatory inputs from neurons conveying select visual features and internal state; dendritic disinhibition of select visual feature detectors; and a switch that toggles between two visual feature detectors. Using cell-type-specific genetic tools, together with behavioral and neurophysiological analyses, we show that each of these circuit motifs function during female aggression. We reveal that features of this same switch operate in males during courtship pursuit, suggesting that disparate social behaviors may share circuit mechanisms. Our work provides a compelling example of using the connectome to infer circuit mechanisms that underlie dynamic processing of sensory signals.Competing Interest StatementThe authors have declared no competing interest.

    View Publication Page
    03/14/24 | Whole-body simulation of realistic fruit fly locomotion with deep reinforcement learning
    Roman Vaxenburg , Igor Siwanowicz , Josh Merel , Alice A Robie , Carmen Morrow , Guido Novati , Zinovia Stefanidi , Gwyneth M Card , Michael B Reiser , Matthew M Botvinick , Kristin M Branson , Yuval Tassa , Srinivas C Turaga
    bioRxiv. 2024-03-14:. doi: 10.1101/2024.03.11.584515

    The body of an animal determines how the nervous system produces behavior. Therefore, detailed modeling of the neural control of sensorimotor behavior requires a detailed model of the body. Here we contribute an anatomically-detailed biomechanical whole-body model of the fruit fly Drosophila melanogaster in the MuJoCo physics engine. Our model is general-purpose, enabling the simulation of diverse fly behaviors, both on land and in the air. We demonstrate the generality of our model by simulating realistic locomotion, both flight and walking. To support these behaviors, we have extended MuJoCo with phenomenological models of fluid forces and adhesion forces. Through data-driven end-to-end reinforcement learning, we demonstrate that these advances enable the training of neural network controllers capable of realistic locomotion along complex trajectories based on high-level steering control signals. With a visually guided flight task, we demonstrate a neural controller that can use the vision sensors of the body model to control and steer flight. Our project is an open-source platform for modeling neural control of sensorimotor behavior in an embodied context.Competing Interest StatementThe authors have declared no competing interest.

    View Publication Page
    03/13/23 | Connectome-constrained deep mechanistic networks predict neural responses across the fly visual system at single-neuron resolution
    Janne K. Lappalainen , Fabian D. Tschopp , Sridhama Prakhya , Mason McGill , Aljoscha Nern , Kazunori Shinomiya , Shin-ya Takemura , Eyal Gruntman , Jakob H. Macke , Srinivas C. Turaga
    bioRxiv. 2023 Mar 13:. doi: 10.1101/2023.03.11.532232

    We can now measure the connectivity of every neuron in a neural circuit, but we are still blind to other biological details, including the dynamical characteristics of each neuron. The degree to which connectivity measurements alone can inform understanding of neural computation is an open question. Here we show that with only measurements of the connectivity of a biological neural network, we can predict the neural activity underlying neural computation. We constructed a model neural network with the experimentally determined connectivity for 64 cell types in the motion pathways of the fruit fly optic lobe but with unknown parameters for the single neuron and single synapse properties. We then optimized the values of these unknown parameters using techniques from deep learning, to allow the model network to detect visual motion. Our mechanistic model makes detailed experimentally testable predictions for each neuron in the connectome. We found that model predictions agreed with experimental measurements of neural activity across 24 studies. Our work demonstrates a strategy for generating detailed hypotheses about the mechanisms of neural circuit function from connectivity measurements. We show that this strategy is more likely to be successful when neurons are sparsely connected—a universally observed feature of biological neural networks across species and brain regions.

    View Publication Page
    02/01/23 | Local shape descriptors for neuron segmentation.
    Sheridan A, Nguyen TM, Deb D, Lee WA, Saalfeld S, Turaga SC, Manor U, Funke J
    Nature Methods. 2023 Feb 01;20(2):295-303. doi: 10.1038/s41592-022-01711-z

    We present an auxiliary learning task for the problem of neuron segmentation in electron microscopy volumes. The auxiliary task consists of the prediction of local shape descriptors (LSDs), which we combine with conventional voxel-wise direct neighbor affinities for neuron boundary detection. The shape descriptors capture local statistics about the neuron to be segmented, such as diameter, elongation, and direction. On a study comparing several existing methods across various specimen, imaging techniques, and resolutions, auxiliary learning of LSDs consistently increases segmentation accuracy of affinity-based methods over a range of metrics. Furthermore, the addition of LSDs promotes affinity-based segmentation methods to be on par with the current state of the art for neuron segmentation (flood-filling networks), while being two orders of magnitudes more efficient-a critical requirement for the processing of future petabyte-sized datasets.

    View Publication Page
    10/31/22 | FourierNets enable the design of highly non-local optical encoders for computational imaging
    Diptodip Deb , Zhenfei Jiao , Ruth R Sims , Alex Bo-Yuan Chen , Michael Broxton , Misha Ahrens , Kaspar Podgorski , Srinivas C Turaga , Alice H. Oh , Alekh Agarwal , Danielle Belgrave , Kyunghyun Cho
    Advances in Neural Information Processing Systems. 10/2022:. doi: https://doi.org/10.48550/arXiv.2104.10611

    Differentiable simulations of optical systems can be combined with deep learning-based reconstruction networks to enable high performance computational imaging via end-to-end (E2E) optimization of both the optical encoder and the deep decoder. This has enabled imaging applications such as 3D localization microscopy, depth estimation, and lensless photography via the optimization of local optical encoders. More challenging computational imaging applications, such as 3D snapshot microscopy which compresses 3D volumes into single 2D images, require a highly non-local optical encoder. We show that existing deep network decoders have a locality bias which prevents the optimization of such highly non-local optical encoders. We address this with a decoder based on a shallow neural network architecture using global kernel Fourier convolutional neural networks (FourierNets). We show that FourierNets surpass existing deep network based decoders at reconstructing photographs captured by the highly non-local DiffuserCam optical encoder. Further, we show that FourierNets enable E2E optimization of highly non-local optical encoders for 3D snapshot microscopy. By combining FourierNets with a large-scale multi-GPU differentiable optical simulation, we are able to optimize non-local optical encoders 170× to 7372× larger than prior state of the art, and demonstrate the potential for ROI-type specific optical encoding with a programmable microscope.

    View Publication Page
    09/28/21 | Connectome-constrained Latent Variable Model of Whole-Brain Neural Activity
    Lu Mi , Richard Xu , Sridhama Prakhya , Albert Lin , Nir Shavit , Aravinthan Samuel , Srinivas C Turaga
    International Conference on Learning Representations. 09/2021:

    The availability of both anatomical connectivity and brain-wide neural activity measurements in C. elegans make the worm a promising system for learning detailed, mechanistic models of an entire nervous system in a data-driven way. However, one faces several challenges when constructing such a model. We often do not have direct experimental access to important modeling details such as single-neuron dynamics and the signs and strengths of the synaptic connectivity. Further, neural activity can only be measured in a subset of neurons, often indirectly via calcium imaging, and significant trial-to-trial variability has been observed. To address these challenges, we introduce a connectome-constrained latent variable model (CC-LVM) of the unobserved voltage dynamics of the entire C. elegans nervous system and the observed calcium signals. We used the framework of variational autoencoders to fit parameters of the mechanistic simulation constituting the generative model of the LVM to calcium imaging observations. A variational approximate posterior distribution over latent voltage traces for all neurons is efficiently inferred using an inference network, and constrained by a prior distribution given by the biophysical simulation of neural dynamics. We applied this model to an experimental whole-brain dataset, and found that connectomic constraints enable our LVM to predict the activity of neurons whose activity were withheld significantly better than models unconstrained by a connectome. We explored models with different degrees of biophysical detail, and found that models with realistic conductance-based synapses provide markedly better predictions than current-based synapses for this system.

    View Publication Page
    09/03/21 | Deep learning enables fast and dense single-molecule localization with high accuracy
    Speiser A, Müller L, Matti U, Obara CJ, Legant WR, Kreshuk A, Macke JH, Ries J, Turaga SC
    Nature Methods. 2021 Sep 03;18(9):. doi: 10.1101/2020.10.26.355164

    Single-molecule localization microscopy (SMLM) has had remarkable success in imaging cellular structures with nanometer resolution, but the need for activating only single isolated emitters limits imaging speed and labeling density. Here, we overcome this major limitation using deep learning. We developed DECODE, a computational tool that can localize single emitters at high density in 3D with highest accuracy for a large range of imaging modalities and conditions. In a public software benchmark competition, it outperformed all other fitters on 12 out of 12 data-sets when comparing both detection accuracy and localization error, often by a substantial margin. DECODE allowed us to take live-cell SMLM data with reduced light exposure in just 3 seconds and to image microtubules at ultra-high labeling density. Packaged for simple installation and use, DECODE will enable many labs to reduce imaging times and increase localization density in SMLM.Competing Interest StatementThe authors have declared no competing interest.

    View Publication Page
    07/01/21 | Automatic Detection of Synaptic Partners in a Whole-Brain Drosophila EM Dataset
    Buhmann J, Sheridan A, Gerhard S, Krause R, Nguyen T, Heinrich L, Schlegel P, Lee WA, Wilson R, Saalfeld S, Jefferis G, Bock D, Turaga S, Cook M, Funke J
    Nature Methods. 2021 Jul 1;18(7):771-4. doi: 10.1038/s41592-021-01183-7

    The study of neural circuits requires the reconstruction of neurons and the identification of synaptic connections between them. To scale the reconstruction to the size of whole-brain datasets, semi-automatic methods are needed to solve those tasks. Here, we present an automatic method for synaptic partner identification in insect brains, which uses convolutional neural networks to identify post-synaptic sites and their pre-synaptic partners. The networks can be trained from human generated point annotations alone and requires only simple post-processing to obtain final predictions. We used our method to extract 244 million putative synaptic partners in the fifty-teravoxel full adult fly brain (FAFB) electron microscopy (EM) dataset and evaluated its accuracy on 146,643 synapses from 702 neurons with a total cable length of 312 mm in four different brain regions. The predicted synaptic connections can be used together with a neuron segmentation to infer a connectivity graph with high accuracy: 96% of edges between connected neurons are correctly classified as weakly connected (less than five synapses) and strongly connected (at least five synapses). Our synaptic partner predictions for the FAFB dataset are publicly available, together with a query library allowing automatic retrieval of up- and downstream neurons.

    View Publication Page
    04/21/21 | Community-based benchmarking improves spike rate inference from two-photon calcium imaging data
    Berens P, Freeman J, Deneux T, Chenkov N, McColgan T, Speiser A, Macke JH, Turaga SC, Mineault P, Rupprecht P, Gerhard S, Friedrich RW, Friedrich J, Paninski L, Pachitariu M, Harris KD, Bolte B, Machado TA, Ringach D, Stone J, Rogerson LE, Sofroniew NJ, Reimer J, Froudarakis E, Euler T, Román Rosón M, Theis L, Tolias AS, Bethge M, Bush D
    PLOS Computational Biology. Sep-05-2019;14(5):e1006157. doi: 10.1371/journal.pcbi.1006157

    In recent years, two-photon calcium imaging has become a standard tool to probe the function of neural circuits and to study computations in neuronal populations. However, the acquired signal is only an indirect measurement of neural activity due to the comparatively slow dynamics of fluorescent calcium indicators. Different algorithms for estimating spike rates from noisy calcium measurements have been proposed in the past, but it is an open question how far performance can be improved. Here, we report the results of the spikefinder challenge, launched to catalyze the development of new spike rate inference algorithms through crowd-sourcing. We present ten of the submitted algorithms which show improved performance compared to previously evaluated methods. Interestingly, the top-performing algorithms are based on a wide range of principles from deep neural networks to generative models, yet provide highly correlated estimates of the neural activity. The competition shows that benchmark challenges can drive algorithmic developments in neuroscience.

    View Publication Page
    01/01/20 | Comparative single-cell transcriptomics of complete insect nervous systems
    Cocanougher BT, Wittenbach JD, Long XS, Kohn AB, Norekian TP, Yan J, Colonell J, Masson J, Truman JW, Cardona A, Turaga SC, Singer RH, Moroz LL, Zlatic M
    bioRxiv. 01/2020:. doi: 10.1101/785931

    Molecular profiles of neurons influence information processing, but bridging the gap between genes, circuits, and behavior has been very difficult. Furthermore, the behavioral state of an animal continuously changes across development and as a result of sensory experience. How behavioral state influences molecular cell state is poorly understood. Here we present a complete atlas of the Drosophila larval central nervous system composed of over 200,000 single cells across four developmental stages. We develop polyseq, a python package, to perform cell-type analyses. We use single-molecule RNA-FISH to validate our scRNAseq findings. To investigate how internal state affects cell state, we optogentically altered internal state with high-throughput behavior protocols designed to mimic wasp sting and over activation of the memory system. We found nervous system-wide and neuron-specific gene expression changes. This resource is valuable for developmental biology and neuroscience, and it advances our understanding of how genes, neurons, and circuits generate behavior.

    View Publication Page