Main Menu (Mobile)- Block

Main Menu - Block

janelia7_blocks-janelia7_fake_breadcrumb | block
Liu Lab / Publications
custom | custom

Filter

facetapi-Q2b17qCsTdECvJIqZJgYMaGsr8vANl1n | block

Associated Lab

facetapi-W9JlIB1X0bjs93n1Alu3wHJQTTgDCBGe | block
facetapi-PV5lg7xuz68EAY8eakJzrcmwtdGEnxR0 | block
facetapi-021SKYQnqXW6ODq5W5dPAFEDBaEJubhN | block
general_search_page-panel_pane_1 | views_panes

4067 Publications

Showing 4021-4030 of 4067 results
07/18/16 | Whole-animal imaging with high spatio-temporal resolution.
Chhetri R, Amat F, Wan Y, Höckendorf B, Lemon WC, Keller PJ
Proceedings of SPIE. 2016 Jul 18;9720:97200R. doi: 10.1117/12.2212564

We developed isotropic multiview (IsoView) light-sheet microscopy in order to image fast cellular dynamics, such as cell movements in an entire developing embryo or neuronal activity throughput an entire brain or nervous system, with high resolution in all dimensions, high imaging speeds, good physical coverage and low photo-damage. To achieve high temporal resolution and high spatial resolution at the same time, IsoView microscopy rapidly images large specimens via simultaneous light-sheet illumination and fluorescence detection along four orthogonal directions. In a post-processing step, these four views are then combined by means of high-throughput multiview deconvolution to yield images with a system resolution of ≤ 450 nm in all three dimensions. Using IsoView microscopy, we performed whole-animal functional imaging of Drosophila embryos and larvae at a spatial resolution of 1.1-2.5 μm and at a temporal resolution of 2 Hz for up to 9 hours. We also performed whole-brain functional imaging in larval zebrafish and multicolor imaging of fast cellular dynamics across entire, gastrulating Drosophila embryos with isotropic, sub-cellular resolution. Compared with conventional (spatially anisotropic) light-sheet microscopy, IsoView microscopy improves spatial resolution at least sevenfold and decreases resolution anisotropy at least threefold. Compared with existing high-resolution light-sheet techniques, such as lattice lightsheet microscopy or diSPIM, IsoView microscopy effectively doubles the penetration depth and provides subsecond temporal resolution for specimens 400-fold larger than could previously be imaged.

View Publication Page
11/22/24 | Whole-body simulation of realistic fruit fly locomotion with deep reinforcement learning
Vaxenburg R, Siwanowicz I, Merel J, Robie AA, Morrow C, Novati G, Stefanidi Z, Both G, Card GM, Reiser MB, Botvinick MM, Branson KM, Tassa Y, Turaga SC
bioRxiv. 2024 Nov 22:. doi: 10.1101/2024.03.11.584515

The body of an animal influences how the nervous system produces behavior. Therefore, detailed modeling of the neural control of sensorimotor behavior requires a detailed model of the body. Here we contribute an anatomically-detailed biomechanical whole-body model of the fruit fly Drosophila melanogaster in the MuJoCo physics engine. Our model is general-purpose, enabling the simulation of diverse fly behaviors, both on land and in the air. We demonstrate the generality of our model by simulating realistic locomotion, both flight and walking. To support these behaviors, we have extended MuJoCo with phenomenological models of fluid forces and adhesion forces. Through data-driven end-to-end reinforcement learning, we demonstrate that these advances enable the training of neural network controllers capable of realistic locomotion along complex trajectories based on high-level steering control signals. We demonstrate the use of visual sensors and the re-use of a pre-trained general-purpose flight controller by training the model to perform visually guided flight tasks. Our project is an open-source platform for modeling neural control of sensorimotor behavior in an embodied context.Competing Interest StatementThe authors have declared no competing interest.

View Publication Page
04/23/25 | Whole-body simulation of realistic fruit fly locomotion with deep reinforcement learning
Roman Vaxenburg , Igor Siwanowicz , Josh Merel , Alice A Robie , Carmen Morrow , Guido Novati , Zinovia Stefanidi , Gwyneth M Card , Michael B Reiser , Matthew M Botvinick , Kristin M Branson , Yuval Tassa , Srinivas C Turaga
Nature. 2025 Apr 23:. doi: 10.1038/s41586-025-09029-4

The body of an animal influences how its nervous system generates behavior1. Accurately modeling the neural control of sensorimotor behavior requires an anatomically detailed biomechanical representation of the body. Here, we introduce a whole-body model of the fruit fly Drosophila melanogaster in a physics simulator. Designed as a general-purpose framework, our model enables the simulation of diverse fly behaviors, including both terrestrial and aerial locomotion. We validate its versatility by replicating realistic walking and flight behaviors. To support these behaviors, we develop new phenomenological models for fluid and adhesion forces. Using data-driven, end-to-end reinforcement learning we train neural network controllers capable of generating naturalistic locomotion along complex trajectories in response to high-level steering commands. Additionally, we show the use of visual sensors and hierarchical motor control, training a high-level controller to reuse a pre-trained low-level flight controller to perform visually guided flight tasks. Our model serves as an open-source platform for studying the neural control of sensorimotor behavior in an embodied context.

 

Preprint: www.biorxiv.org/content/early/2024/03/14/2024.03.11.584515

View Publication Page
Fitzgerald Lab
09/14/15 | Whole-brain activity mapping onto a zebrafish brain atlas.
Randlett O, Wee CL, Naumann EA, Nnaemeka O, Schoppik D, Fitzgerald JE, Portugues R, Lacoste AM, Riegler C, Engert F, Schier AF
Nature methods. 2015 Nov;12(11):1039-46. doi: 10.1038/nmeth.3581

In order to localize the neural circuits involved in generating behaviors, it is necessary to assign activity onto anatomical maps of the nervous system. Using brain registration across hundreds of larval zebrafish, we have built an expandable open-source atlas containing molecular labels and definitions of anatomical regions, the Z-Brain. Using this platform and immunohistochemical detection of phosphorylated extracellular signal–regulated kinase (ERK) as a readout of neural activity, we have developed a system to create and contextualize whole-brain maps of stimulus- and behavior-dependent neural activity. This mitogen-activated protein kinase (MAP)-mapping assay is technically simple, and data analysis is completely automated. Because MAP-mapping is performed on freely swimming fish, it is applicable to studies of nearly any stimulus or behavior. Here we demonstrate our high-throughput approach using pharmacological, visual and noxious stimuli, as well as hunting and feeding. The resultant maps outline hundreds of areas associated with behaviors.

View Publication Page
05/01/13 | Whole-brain functional imaging at cellular resolution using light-sheet microscopy.
Ahrens MB, Orger MB, Robson DN, Li JM, Keller PJ
Nature Methods. 2013 May;10(5):413-20. doi: 10.1038/nmeth.2434

Brain function relies on communication between large populations of neurons across multiple brain areas, a full understanding of which would require knowledge of the time-varying activity of all neurons in the central nervous system. Here we use light-sheet microscopy to record activity, reported through the genetically encoded calcium indicator GCaMP5G, from the entire volume of the brain of the larval zebrafish in vivo at 0.8 Hz, capturing more than 80% of all neurons at single-cell resolution. Demonstrating how this technique can be used to reveal functionally defined circuits across the brain, we identify two populations of neurons with correlated activity patterns. One circuit consists of hindbrain neurons functionally coupled to spinal cord neuropil. The other consists of an anatomically symmetric population in the anterior hindbrain, with activity in the left and right halves oscillating in antiphase, on a timescale of 20 s, and coupled to equally slow oscillations in the inferior olive.

View Publication Page
05/06/20 | Whole-brain profiling of cells and circuits in mammals by tissue clearing and light-sheet microscopy.
Ueda HR, Dodt H, Osten P, Economo MN, Chandrashekar J, Keller PJ
Neuron. 2020 May 06;106(3):369-387. doi: 10.1016/j.neuron.2020.03.004

Tissue clearing and light-sheet microscopy have a 100-year-plus history, yet these fields have been combined only recently to facilitate novel experiments and measurements in neuroscience. Since tissue-clearing methods were first combined with modernized light-sheet microscopy a decade ago, the performance of both technologies has rapidly improved, broadening their applications. Here, we review the state of the art of tissue-clearing methods and light-sheet microscopy and discuss applications of these techniques in profiling cells and circuits in mice. We examine outstanding challenges and future opportunities for expanding these techniques to achieve brain-wide profiling of cells and circuits in primates and humans. Such integration will help provide a systems-level understanding of the physiology and pathology of our central nervous system.

View Publication Page
05/06/20 | Whole-brain profiling of cells and circuits in mammals by tissue clearing and light-sheet microscopy.
Ueda HR, Dodt H, Osten P, Economo MN, Chandrashekar J, Keller PJ
Neuron. 2020 May 06;106(3):369-387. doi: 10.1016/j.neuron.2020.03.004

Tissue clearing and light-sheet microscopy have a 100-year-plus history, yet these fields have been combined only recently to facilitate novel experiments and measurements in neuroscience. Since tissue-clearing methods were first combined with modernized light-sheet microscopy a decade ago, the performance of both technologies has rapidly improved, broadening their applications. Here, we review the state of the art of tissue-clearing methods and light-sheet microscopy and discuss applications of these techniques in profiling cells and circuits in mice. We examine outstanding challenges and future opportunities for expanding these techniques to achieve brain-wide profiling of cells and circuits in primates and humans. Such integration will help provide a systems-level understanding of the physiology and pathology of our central nervous system.

View Publication Page
05/18/17 | Whole-brain serial-section electron microscopy in larval zebrafish.
Hildebrand DG, Cicconet M, Torres RM, Choi W, Quan TM, Moon J, Wetzel AW, Scott Champion A, Graham BJ, Randlett O, Plummer GS, Portugues R, Bianco IH, Saalfeld S, Baden AD, Lillaney K, Burns R, Vogelstein JT, Schier AF, Lee WA, Jeong W, Lichtman JW, Engert F
Nature. 2017 May 18;545(7654):345-349. doi: 10.1038/nature22356

High-resolution serial-section electron microscopy (ssEM) makes it possible to investigate the dense meshwork of axons, dendrites, and synapses that form neuronal circuits. However, the imaging scale required to comprehensively reconstruct these structures is more than ten orders of magnitude smaller than the spatial extents occupied by networks of interconnected neurons, some of which span nearly the entire brain. Difficulties in generating and handling data for large volumes at nanoscale resolution have thus restricted vertebrate studies to fragments of circuits. These efforts were recently transformed by advances in computing, sample handling, and imaging techniques, but high-resolution examination of entire brains remains a challenge. Here, we present ssEM data for the complete brain of a larval zebrafish (Danio rerio) at 5.5 days post-fertilization. Our approach utilizes multiple rounds of targeted imaging at different scales to reduce acquisition time and data management requirements. The resulting dataset can be analysed to reconstruct neuronal processes, permitting us to survey all myelinated axons (the projectome). These reconstructions enable precise investigations of neuronal morphology, which reveal remarkable bilateral symmetry in myelinated reticulospinal and lateral line afferent axons. We further set the stage for whole-brain structure-function comparisons by co-registering functional reference atlases and in vivo two-photon fluorescence microscopy data from the same specimen. All obtained images and reconstructions are provided as an open-access resource.

View Publication Page
03/30/25 | Whole-brain, all-optical interrogation of neuronal dynamics underlying gut interoception in zebrafish
Chen W, James B, Ruetten VM, Banala S, Wei Z, Fleishman G, Rubinov M, Fishman MC, Engert F, Lavis LD, Fitzgerald JE, Ahrens MB
bioRxiv. 2025 Mar 30:. doi: 10.1101/2025.03.26.645305

Internal signals from the body and external signals from the environment are processed by brain-wide circuits to guide behavior. However, the complete brain-wide circuit activity underlying interoception—the perception of bodily signals—and its interactions with sensorimotor circuits remain unclear due to technical barriers to accessing whole-brain activity at the cellular level during organ physiology perturbations. We developed an all-optical system for whole-brain neuronal imaging in behaving larval zebrafish during optical uncaging of gut-targeted nutrients and visuo-motor stimulation. Widespread neural activity throughout the brain encoded nutrient delivery, unfolding on multiple timescales across many specific peripheral and central regions. Evoked activity depended on delivery location and occurred with amino acids and D-glucose, but not L-glucose. Many gut-sensitive neurons also responded to swimming and visual stimuli, with brainstem areas primarily integrating gut and motor signals and midbrain regions integrating gut and visual signals. This platform links body-brain communication studies to brain-wide neural computation in awake, behaving vertebrates.

View Publication Page
11/01/21 | Whole-cell organelle segmentation in volume electron microscopy.
Heinrich L, Bennett D, Ackerman D, Park W, Bogovic J, Eckstein N, Petruncio A, Clements J, Pang S, Xu CS, Funke J, Korff W, Hess HF, Lippincott-Schwartz J, Saalfeld S, Weigel AV, COSEM Project Team
Nature. 2021 Nov 01;599(7883):141-46. doi: 10.1038/s41586-021-03977-3

Cells contain hundreds of organelles and macromolecular assemblies. Obtaining a complete understanding of their intricate organization requires the nanometre-level, three-dimensional reconstruction of whole cells, which is only feasible with robust and scalable automatic methods. Here, to support the development of such methods, we annotated up to 35 different cellular organelle classes-ranging from endoplasmic reticulum to microtubules to ribosomes-in diverse sample volumes from multiple cell types imaged at a near-isotropic resolution of 4 nm per voxel with focused ion beam scanning electron microscopy (FIB-SEM). We trained deep learning architectures to segment these structures in 4 nm and 8 nm per voxel FIB-SEM volumes, validated their performance and showed that automatic reconstructions can be used to directly quantify previously inaccessible metrics including spatial interactions between cellular components. We also show that such reconstructions can be used to automatically register light and electron microscopy images for correlative studies. We have created an open data and open-source web repository, 'OpenOrganelle', to share the data, computer code and trained models, which will enable scientists everywhere to query and further improve automatic reconstruction of these datasets.

View Publication Page