Many animals navigate using optic flow, detecting rotational image velocity differences between their eyes to adjust direction. Forward locomotion produces strong symmetric translational optic flow that can mask these differences, yet the brain efficiently extracts these binocular asymmetries for course control. In Drosophila melanogaster, monocular horizontal system neurons facilitate detection of binocular asymmetries and contribute to steering. To understand these functions, we reconstructed horizontal system cells' central network using electron microscopy datasets, revealing convergent visual inputs, a recurrent inhibitory middle layer and a divergent output layer projecting to the ventral nerve cord and deeper brain regions. Two-photon imaging, GABA receptor manipulations and modeling, showed that lateral disinhibition reduces the output's translational sensitivity while enhancing its rotational selectivity. Unilateral manipulations confirmed the role of interneurons and descending outputs in steering. These findings establish competitive disinhibition as a key circuit mechanism for detecting rotational motion during translation, supporting navigation in dynamic environments.

Preprint: https://doi.org/10.1101/2023.08.06.552150

Modern algorithms for biological segmentation can match inter-human agreement in annotation quality. This however is not a performance bound: a hypothetical human-consensus segmentation could reduce error rates in half. To obtain a model that generalizes better we adapted the pretrained transformer backbone of a foundation model (SAM) to the Cellpose framework. The resulting Cellpose-SAM model substantially outperforms inter-human agreement and approaches the human-consensus bound. We increase generalization performance further by making the model robust to channel shuffling, cell size, shot noise, downsampling, isotropic and anisotropic blur. The new model can be readily adopted into the Cellpose ecosystem which includes finetuning, human-in-the-loop training, image restoration and 3D segmentation approaches. These properties establish Cellpose-SAM as a foundation model for biological segmentation.

In most complex nervous systems there is a clear anatomical separation between the nerve cord, which contains most of the final motor outputs necessary for behaviour, and the brain. In insects, the neck connective is both a physical and an information bottleneck connecting the brain and the ventral nerve cord (an analogue of the spinal cord) and comprises diverse populations of descending neurons (DNs), ascending neurons (ANs) and sensory ascending neurons, which are crucial for sensorimotor signalling and control. Here, by integrating three separate electron microscopy (EM) datasets, we provide a complete connectomic description of the ANs and DNs of the Drosophila female nervous system and compare them with neurons of the male nerve cord. Proofread neuronal reconstructions are matched across hemispheres, datasets and sexes. Crucially, we also match 51% of DN cell types to light-level data defining specific driver lines, as well as classifying all ascending populations. We use these results to reveal the anatomical and circuit logic of neck connective neurons. We observe connected chains of DNs and ANs spanning the neck, which may subserve motor sequences. We provide a complete description of sexually dimorphic DN and AN populations, with detailed analyses of selected circuits for reproductive behaviours, including male courtship (DNa12; also known as aSP22) and song production (AN neurons from hemilineage 08B) and female ovipositor extrusion (DNp13). Our work provides EM-level circuit analyses that span the entire central nervous system of an adult animal.

Synapses have undergone significant diversification and adaptation, contributing to the complexity of the central nervous system. Understanding their molecular architecture is essential for deciphering the brain's functional evolution. While nicotinic acetylcholine receptors (nAchRs) are widely distributed across metazoan brains, their associated protein networks remain poorly characterized. Using in vivo proximity labeling, we generated proteomic maps of subunit-specific nAchR interactomes in developing and mature brains. Our findings reveal a developmental expansion and reconfiguration of the nAchR interactome. Proteome profiling with genetic perturbations showed that removing individual nAchR subunits consistently triggers compensatory shifts in receptor subtypes, highlighting mechanisms of synaptic plasticity. We also identified the Rho-GTPase regulator Still life (Sif) as a key organizer of cholinergic synapses, with loss of Sif disrupting their molecular composition and structural integrity. These results provide molecular insights into the development and plasticity of central cholinergic synapses, advancing our understanding of synaptic identity conservation and divergence.

The body of an animal influences how its nervous system generates behavior1. Accurately modeling the neural control of sensorimotor behavior requires an anatomically detailed biomechanical representation of the body. Here, we introduce a whole-body model of the fruit fly Drosophila melanogaster in a physics simulator. Designed as a general-purpose framework, our model enables the simulation of diverse fly behaviors, including both terrestrial and aerial locomotion. We validate its versatility by replicating realistic walking and flight behaviors. To support these behaviors, we develop new phenomenological models for fluid and adhesion forces. Using data-driven, end-to-end reinforcement learning we train neural network controllers capable of generating naturalistic locomotion along complex trajectories in response to high-level steering commands. Additionally, we show the use of visual sensors and hierarchical motor control, training a high-level controller to reuse a pre-trained low-level flight controller to perform visually guided flight tasks. Our model serves as an open-source platform for studying the neural control of sensorimotor behavior in an embodied context.

Preprint: www.biorxiv.org/content/early/2024/03/14/2024.03.11.584515

The spatial distribution of diverse biomolecules in multicellular organisms is essential for their physiological functions. High-throughput in situ mapping of biomolecules is crucial for both basic and medical research, and requires high scanning speed, spatial resolution, and chemical sensitivity. Here, we developed a Tissue Expansion method compatible with matrix-assisted laser desorption/ionization Mass spectrometry Imaging (TEMI). TEMI reaches single-cell spatial resolution without sacrificing voxel throughput and enables the profiling of hundreds of biomolecules, including lipids, metabolites, peptides (proteins), and N-glycans. Using TEMI, we mapped the spatial distribution of biomolecules across various mammalian tissues and uncovered metabolic heterogeneity in tumors. TEMI can be easily adapted and broadly applied in biological and medical research, to advance spatial multi-omics profiling.

Preprint: 10.1101/2025.02.22.639343

Circulating tumor cells (CTCs) are critical biomarkers for predicting therapy response and survival in breast cancer patients. Multicellular CTC clusters exhibit enhanced metastatic potential, yet their detection and characterization are constrained by low frequency in blood samples and reliance on labor-intensive manual analysis. Advancing these methods could significantly improve prognostic evaluation and therapeutic strategies.Leveraging FDA-approved CellSearch technology and single-cell sequencing, we analyzed 2, 853 blood specimens, longitudinally collected from 1358 patients with advanced cancer (breast, prostate, etc) and other diseases. Integrating machine learning and deep learning tools, we developed a novel CTCpose platform to automate detection and analysis of CTCs, immune cells, and their interactions. Using artificial intelligence (AI)-driven image analysis, we extracted over 270 cellular and nuclear features including intensity, morphometry, fourier shape, gradient/edge, and haralick of cytokeratin, CD45, and DAPI expression patterns, enabling precise characterization of CTCs, white blood cells (WBCs), CTC clusters, and their interactions with immune cells (WBCs).The CTCpose platform enabled automated identification of CTCs, WBCs, homotypic CTC clusters, heterogenous CTC-WBC clusters, and immune cell clusters, providing comprehensive insights into cell morphology, biomarker expression, and spatial organization. These features correlated with patient survival, disease progression, and treatment response. Our findings highlight the clinical significance of CTC-immune cell interactions and dynamic alterations of CTCs (singles and clusters) and underscore their potential in stratifying patients into distinct risk categories.This study demonstrates the transformative potential of deep learning in overcoming limitations of traditional CTC detection methods and integrating imaging data with large cohorts of patient data. By automating and enhancing the analysis of CTC-immune cell interactions, we present a robust framework for developing predictive models with direct clinical relevance. This work opens avenues for personalized treatment strategies, underscoring the impact of AI in advancing precision oncology.Yuanfei Sun, Joshua R. Squires, Andrew Hoffmann, Youbin Zhang, Allegra Minor, Anmol Singh, David Scholten, Chengsheng Mao, Yuan Luo, Deyu Fang, William J. Gradishar, Massimo Cristofanilli, Carsen Stringer, Huiping Liu. Deep learning enables automated detection of circulating tumor cell-immune cell interactions with prognostic insights in cancer [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2025; Part 1 (Regular Abstracts); 2025 Apr 25-30; Chicago, IL. Philadelphia (PA): AACR; Cancer Res 2025;85(8_Suppl_1):Abstract nr 2420.

The central nervous system can generate various behaviors, including motor responses, which we can observe through video recordings. Recent advances in gene manipulation, automated behavioral acquisition at scale, and machine learning enable us to causally link behaviors to their underlying neural mechanisms. Moreover, in some animals, such as the Drosophila melanogaster larva, this mapping is possible at the unprecedented scale of single neurons, allowing us to identify the neural microcircuits generating particular behaviors. These high-throughput screening efforts, linking the activation or suppression of specific neurons to behavioral patterns in millions of animals, provide a rich dataset to explore the diversity of nervous system responses to the same stimuli. However, important challenges remain in identifying subtle behaviors, including immediate and delayed responses to neural activation or suppression, and understanding these behaviors on a large scale. We here introduce several statistically robust methods for analyzing behavioral data in response to these challenges: 1) A generative physical model that regularizes the inference of larval shapes across the entire dataset. 2) An unsupervised kernel-based method for statistical testing in learned behavioral spaces aimed at detecting subtle deviations in behavior. 3) A generative model for larval behavioral sequences, providing a benchmark for identifying higher-order behavioral changes. 4) A comprehensive analysis technique using suffix trees to categorize genetic lines into clusters based on common action sequences. We showcase these methodologies through a behavioral screen focused on responses to an air puff, analyzing data from 280 716 larvae across 569 genetic lines.

Preprint: https://www.biorxiv.org/content/10.1101/2024.05.03.591825v1

Intermediate filaments (IFs) play key roles in cellular mechanics, signaling, and organization, but tools for their rapid, selective disassembly remain limited. Here, we introduce FilaBuster, a photochemical approach for efficient and spatiotemporally controlled IF disassembly in living cells. FilaBuster uses a three-step strategy: (1) targeting HaloTag to IFs, (2) labeling with a covalent photosensitizer ligand, and (3) light-induced generation of localized reactive oxygen species to trigger filament disassembly. This modular strategy applies broadly across IF subtypes—including vimentin, GFAP, desmin, peripherin, and keratin 18—and is compatible with diverse dyes and imaging platforms. Using vimentin IFs as a model system, we establish a baseline implementation in which vimentin-HaloTag labeled with a photosensitizer HaloTag ligand triggers rapid and specific IF disassembly upon light activation. We then refine this approach by (i) expanding targeting strategies to include a vimentin nanobody-HaloTag fusion, (ii) broadening the range of effective photosensitizers, and (iii) optimizing irradiation parameters to enable precise spatial control over filament disassembly. Together, these findings position FilaBuster as a robust platform for acute, selective, and spatiotemporally precise disassembly of IF networks, enabling new investigations into their structural and functional roles in cell physiology and disease.

Sample-induced aberrations and optical imperfections limit the resolution of fluorescence microscopy. Phase diversity is a powerful technique that leverages complementary phase information in sequentially acquired images with deliberately introduced aberrations--the phase diversities--to enable phase and object reconstruction and restore diffraction-limited resolution. These phase diversities are typically introduced into the optical path via a deformable mirror. Existing phase-diversity-based methods are limited to Zernike modes, require large numbers of diversity images, or depend on accurate mirror calibration--which are all suboptimal. We present DeepPD, a deep learning-based framework that combines neural representations of the object and wavefront with a learned model of the deformable mirror to jointly estimate both object and phase from only five images. DeepPD improves robustness and reconstruction quality over previous approaches, even under severe aberrations. We demonstrate its performance on calibration targets and biological samples, including immunolabeled myosin in fixed PtK2 cells.