Filter
Associated Lab
- Betzig Lab (1) Apply Betzig Lab filter
- Beyene Lab (1) Apply Beyene Lab filter
- Hess Lab (1) Apply Hess Lab filter
- Lavis Lab (3) Apply Lavis Lab filter
- Liu (Zhe) Lab (3) Apply Liu (Zhe) Lab filter
- O'Shea Lab (3) Apply O'Shea Lab filter
- Saalfeld Lab (1) Apply Saalfeld Lab filter
- Shroff Lab (3) Apply Shroff Lab filter
- Spruston Lab (1) Apply Spruston Lab filter
- Sternson Lab (2) Apply Sternson Lab filter
- Svoboda Lab (2) Apply Svoboda Lab filter
- Tillberg Lab (3) Apply Tillberg Lab filter
Associated Project Team
Associated Support Team
- Anatomy and Histology (1) Apply Anatomy and Histology filter
- Cryo-Electron Microscopy (1) Apply Cryo-Electron Microscopy filter
- Electron Microscopy (1) Apply Electron Microscopy filter
- Remove Integrative Imaging filter Integrative Imaging
- Project Technical Resources (1) Apply Project Technical Resources filter
- Scientific Computing (1) Apply Scientific Computing filter
- Stem Cell & Primary Culture (2) Apply Stem Cell & Primary Culture filter
- Viral Tools (3) Apply Viral Tools filter
23 Janelia Publications
Showing 1-10 of 23 resultsSpectral information plays a crucial role in biological imaging, yet conventional epifluorescence and histological techniques often rely on RGB image acquisition, limiting the resolution of spectrally overlapping components. Here, we present a phasor-based spectral analysis framework adapted for RGB images, enabling unsupervised segmentation and unmixing without the need for hyperspectral systems or sequential acquisition. By applying a discrete Fourier transform to the red, green, and blue intensities at each pixel, we generate a two-dimensional phasor plot where spectral relationships are encoded in modulation and phase. We demonstrate the utility of this approach across three distinct applications: segmentation of lung histology images stained with hematoxylin and eosin to quantify alveolar collapse, analysis of autofluorescence in skin lesions (nevi and melanoma) to highlight pathological spectral signatures, and spectral unmixing in multicolor-labeled U2OS cells to resolve overlapping fluorophores. Our method improves signal separation, reduces noise, and enhances biological interpretability using standard RGB acquisition. These findings establish RGB phasor analysis as a practical and powerful tool for spectral decomposition and segmentation in microscopy, bridging the gap between conventional imaging and advanced spectral analysis.
The global microscopy community has made wide efforts in imaging technology dissemination, especially to lower- and middle-income countries. Yet, many efforts have not fully realised their aim of increased, sustained microscopy utilisation. To guide future outreach initiatives towards more positive results, we analysed over 2300 unique applications across seven recent international microscopy workshops. We found significant differences in research priorities, as well as in microscopy experience and applications between lower- and higher-income regions. We discuss the importance of tailoring technology dissemination, training curricula, and capacity-building to these regional variations.
Light sheet fluorescence microscopy (LSFM) is increasingly appreciated as the gold standard for gentle, volumetric imaging with fast acquisition speeds and/or long imaging durations. However, the often-constrained sample space of these microscopes has precluded a specific class of biological specimens from being studied with these tools: those requiring an air-liquid interface (ALI). Here, we present a device for robust imaging at ALI on an upright light sheet microscope with dipping objectives. We demonstrate the system using three relevant use-cases: ex vivo embryonic mouse salivary glands, human epidermal equivalent cultures, and in vivo adult Drosophila melanogaster brains. While the device presented is engineered for one specific light sheet microscope design, it provides a blueprint for easy adaptation to other systems. In doing so, it can potentially spur the use of LSFM for model systems that have so far been unable to take advantage of this powerful technology.
Motion is an essential component of any living system. It is rich with information, but it is often challenging to quantitatively extract biologically informative results from the motion apparent in microscopy images. This challenge is exacerbated by the wide variety in biological movement, which often takes the form of difficult-to-segment amorphous structures undergoing complex motion. An image processing technique known as optical flow can capture motion at each pixel in an image, thus bypassing the need for object segmentation or a priori definition of motion types. This makes it a powerful tool for quantitative assessment of biological systems from the protein to organism scale. However, despite its flexibility and strengths for analyzing fluorescence microscopy images, its adoption in the bioimaging community has been limited by the availability of easy-to-use tools and guidance in results interpretation. Here we describe an optical flow tool, OpticalFlow3D, that can be run in Python or MATLAB and is compatible with three-dimensional microscopy images. Using biological examples across length scales, we illustrate how OpticalFlow3D can enable new biological insight.
To form a blood clot, fibrinogen is converted into fibrin through the action of the enzyme thrombin. Fibrin then polymerizes longitudinally and laterally as it matures into a fiber. Polymerization results in a dense, 3-dimensional branched network. Previous research has shown the relevance of these fibrin gel structures in hemostatic conditions; however, the mechanism by which they form has not been fully resolved. Using light sheet microscopy, 3-dimensional volumes of the fibrin polymerization process were captured. Manual annotation of these microscopy videos revealed that fiber branch points occur through the collision and the binding of diffusing fibers rather than through the splitting of growing fiber termini. However, the density of fibers and amount of data greatly slows manual annotation-based analysis and limits the ability to capture important data, such as growth rates and fiber stiffness. To more quickly process these data, a computational approach was utilized. A custom tracking pipeline, suited to the networks formed by cylindrical fibrin fibers, was developed, beginning with an AI-based classifier. This custom pipeline allowed for the tracking of uniquely labeled fibers over time. Automated merge detection between linking phases further improved accuracy. Additionally, network formation was analyzed through skeletonization techniques to measure the number of branches per junction over time. Combining the skeletonization and tracking methods, single fibers were identified by their lack of branch points and tracked. The addition of branch points to previously tracked objects served as a signal for merge detection. This approach yielded measurements of single fibrin fiber diffusion rates, as well as the first volumetric and length growth rates of fibers throughout polymerization. In addition, the gel point was quantified by analyzing the span of connected objects to characterize the network consolidation over time at the level of single fibers.
Whether recovering after a gust of wind, or rapidly saccading away from an oncoming predator, fruit flies show remarkable aerial dexterity about their body roll axis. Here, we investigated the detailed wing kinematic changes during free-flight roll motion and probed the neuromuscular basis for such changes. Consistent with previous work, we observed that flies manipulated the stroke amplitude difference between their wings to control their roll angle. Here, we show that flies are capable of achieving such changes by altering the stroke amplitude of either or both of their wings. Further we found that during corrections flies can also take advantage of an aerodynamically significant change in the angle of attack of their uppermost wing. Curiously, these corrective wing changes cannot be eliminated when motor neurons hypothesized to be used during roll maneuvers (i1, i2, b1, b2, and b3) are individually inhibited. However, free-flight optogenetic manipulations and quasi-steady aerodynamic calculations show that each of these motor neurons individually can effect kinematic changes consistent with a roll correction. Combining this evidence with an analysis of haltere inputs found in the BANC connectome, we propose that the observed robustness could be the result of two sets of muscular redundancies that receive shared inputs from haltere sensory afferents: one set, containing b1 and b2, is able to increase the stroke amplitude of the lower wing; while the other set, containing i1, i2, and b3, is able to decrease the stroke amplitude and wing pitch angle of the upper wing. Because of the redundancy in the input sensory information and output wing motion in the muscles in each cluster, the fly is able to perform roll stability maneuvers even when one of the constituent motor neurons is inhibited. This framework proposes new ways fast aerial maneuverability can be implemented when dealing with the fly’s most unstable rotational degree of freedom.
Fluorescence microscopy is essential for biological research, offering high-contrast imaging of microscopic structures. However, the quality of these images is often compromised by optical aberrations and noise, particularly in low signal-to-noise ratio (SNR) conditions. While adaptive optics (AO) can correct aberrations, it requires costly hardware and slows down imaging; whereas current denoising approaches boost the SNR but leave out the aberration compensation. To address these limitations, we introduce HD2Net, a deep learning framework that enhances image quality by simultaneously denoising and suppressing the effect of aberrations without the need for additional hardware. Building on our previous work, HD2Net incorporates noise estimation and aberration removal modules, effectively restoring images degraded by noise and aberrations. Through comprehensive evaluation of synthetic phantoms and biological data, we demonstrate that HD2Net outperforms existing methods, significantly improving image resolution and contrast. This framework offers a promising solution for enhancing biological imaging, particularly in challenging aberrating and low-light conditions.
Optical aberrations hinder fluorescence microscopy of thick samples, reducing image signal, contrast, and resolution. Here we introduce a deep learning-based strategy for aberration compensation, improving image quality without slowing image acquisition, applying additional dose, or introducing more optics. Our method (i) introduces synthetic aberrations to images acquired on the shallow side of image stacks, making them resemble those acquired deeper into the volume and (ii) trains neural networks to reverse the effect of these aberrations. We use simulations and experiments to show that applying the trained ‘de-aberration’ networks outperforms alternative methods, providing restoration on par with adaptive optics techniques; and subsequently apply the networks to diverse datasets captured with confocal, light-sheet, multi-photon, and super-resolution microscopy. In all cases, the improved quality of the restored data facilitates qualitative image inspection and improves downstream image quantitation, including orientational analysis of blood vessels in mouse tissue and improved membrane and nuclear segmentation in C. elegans embryos.
Fluorescence microscopy is essential for biological research, offering high-contrast imaging of microscopic structures. However, the quality of these images is often compromised by optical aberrations and noise, particularly in low signal-to-noise ratio (SNR) conditions. While adaptive optics (AO) can correct aberrations, it requires costly hardware and slows down imaging; whereas current denoising approaches boost the SNR but leave out the aberration compensation. To address these limitations, we introduce HD2Net, a deep learning framework that enhances image quality by simultaneously denoising and suppressing the effect of aberrations without the need for additional hardware. Building on our previous work, HD2Net incorporates noise estimation and aberration removal modules, effectively restoring images degraded by noise and aberrations. Through comprehensive evaluation of synthetic phantoms and biological data, we demonstrate that HD2Net outperforms existing methods, significantly improving image resolution and contrast. This framework offers a promising solution for enhancing biological imaging, particularly in challenging aberrating and low-light conditions.
Dopamine is a key chemical neuromodulator that plays vital roles in various brain functions. Traditionally, neuromodulators like dopamine are believed to be released in a diffuse manner and are not commonly associated with synaptic structures where pre- and postsynaptic processes are closely aligned. Our findings challenge this conventional view. Using single-bouton optical measurements of dopamine release, we discovered that dopamine is predominantly released from varicosities that are juxtaposed against the processes of their target neurons. Dopamine axons specifically target neurons expressing dopamine receptors, forming synapses to release dopamine. Interestingly, varicosities that were not directly apposed to dopamine receptor-expressing processes or associated with neurons lacking dopamine receptors did not release dopamine, regardless of their vesicle content. The ultrastructure of dopamine release sites share common features of classical synapses. We further show that the dopamine released at these contact sites induces a precise, dopamine-gated biochemical response in the target processes. Our results indicate that dopamine release sites share key characteristics of conventional synapses that enable relatively precise and efficient neuromodulation of their targets.
