Within cells, the spatial compartmentalization of thousands of distinct proteins serves a multitude of diverse biochemical needs. Correlative super-resolution (SR) fluorescence and electron microscopy (EM) can elucidate protein spatial relationships to global ultrastructure, but has suffered from tradeoffs of structure preservation, fluorescence retention, resolution, and field of view. We developed a platform for three-dimensional cryogenic SR and focused ion beam-milled block-face EM across entire vitreously frozen cells. The approach preserves ultrastructure while enabling independent SR and EM workflow optimization. We discovered unexpected protein-ultrastructure relationships in mammalian cells including intranuclear vesicles containing endoplasmic reticulum-associated proteins, web-like adhesions between cultured neurons, and chromatin domains subclassified on the basis of transcriptional activity. Our findings illustrate the value of a comprehensive multimodal view of ultrastructural variability across whole cells.

The motor cortex controls skilled arm movement by sending temporal patterns of activity to lower motor centres. Local cortical dynamics are thought to shape these patterns throughout movement execution. External inputs have been implicated in setting the initial state of the motor cortex, but they may also have a pattern-generating role. Here we dissect the contribution of local dynamics and inputs to cortical pattern generation during a prehension task in mice. Perturbing cortex to an aberrant state prevented movement initiation, but after the perturbation was released, cortex either bypassed the normal initial state and immediately generated the pattern that controls reaching or failed to generate this pattern. The difference in these two outcomes was probably a result of external inputs. We directly investigated the role of inputs by inactivating the thalamus; this perturbed cortical activity and disrupted limb kinematics at any stage of the movement. Activation of thalamocortical axon terminals at different frequencies disrupted cortical activity and arm movement in a graded manner. Simultaneous recordings revealed that both thalamic activity and the current state of cortex predicted changes in cortical activity. Thus, the pattern generator for dexterous arm movement is distributed across multiple, strongly interacting brain regions.

Representation learning in neural networks may be implemented with supervised or unsupervised algorithms, distinguished by the availability of feedback. In sensory cortex, perceptual learning drives neural plasticity, but it is not known if this is due to supervised or unsupervised learning. Here we recorded populations of up to 90,000 neurons simultaneously from the primary visual cortex (V1) and higher visual areas (HVA), while mice learned multiple tasks as well as during unrewarded exposure to the same stimuli. Similar to previous studies, we found that neural changes in task mice were correlated with their behavioral learning. However, the neural changes were mostly replicated in mice with unrewarded exposure, suggesting that the changes were in fact due to unsupervised learning. The neural plasticity was concentrated in the medial HVAs and obeyed visual, rather than spatial, learning rules. In task mice only, we found a ramping reward prediction signal in anterior HVAs, potentially involved in supervised learning. Our neural results predict that unsupervised learning may accelerate subsequent task learning, a prediction which we validated with behavioral experiments.

Behavioral strategies employed for chemotaxis have been described across phyla, but the sensorimotor basis of this phenomenon has seldom been studied in naturalistic contexts. Here, we examine how signals experienced during free olfactory behaviors are processed by first-order olfactory sensory neurons (OSNs) of the Drosophila larva. We find that OSNs can act as differentiators that transiently normalize stimulus intensity-a property potentially derived from a combination of integral feedback and feed-forward regulation of olfactory transduction. In olfactory virtual reality experiments, we report that high activity levels of the OSN suppress turning, whereas low activity levels facilitate turning. Using a generalized linear model, we explain how peripheral encoding of olfactory stimuli modulates the probability of switching from a run to a turn. Our work clarifies the link between computations carried out at the sensory periphery and action selection underlying navigation in odor gradients.

Internal representations are thought to support the generation of flexible, long-timescale behavioral patterns in both animals and artificial agents. Here, we present a novel conceptual framework for how Drosophila use their internal representation of head direction to maintain preferred headings in their surroundings, and how they learn to modify these preferences in the presence of selective thermal reinforcement. To develop the framework, we analyzed flies’ behavior in a classical operant visual learning paradigm and found that they use stochastically generated fixations and directed turns to express their heading preferences. Symmetries in the visual scene used in the paradigm allowed us to expose how flies’ probabilistic behavior in this setting is tethered to their head direction representation. We describe how flies’ ability to quickly adapt their behavior to the rules of their environment may rest on a behavioral policy whose parameters are flexible but whose form is genetically encoded in the structure of their circuits. Many of the mechanisms we outline may also be relevant for rapidly adaptive behavior driven by internal representations in other animals, including mammals.

Many animals rely on an internal heading representation when navigating in varied environments. How this representation is linked to the sensory cues that define different surroundings is unclear. In the fly brain, heading is represented by 'compass' neurons that innervate a ring-shaped structure known as the ellipsoid body. Each compass neuron receives inputs from 'ring' neurons that are selective for particular visual features; this combination provides an ideal substrate for the extraction of directional information from a visual scene. Here we combine two-photon calcium imaging and optogenetics in tethered flying flies with circuit modelling, and show how the correlated activity of compass and visual neurons drives plasticity, which flexibly transforms two-dimensional visual cues into a stable heading representation. We also describe how this plasticity enables the fly to convert a partial heading representation, established from orienting within part of a novel setting, into a complete heading representation. Our results provide mechanistic insight into the memory-related computations that are essential for flexible navigation in varied surroundings.

The ability to measure synaptic connectivity and properties is essential for understanding neuronal circuits. However, existing methods that allow such measurements at cellular resolution are laborious and technically demanding. Here, we describe a system that allows such measurements in a high-throughput way by combining two-photon optogenetics and volumetric Ca2+ imaging with whole-cell recording. We reveal a circuit motif for generating fast undulatory locomotion in zebrafish.

Point-scanning two-photon microscopy enables high-resolution imaging within scattering specimens such as the mammalian brain, but sequential acquisition of voxels fundamentally limits imaging speed. We developed a two-photon imaging technique that scans lines of excitation across a focal plane at multiple angles and uses prior information to recover high-resolution images at over 1.4 billion voxels per second. Using a structural image as a prior for recording neural activity, we imaged visually-evoked and spontaneous glutamate release across hundreds of dendritic spines in mice at depths over 250 microns and frame-rates over 1 kHz. Dendritic glutamate transients in anaesthetized mice are synchronized within spatially-contiguous domains spanning tens of microns at frequencies ranging from 1-100 Hz. We demonstrate high-speed recording of acetylcholine and calcium sensors, 3D single-particle tracking, and imaging in densely-labeled cortex. Our method surpasses limits on the speed of raster-scanned imaging imposed by fluorescence lifetime.

Understanding information processing in the brain requires monitoring neuronal activity at high spatiotemporal resolution. Using an ultrafast two-photon fluorescence microscope empowered by all-optical laser scanning, we imaged neuronal activity in vivo at up to 3,000 frames per second and submicrometer spatial resolution. This imaging method enabled monitoring of both supra- and subthreshold electrical activity down to 345 μm below the brain surface in head-fixed awake mice.