Recent success in training artificial agents and robots derives from a combination of direct learning of behavioral policies and indirect learning via value functions. Policy learning and value learning employ distinct algorithms that optimize behavioral performance and reward prediction, respectively. In animals, behavioral learning and the role of mesolimbic dopamine signaling have been extensively evaluated with respect to reward prediction; however, to date there has been little consideration of how direct policy learning might inform our understanding. Here we used a comprehensive dataset of orofacial and body movements to understand how behavioral policies evolve as naive, head-restrained mice learned a trace conditioning paradigm. Individual differences in initial dopaminergic reward responses correlated with the emergence of learned behavioral policy, but not the emergence of putative value encoding for a predictive cue. Likewise, physiologically-calibrated manipulations of mesolimbic dopamine produced multiple effects inconsistent with value learning but predicted by a neural network-based model that used dopamine signals to set an adaptive rate, not an error signal, for behavioral policy learning. This work provides strong evidence that phasic dopamine activity can regulate direct learning of behavioral policies, expanding the explanatory power of reinforcement learning models for animal learning.

Understanding live-cell behavior in part requires high precision mapping of molecular species in 3-D dynamic environments. Approaches like single-molecule localization microscopy (SMLM) offer high promise for challenges posed by molecular cartography. Effectively, the precision of these approaches is dependent on the how many photons / second a fluorescent marker is capable of emitting. For this reason, many SRLM experiments are typically done using fluorescent organic dyes (such as Alexa Fluors) in reducing chemical environments which cause some organic dyes to stochastically cycle through dark states, allowing single-molecule localization (e.g. (d)STORM). The need to couple these dyes to antibodies and the harsh reducing conditions makes their application to live cell work problematic. To overcome these limitations, we made use of modifications to Janelia Fluor-based dyes which make them spontaneously cycle through dark states (blink) under physiological imaging conditions. The dyes are spectrally compatible with photo-activatable fluorescent proteins such as mEos and allow for simultaneous 2-color superresolution microscopy. When conjugated to a HaloTag, these artificial dyes can bind genetically encodable targets in live samples, allowing subsequent measurement in a live-cell environment. To correct for nanoscale chromatic aberrations we developed a new machine-learning based approach with reconstruction errors below achievable localization precisions. We show that these methods allow the reconstruction of live synapse surfaces and a variety of the associated molecular machineries with up to 50 nm accuracy in 3 dimensions.

To coordinate cellular physiology, eukaryotic cells rely on the inter-organelle transfer of molecules at specialized organelle-organelle contact sites1,2. Endoplasmic reticulum-mitochondria contact sites (ERMCSs) are particularly vital communication hubs, playing key roles in the exchange of signaling molecules, lipids, and metabolites3. ERMCSs are maintained by interactions between complementary tethering molecules on the surface of each organelle4,5. However, due to the extreme sensitivity of these membrane interfaces to experimental perturbation6,7, a clear understanding of their nanoscale structure and regulation is still lacking. Here, we combine 3D electron microscopy with high-speed molecular tracking of a model organelle tether, VAPB, to map the structure and diffusion landscape of ERMCSs. From EM reconstructions, we identified subdomains within the contact site where ER membranes dramatically deform to match local mitochondrial curvature. In parallel live cell experiments, we observed that the VAPB tethers that mediate this interface were not immobile, but rather highly dynamic, entering and leaving the site in seconds. These subdomains enlarged during nutrient stress, indicating ERMCSs can readily remodel under different physiological conditions. An ALS-associated mutation in VAPB altered the normal fluidity of contact sites, likely perturbing effective communication across the contact site and preventing remodeling. These results establish high speed single molecule imaging as a new tool for mapping the structure of contact site interfaces and suggest that the diffusion landscape of VAPB is a crucial component of ERMCS homeostasis.

The interaction of descending neocortical outputs and subcortical premotor circuits is critical for shaping skilled movements. Two broad classes of motor cortical output projection neurons provide input to many subcortical motor areas: pyramidal tract (PT) neurons, which project throughout the neuraxis, and intratelencephalic (IT) neurons, which project within the cortex and subcortical striatum. It is unclear whether these classes are functionally in series or whether each class carries distinct components of descending motor control signals. Here, we combine large-scale neural recordings across all layers of motor cortex with cell type-specific perturbations to study cortically dependent mouse motor behaviors: kinematically variable manipulation of a joystick and a kinematically precise reach-to-grasp. We find that striatum-projecting IT neuron activity preferentially represents amplitude, whereas pons-projecting PT neurons preferentially represent the variable direction of forelimb movements. Thus, separable components of descending motor cortical commands are distributed across motor cortical projection cell classes.

The development of enzyme-based self-labeling tags allow the labeling of proteins in living cells with synthetic small-molecules. Use of a fluorophore-containing ligand enables the visualization of protein location inside cells using fluorescence microscopy. Alternatively, deployment of a biotin-containing ligand allows purification of tagged protein using affinity resins. Despite these various applications of self-labeling tags, most ligands serve a single purpose. Here, we describe self-labeling tag ligands that allow both visualization and subsequent capture of a protein. A key design principle is exploiting the chemical properties and size of a rhodamine fluorophore to optimize cell-permeability of the ligand and the capture efficiency of the biotin conjugate. This work generates useful “multifunctional” fluorophores with generalizable design principles that will allow the construction of new tools for biology.

Most animals have compound eyes, with tens to thousands of lenses attached rigidly to the exoskeleton. A natural assumption is that all of these species must resort to moving either their head or their body to actively change their visual input. However, classic anatomy has revealed that flies have muscles poised to move their retinas under the stable lenses of each compound eye. Here we show that Drosophila use their retinal muscles to smoothly track visual motion, which helps to stabilize the retinal image, and also to perform small saccades when viewing a stationary scene. We show that when the retina moves, visual receptive fields shift accordingly, and that even the smallest retinal saccades activate visual neurons. Using a head-fixed behavioural paradigm, we find that Drosophila perform binocular, vergence movements of their retinas-which could enhance depth perception-when crossing gaps, and impairing the physiology of retinal motor neurons alters gap-crossing trajectories during free behaviour. That flies evolved an ability to actuate their retinas suggests that moving the eye independently of the head is broadly paramount for animals. The similarities of smooth and saccadic movements of the Drosophila retina and the vertebrate eye highlight a notable example of convergent evolution.

During transcription, RNA Polymerase II (RNAPII) is spatially organised within the nucleus into clusters that correlate with transcription activity. While this is a hallmark of genome regulation in mammalian cells, the mechanisms concerning the assembly, organisation and stability remain unknown. Here, we have used combination of single molecule imaging and genomic approaches to explore the role of nuclear myosin VI (MVI) in the nanoscale organisation of RNAPII. We reveal that MVI in the nucleus acts as the molecular anchor that holds RNAPII in high density clusters. Perturbation of MVI leads to the disruption of RNAPII localisation, chromatin organisation and subsequently a decrease in gene expression. Overall, we uncover the fundamental role of MVI in the spatial regulation of gene expression.

Due to advances in electron microscopy and deep learning, it is now practical to reconstruct a connectome, a description of neurons and the chemical synapses between them, for significant volumes of neural tissue. Smaller past reconstructions were primarily used by domain experts, could be handled by downloading data, and performance was not a serious problem. But new and much larger reconstructions upend these assumptions. These networks now contain tens of thousands of neurons and tens of millions of connections, with yet larger reconstructions pending, and are of interest to a large community of non-specialists. Allowing other scientists to make use of this data needs more than publication-it requires new tools that are publicly available, easy to use, and efficiently handle large data. We introduce neuPrint to address these data analysis challenges. Neuprint contains two major components-a web interface and programmer APIs. The web interface is designed to allow any scientist worldwide, using only a browser, to quickly ask and answer typical biological queries about a connectome. The neuPrint APIs allow more computer-savvy scientists to make more complex or higher volume queries. NeuPrint also provides features for assessing reconstruction quality. Internally, neuPrint organizes connectome data as a graph stored in a neo4j database. This gives high performance for typical queries, provides access though a public and well documented query language Cypher, and will extend well to future larger connectomics databases. Our experience is also an experiment in open science. We find a significant fraction of the readers of the article proceed to examine the data directly. In our case preprints worked exactly as intended, with data inquiries and PDF downloads starting immediately after pre-print publication, and little affected by formal publication later. From this we deduce that many readers are more interested in our data than in our analysis of our data, suggesting that data-only papers can be well appreciated and that public data release can speed up the propagation of scientific results by many months. We also find that providing, and keeping, the data available for online access imposes substantial additional costs to connectomics research.

The brain plans and executes volitional movements. The underlying patterns of neural population activity have been explored in the context of movements of the eyes, limbs, tongue, and head in nonhuman primates and rodents. How do networks of neurons produce the slow neural dynamics that prepare specific movements and the fast dynamics that ultimately initiate these movements? Recent work exploits rapid and calibrated perturbations of neural activity to test specific dynamical systems models that are capable of producing the observed neural activity. These joint experimental and computational studies show that cortical dynamics during motor planning reflect fixed points of neural activity (attractors). Subcortical control signals reshape and move attractors over multiple timescales, causing commitment to specific actions and rapid transitions to movement execution. Experiments in rodents are beginning to reveal how these algorithms are implemented at the level of brain-wide neural circuits. Expected final online publication date for the , Volume 45 is July 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

The brain plans and executes volitional movements. The underlying patterns of neural population activity have been explored in the context of movements of the eyes, limbs, tongue, and head in nonhuman primates and rodents. How do networks of neurons produce the slow neural dynamics that prepare specific movements and the fast dynamics that ultimately initiate these movements? Recent work exploits rapid and calibrated perturbations of neural activity to test specific dynamical systems models that are capable of producing the observed neural activity. These joint experimental and computational studies show that cortical dynamics during motor planning reflect fixed points of neural activity (attractors). Subcortical control signals reshape and move attractors over multiple timescales, causing commitment to specific actions and rapid transitions to movement execution. Experiments in rodents are beginning to reveal how these algorithms are implemented at the level of brain-wide neural circuits.