Progressive depletion of midbrain dopamine neurons (PDD) is associated with deficits in the initiation, speed, and fluidity of voluntary movement. Models of basal ganglia function focus on initiation deficits; however, it is unclear how they account for deficits in the speed or amplitude of movement (vigor). Using an effort-based operant conditioning task for head-fixed mice, we discovered distinct functional classes of neurons in the dorsal striatum that represent movement vigor. Mice with PDD exhibited a progressive reduction in vigor, along with a selective impairment of its neural representation in striatum. Restoration of dopaminergic tone with a synthetic precursor ameliorated deficits in movement vigor and its neural representation, while suppression of striatal activity during movement was sufficient to reduce vigor. Thus, dopaminergic input to the dorsal striatum is indispensable for the emergence of striatal activity that mediates adaptive changes in movement vigor. These results suggest refined intervention strategies for Parkinson’s disease.

Coherent control of purposive actions emerges from the coordination of multiple brain circuits during learning. Dissociable brain circuits and cell-types are thought to preferentially participate in distinct learning mechanisms. For example, the activity of midbrain dopamine (mDA) neurons is proposed to primarily, or even exclusively, reflect reward prediction error signals in well-trained animals. To study the specific contribution of individual circuits requires observing changes before tight functional coordination is achieved. However, little is known about the detailed timing of the emergence of reward-related representations in dopaminergic neurons. Here we recorded activity of identified dopaminergic neurons as naive mice learned a novel stimulus-reward association. We found that at early stages of learning mDA neuron activity reflected both external (sensory) and internal (action initiation) causes of reward expectation. The increasingly precise correlation of action initiation with sensory stimuli rather than an evaluation of outcomes governed mDA neuron activity. Thus, our data demonstrate that mDA neuron activity early in learning does not reflect errors, but is more akin to a Hebbian learning signal - providing new insight into a critical computation in a highly conserved, essential learning circuit.

Targeted manipulation of activity in specific populations of neurons is important for investigating the neural circuit basis of behavior. Optogenetic approaches using light-sensitive microbial rhodopsins have permitted manipulations to reach a level of temporal precision that is enabling functional circuit dissection. As demand for more precise perturbations to serve specific experimental goals increases, a palette of opsins with diverse selectivity, kinetics, and spectral properties will be needed. Here, we introduce a novel approach of "topological engineering"-inversion of opsins in the plasma membrane-and demonstrate that it can produce variants with unique functional properties of interest for circuit neuroscience. In one striking example, inversion of a Channelrhodopsin variant converted it from a potent activator into a fast-acting inhibitor that operates as a cation pump. Our findings argue that membrane topology provides a useful orthogonal dimension of protein engineering that immediately permits as much as a doubling of the available toolkit.

Optical imaging has become a powerful tool for studying brains . The opacity of adult brains makes microendoscopy, with an optical probe such as a gradient index (GRIN) lens embedded into brain tissue to provide optical relay, the method of choice for imaging neurons and neural activity in deeply buried brain structures. Incorporating a Bessel focus scanning module into two-photon fluorescence microendoscopy, we extended the excitation focus axially and improved its lateral resolution. Scanning the Bessel focus in 2D, we imaged volumes of neurons at high-throughput while resolving fine structures such as synaptic terminals. We applied this approach to the volumetric anatomical imaging of dendritic spines and axonal boutons in the mouse hippocampus, and functional imaging of GABAergic neurons in the mouse lateral hypothalamus .

Animals learn trajectories to rewards in both spatial, navigational contexts and relational, non-navigational contexts. Synchronous reactivation of hippocampal activity is thought to be critical for recall and evaluation of trajectories for learning. Do hippocampal representations differentially contribute to experience-dependent learning of trajectories across spatial and relational contexts? In this study, we trained mice to navigate to a hidden target in a physical arena or manipulate a joystick to a virtual target to collect delayed rewards. In a navigational context, calcium imaging in freely moving mice revealed that synchronous CA1 reactivation was retrospective and important for evaluation of prior navigational trajectories. In a non-navigational context, reactivation was prospective and important for initiation of joystick trajectories, even in the same animals trained in both contexts. Adaptation of trajectories to a new target was well-explained by a common learning algorithm in which hippocampal activity makes dissociable contributions to reinforcement learning computations depending upon spatial context.

Optogenetic reagents allow for depolarization and hyperpolarization of cells with light. This provides unprecedented spatial and temporal resolution to the control of neuronal activity both in vitro and in vivo. In the intact animal this requires strategies to deliver light deep into the highly scattering tissue of the brain. A general approach that we describe here is to implant optical fibers just above brain regions targeted for light delivery. In part due to the fact that expression of optogenetic proteins is accomplished by techniques with inherent variability (e.g., viral expression levels), it also requires strategies to measure and calibrate the effect of stimulation. Here we describe general procedures that allow one to simultaneously stimulate neurons and use photometry with genetically encoded activity indicators to precisely calibrate stimulation.

The basal ganglia play a critical role in the regulation of voluntary action in vertebrates. Our understanding of the function of the basal ganglia relies heavily upon anatomical information, but continued progress will require an understanding of the specific functional roles played by diverse cell types and their connectivity. An increasing number of mouse lines allow extensive identification, characterization, and manipulation of specified cell types in the basal ganglia. Despite the promise of genetically modified mice for elucidating the functional roles of diverse cell types, there is relatively little anatomical data obtained directly in the mouse. Here we have characterized the retrograde labeling obtained from a series of tracer injections throughout the dorsal striatum of adult mice. We found systematic variations in input along both the medial-lateral and anterior-posterior neuraxes in close agreement with canonical features of basal ganglia anatomy in the rat. In addition to the canonical features we have provided experimental support for the importance of non-canonical inputs to the striatum from the raphe nuclei and the amygdala. To look for organization at a finer scale we have analyzed the correlation structure of labeling intensity across our entire dataset. Using this analysis we found substantial local heterogeneity within the large-scale order. From this analysis we conclude that individual striatal sites receive varied combinations of cortical and thalamic input from multiple functional areas, consistent with some earlier studies in the rat that have suggested the presence of a combinatorial map.

The nervous system evolved to enable navigation throughout the environment in the pursuit of resources. Evolutionarily newer structures allowed increasingly complex adaptations but necessarily added redundancy. A dominant view of movement neuroscientists is that there is a one-to-one mapping between brain region and function. However, recent experimental data is hard to reconcile with the most conservative interpretation of this framework, suggesting a degree of functional redundancy during the performance of well-learned, constrained behaviors. This apparent redundancy likely stems from the bidirectional interactions between the various cortical and subcortical structures involved in motor control. We posit that these bidirectional connections enable flexible interactions across structures that change depending upon behavioral demands, such as during acquisition, execution or adaptation of a skill. Observing the system across both multiple actions and behavioral timescales can help isolate the functional contributions of individual structures, leading to an integrated understanding of the neural control of movement.

Animals infer when and where a reward is available from experience with informative sensory stimuli and their own actions. In vertebrates, this is thought to depend upon the release of dopamine from midbrain dopaminergic neurons. Studies of the role of dopamine have focused almost exclusively on their encoding of informative sensory stimuli; however, many dopaminergic neurons are active just prior to movement initiation, even in the absence of sensory stimuli. How should current frameworks for understanding the role of dopamine incorporate these observations? To address this question, we review recent anatomical and functional evidence for action-related dopamine signaling. We conclude by proposing a framework in which dopaminergic neurons encode subjective signals of action initiation to solve an internal credit assignment problem.

Recent success in training artificial agents and robots derives from a combination of direct learning of behavioral policies and indirect learning via value functions. Policy learning and value learning employ distinct algorithms that optimize behavioral performance and reward prediction, respectively. In animals, behavioral learning and the role of mesolimbic dopamine signaling have been extensively evaluated with respect to reward prediction; however, to date there has been little consideration of how direct policy learning might inform our understanding. Here we used a comprehensive dataset of orofacial and body movements to understand how behavioral policies evolve as naive, head-restrained mice learned a trace conditioning paradigm. Individual differences in initial dopaminergic reward responses correlated with the emergence of learned behavioral policy, but not the emergence of putative value encoding for a predictive cue. Likewise, physiologically-calibrated manipulations of mesolimbic dopamine produced multiple effects inconsistent with value learning but predicted by a neural network-based model that used dopamine signals to set an adaptive rate, not an error signal, for behavioral policy learning. This work provides strong evidence that phasic dopamine activity can regulate direct learning of behavioral policies, expanding the explanatory power of reinforcement learning models for animal learning.