Recent success in training artificial agents and robots derives from a combination of direct learning of behavioural policies and indirect learning through value functions. Policy learning and value learning use distinct algorithms that optimize behavioural performance and reward prediction, respectively. In animals, behavioural learning and the role of mesolimbic dopamine signalling have been extensively evaluated with respect to reward prediction; however, so far there has been little consideration of how direct policy learning might inform our understanding. Here we used a comprehensive dataset of orofacial and body movements to understand how behavioural policies evolved as naive, head-restrained mice learned a trace conditioning paradigm. Individual differences in initial dopaminergic reward responses correlated with the emergence of learned behavioural policy, but not the emergence of putative value encoding for a predictive cue. Likewise, physiologically calibrated manipulations of mesolimbic dopamine produced several effects inconsistent with value learning but predicted by a neural-network-based model that used dopamine signals to set an adaptive rate, not an error signal, for behavioural policy learning. This work provides strong evidence that phasic dopamine activity can regulate direct learning of behavioural policies, expanding the explanatory power of reinforcement learning models for animal learning.

Most cortical synapses are local and excitatory. Local recurrent circuits could implement amplification, allowing pattern completion and other computations. Cortical circuits contain subnetworks that consist of neurons with similar receptive fields and increased connectivity relative to the network average. Cortical neurons that encode different types of information are spatially intermingled and distributed over large brain volumes, and this complexity has hindered attempts to probe the function of these subnetworks by perturbing them individually. Here we use computational modelling, optical recordings and manipulations to probe the function of recurrent coupling in layer 2/3 of the mouse vibrissal somatosensory cortex during active tactile discrimination. A neural circuit model of layer 2/3 revealed that recurrent excitation enhances sensory signals by amplification, but only for subnetworks with increased connectivity. Model networks with high amplification were sensitive to damage: loss of a few members of the subnetwork degraded stimulus encoding. We tested this prediction by mapping neuronal selectivity and photoablating neurons with specific selectivity. Ablation of a small proportion of layer 2/3 neurons (10-20, less than 5% of the total) representing touch markedly reduced responses in the spared touch representation, but not in other representations. Ablations most strongly affected neurons with stimulus responses that were similar to those of the ablated population, which is also consistent with network models. Recurrence among cortical neurons with similar selectivity therefore drives input-specific amplification during behaviour.

Genetically encoded calcium indicators (GECIs) allow measurement of activity in large populations of neurons and in small neuronal compartments, over times of milliseconds to months. Although GFP-based GECIs are widely used for in vivo neurophysiology, GECIs with red-shifted excitation and emission spectra have advantages for in vivo imaging because of reduced scattering and absorption in tissue, and a consequent reduction in phototoxicity. However, current red GECIs are inferior to the state-of-the-art GFP-based GCaMP6 indicators for detecting and quantifying neural activity. Here we present improved red GECIs based on mRuby (jRCaMP1a, b) and mApple (jRGECO1a), with sensitivity comparable to GCaMP6. We characterized the performance of the new red GECIs in cultured neurons and in mouse, Drosophila, zebrafish and C. elegans in vivo. Red GECIs facilitate deep-tissue imaging, dual-color imaging together with GFP-based reporters, and the use of optogenetics in combination with calcium imaging.

Tissue and organ function has been conventionally understood in terms of the interactions among discrete and homogeneous cell types. This approach has proven difficult in neuroscience due to the marked diversity across different neuron classes, but it may be further hampered by prominent within-class variability. Here, we considered a well-defined canonical neuronal population-hippocampal CA1 pyramidal cells (CA1 PCs)-and systematically examined the extent and spatial rules of transcriptional heterogeneity. Using next-generation RNA sequencing, we identified striking variability in CA1 PCs, such that the differences within CA1 along the dorsal-ventral axis rivaled differences across distinct pyramidal neuron classes. This variability emerged from a spectrum of continuous gene-expression gradients, producing a transcriptional profile consistent with a multifarious continuum of cells. This work reveals an unexpected amount of variability within a canonical and narrowly defined neuronal population and suggests that continuous, within-class heterogeneity may be an important feature of neural circuits.

During development, regulatory factors appear in a precise order to determine cell fates over time. Consequently, to investigate complex tissue development, it is necessary to visualize and manipulate cell lineages with temporal control. Current strategies for tracing vertebrate cell lineages lack genetic access to sequentially produced cells. Here, we present TEMPO (Temporal Encoding and Manipulation in a Predefined Order), an imaging-readable genetic tool allowing differential labeling and manipulation of consecutive cell generations in vertebrates. TEMPO is based on CRISPR and powered by a cascade of gRNAs that drive orderly activation and inactivation of reporters and/or effectors. Using TEMPO to visualize zebrafish and mouse neurogenesis, we recapitulated birth-order-dependent neuronal fates. Temporally manipulating cell-cycle regulators in mouse cortex progenitors altered the proportion and distribution of neurons and glia, revealing the effects of temporal gene perturbation on serial cell fates. Thus, TEMPO enables sequential manipulation of molecular factors, crucial to study cell-type specification.

During development, regulatory factors appear in a precise order to determine cell fates over time. Consequently, to investigate complex tissue development, it is necessary to visualize and manipulate cell lineages with temporal control. Current strategies for tracing vertebrate cell lineages lack genetic access to sequentially produced cells. Here, we present TEMPO (Temporal Encoding and Manipulation in a Predefined Order), an imaging-readable genetic tool allowing differential labeling and manipulation of consecutive cell generations in vertebrates. TEMPO is based on CRISPR and powered by a cascade of gRNAs that drive orderly activation and inactivation of reporters and/or effectors. Using TEMPO to visualize zebrafish and mouse neurogenesis, we recapitulated birth-order-dependent neuronal fates. Temporally manipulating cell-cycle regulators in mouse cortex progenitors altered the proportion and distribution of neurons and glia, revealing the effects of temporal gene perturbation on serial cell fates. Thus, TEMPO enables sequential manipulation of molecular factors, crucial to study cell-type specification.

In the hippocampus, the classical pyramidal cell type of the subiculum acts as a primary output, conveying hippocampal signals to a diverse suite of downstream regions. Accumulating evidence suggests that the subiculum pyramidal cell population may actually be comprised of discrete subclasses. Here, we investigated the extent and organizational principles governing pyramidal cell heterogeneity throughout the mouse subiculum. Using single-cell RNA-seq, we find that the subiculum pyramidal cell population can be deconstructed into eight separable subclasses. These subclasses were mapped onto abutting spatial domains, ultimately producing a complex laminar and columnar organization with heterogeneity across classical dorsal-ventral, proximal-distal, and superficial-deep axes. We further show that these transcriptomically defined subclasses correspond to differential protein products and can be associated with specific projection targets. This work deconstructs the complex landscape of subiculum pyramidal cells into spatially segregated subclasses that may be observed, controlled, and interpreted in future experiments.

Calcium imaging is commonly used to measure the neural activity of large groups of neurons in mice. Genetically encoded calcium indicators (GECIs) can be delivered for this purpose using non-invasive genetic methods. Compared to viral gene transfer, transgenic targeting of GECIs provides stable long-term expression and obviates the need for invasive viral injections. Transgenic mice expressing the green GECI GCaMP6 are already widely used. Here we present the generation and characterization of transgenic mice expressing the sensitive red GECI jRGECO1a, driven by the Thy1 promoter. Four transgenic lines with different expression patterns showed sufficiently high expression for cellular in vivo imaging. We used two-photon microscopy to characterize visual responses of individual neurons in the visual cortex in vivo. The signal-to-noise ratio in transgenic mice was comparable to, or better than, mice transduced with adeno-associated virus. In addition, we show that Thy1-jRGECO1a transgenic mice are useful for transcranial population imaging and functional mapping using widefield fluorescence microscopy. We also demonstrate imaging of visual responses in retinal ganglion cells in vitro. Thy1-jRGECO1a transgenic mice are therefore a useful addition to the toolbox for imaging activity in intact neural networks.