Cognitive maps confer animals with flexible intelligence by representing spatial, temporal, and abstract relationships that can be used to shape thought, planning, and behavior. Cognitive maps have been observed in the hippocampus, but their algorithmic form and the processes by which they are learned remain obscure. Here, we employed large-scale, longitudinal two-photon calcium imaging to record activity from thousands of neurons in the CA1 region of the hippocampus while mice learned to efficiently collect rewards from two subtly different versions of linear tracks in virtual reality. The results provide a detailed view of the formation of a cognitive map in the hippocampus. Throughout learning, both the animal behavior and hippocampal neural activity progressed through multiple intermediate stages, gradually revealing improved task understanding and behavioral efficiency. The learning process led to progressive decorrelations in initially similar hippocampal neural activity within and across tracks, ultimately resulting in orthogonalized representations resembling a state machine capturing the inherent structure of the task. We show that a Hidden Markov Model (HMM) and a biologically plausible recurrent neural network trained using Hebbian learning can both capture core aspects of the learning dynamics and the orthogonalized representational structure in neural activity. In contrast, we show that gradient-based learning of sequence models such as Long Short-Term Memory networks (LSTMs) and Transformers do not naturally produce such representations. We further demonstrate that mice exhibited adaptive behavior in novel task settings, with neural activity reflecting flexible deployment of the state machine. These findings shed light on the mathematical form of cognitive maps, the learning rules that sculpt them, and the algorithms that promote adaptive behavior in animals. The work thus charts a course toward a deeper understanding of biological intelligence and offers insights toward developing more robust learning algorithms in artificial intelligence.

PURPOSE: To develop switchable and tunable labels with high contrast ratio for MRI using magnetocaloric materials that have sharp first-order magnetic phase transitions at physiological temperatures and typical MRI magnetic field strengths.

METHODS: A prototypical magnetocaloric material iron-rhodium (FeRh) was prepared by melt mixing, high-temperature annealing, and ice-water quenching. Temperature- and magnetic field-dependent magnetization measurements of wire-cut FeRh samples were performed on a vibrating sample magnetometer. Temperature-dependent MRI of FeRh samples was performed on a 4.7T MRI.

RESULTS: Temperature-dependent MRI clearly demonstrated image contrast changes due to the sharp magnetic state transition of the FeRh samples in the MRI magnetic field (4.7T) and at a physiologically relevant temperature (~37°C).

CONCLUSION: A magnetocaloric material, FeRh, was demonstrated to act as a high contrast ratio switchable MRI contrast agent due to its sharp first-order magnetic phase transition in the DC magnetic field of MRI and at physiologically relevant temperatures. A wide range of magnetocaloric materials are available that can be tuned by materials science techniques to optimize their response under MRI-appropriate conditions and be controllably switched in situ with temperature, magnetic field, or a combination of both.

Recent success in training artificial agents and robots derives from a combination of direct learning of behavioural policies and indirect learning through value functions. Policy learning and value learning use distinct algorithms that optimize behavioural performance and reward prediction, respectively. In animals, behavioural learning and the role of mesolimbic dopamine signalling have been extensively evaluated with respect to reward prediction; however, so far there has been little consideration of how direct policy learning might inform our understanding. Here we used a comprehensive dataset of orofacial and body movements to understand how behavioural policies evolved as naive, head-restrained mice learned a trace conditioning paradigm. Individual differences in initial dopaminergic reward responses correlated with the emergence of learned behavioural policy, but not the emergence of putative value encoding for a predictive cue. Likewise, physiologically calibrated manipulations of mesolimbic dopamine produced several effects inconsistent with value learning but predicted by a neural-network-based model that used dopamine signals to set an adaptive rate, not an error signal, for behavioural policy learning. This work provides strong evidence that phasic dopamine activity can regulate direct learning of behavioural policies, expanding the explanatory power of reinforcement learning models for animal learning.

Electrophysiology is the most used approach for the collection of functional data in basic and translational neuroscience, but it is typically limited to either intracellular or extracellular recordings. The integration of multiple physiological modalities for the routine acquisition of multimodal data with microelectrodes could be useful for biomedical applications, yet this has been challenging owing to incompatibilities of fabrication methods. Here, we present a suite of glass pipettes with integrated microelectrodes for the simultaneous acquisition of multimodal intracellular and extracellular information in vivo, electrochemistry assessments, and optogenetic perturbations of neural activity. We used the integrated devices to acquire multimodal signals from the CA1 region of the hippocampus in mice and rats, and show that these data can serve as ground-truth validation for the performance of spike-sorting algorithms. The microdevices are applicable for basic and translational neurobiology, and for the development of next-generation brain-machine interfaces.

Choosing a mate is one of the most consequential decisions a female will make during her lifetime. A female fly signals her willingness to mate by opening her vaginal plates, allowing a courting male to copulate. Vaginal plate opening (VPO) occurs in response to the male courtship song and is dependent on the mating status of the female. How these exteroceptive (song) and interoceptive (mating status) inputs are integrated to regulate VPO remains unknown. Here we characterize the neural circuitry that implements mating decisions in the brain of female Drosophila melanogaster. We show that VPO is controlled by a pair of female-specific descending neurons (vpoDNs). The vpoDNs receive excitatory input from auditory neurons (vpoENs), which are tuned to specific features of the D. melanogaster song, and from pC1 neurons, which encode the mating status of the female. The song responses of vpoDNs, but not vpoENs, are attenuated upon mating, accounting for the reduced receptivity of mated females. This modulation is mediated by pC1 neurons. The vpoDNs thus directly integrate the external and internal signals that control the mating decisions of Drosophila females.

Mating and egg laying are tightly cooordinated events in the reproductive life of all oviparous females. Oviposition is typically rare in virgin females but is initiated after copulation. Here we identify the neural circuitry that links egg laying to mating status in Drosophila melanogaster. Activation of female-specific oviposition descending neurons (oviDNs) is necessary and sufficient for egg laying, and is equally potent in virgin and mated females. After mating, sex peptide-a protein from the male seminal fluid-triggers many behavioural and physiological changes in the female, including the onset of egg laying. Sex peptide is detected by sensory neurons in the uterus, and silences these neurons and their postsynaptic ascending neurons in the abdominal ganglion. We show that these abdominal ganglion neurons directly activate the female-specific pC1 neurons. GABAergic (γ-aminobutyric-acid-releasing) oviposition inhibitory neurons (oviINs) mediate feed-forward inhibition from pC1 neurons to both oviDNs and their major excitatory input, the oviposition excitatory neurons (oviENs). By attenuating the abdominal ganglion inputs to pC1 neurons and oviINs, sex peptide disinhibits oviDNs to enable egg laying after mating. This circuitry thus coordinates the two key events in female reproduction: mating and egg laying.

Photoactivatable pharmacological agents have revolutionized neuroscience, but the palette of available compounds is limited. We describe a general method for caging tertiary amines by using a stable quaternary ammonium linkage that elicits a red shift in the activation wavelength. We prepared a photoactivatable nicotine (PA-Nic), uncageable via one- or two-photon excitation, that is useful to study nicotinic acetylcholine receptors (nAChRs) in different experimental preparations and spatiotemporal scales.

The palette of tools for stimulation and regulation of neural activity is continually expanding. One of the new methods being introduced is magnetogenetics, where mechano-sensitive and thermo-sensitive ion channels are genetically engineered to be closely coupled to the iron-storage protein ferritin. Such genetic constructs could provide a powerful new way of non-invasively activating ion channels in-vivo using external magnetic fields that easily penetrate biological tissue. Initial reports that introduced this new technology have sparked a vigorous debate on the plausibility of physical mechanisms of ion channel activation by means of external magnetic fields. I argue that the initial criticisms leveled against magnetogenetics as being physically implausible were possibly based on the overly simplistic and unnecessarily pessimistic assumptions about the magnetic spin configurations of iron in ferritin protein. Additionally, all the possible magnetic-field-based mechanisms of ion channel activation in magnetogenetics might not have been fully considered. I present and propose several new magneto-mechanical and magneto-thermal mechanisms of ion channel activation by iron-loaded ferritin protein that may elucidate and clarify some of the mysteries that presently challenge our understanding of the reported biological experiments. Finally, I present some additional puzzles that will require further theoretical and experimental investigation.

Imaging neurons and neural circuits over large volumes at high speed and subcellular resolution is a difficult task. Incorporating a Bessel focus module into a two-photon fluorescence mesoscope, we achieved rapid volumetric imaging of neural activity over the mesoscale with synaptic resolution. We applied the technology to calcium imaging of entire dendritic spans of neurons as well as neural ensembles within multiple cortical regions over two hemispheres of the awake mouse brain.