Main Menu (Mobile)- Block

Main Menu - Block

custom | custom

Search Results

filters_region_cap | custom

Filter

facetapi-Q2b17qCsTdECvJIqZJgYMaGsr8vANl1n | block
facetapi-W9JlIB1X0bjs93n1Alu3wHJQTTgDCBGe | block
facetapi-61yz1V0li8B1bixrCWxdAe2aYiEXdhd0 | block
facetapi-PV5lg7xuz68EAY8eakJzrcmwtdGEnxR0 | block
general_search_page-panel_pane_1 | views_panes

35 Janelia Publications

Showing 1-10 of 35 results
Your Criteria:
    02/27/24 | Distinct streams for supervised and unsupervised learning in the visual cortex
    Lin Zhong , Scott Baptista , Rachel Gattoni , Jon Arnold , Daniel Flickinger , Carsen Stringer , Marius Pachitariu
    bioRxiv. 2024 Feb 27:. doi: 10.1101/2024.02.25.581990

    Representation learning in neural networks may be implemented with supervised or unsupervised algorithms, distinguished by the availability of feedback. In sensory cortex, perceptual learning drives neural plasticity, but it is not known if this is due to supervised or unsupervised learning. Here we recorded populations of up to 90,000 neurons simultaneously from the primary visual cortex (V1) and higher visual areas (HVA), while mice learned multiple tasks as well as during unrewarded exposure to the same stimuli. Similar to previous studies, we found that neural changes in task mice were correlated with their behavioral learning. However, the neural changes were mostly replicated in mice with unrewarded exposure, suggesting that the changes were in fact due to unsupervised learning. The neural plasticity was concentrated in the medial HVAs and obeyed visual, rather than spatial, learning rules. In task mice only, we found a ramping reward prediction signal in anterior HVAs, potentially involved in supervised learning. Our neural results predict that unsupervised learning may accelerate subsequent task learning, a prediction which we validated with behavioral experiments.

    View Publication Page
    10/05/23 | Conjoint specification of action by neocortex and striatum.
    Junchol Park , Peter Polidoro , Catia Fortunato , Jon Arnold , Brett Mensh , Juan A. Gallego , Joshua T. Dudman
    bioRxiv. 2023 Oct 05:. doi: 10.1101/2023.10.04.560957

    The interplay between two major forebrain structures - cortex and subcortical striatum - is critical for flexible, goal-directed action. Traditionally, it has been proposed that striatum is critical for selecting what type of action is initiated while the primary motor cortex is involved in the online control of movement execution. Recent data indicates that striatum may also be critical for specifying movement execution. These alternatives have been difficult to reconcile because when comparing very distinct actions, as in the vast majority of work to date, they make essentially indistinguishable predictions. Here, we develop quantitative models to reveal a somewhat paradoxical insight: only comparing neural activity during similar actions makes strongly distinguishing predictions. We thus developed a novel reach-to-pull task in which mice reliably selected between two similar, but distinct reach targets and pull forces. Simultaneous cortical and subcortical recordings were uniquely consistent with a model in which cortex and striatum jointly specify flexible parameters of action during movement execution.

    View Publication Page
    09/26/23 | Reward expectations direct learning and drive operant matching in Drosophila
    Adithya E. Rajagopalan , Ran Darshan , Karen L. Hibbard , James E. Fitzgerald , Glenn C. Turner
    Proceedings of the National Academy of Sciences of the U.S.A.. 2023 Sep 26;120(39):e2221415120. doi: 10.1073/pnas.2221415120

    Foraging animals must use decision-making strategies that dynamically adapt to the changing availability of rewards in the environment. A wide diversity of animals do this by distributing their choices in proportion to the rewards received from each option, Herrnstein’s operant matching law. Theoretical work suggests an elegant mechanistic explanation for this ubiquitous behavior, as operant matching follows automatically from simple synaptic plasticity rules acting within behaviorally relevant neural circuits. However, no past work has mapped operant matching onto plasticity mechanisms in the brain, leaving the biological relevance of the theory unclear. Here we discovered operant matching in Drosophila and showed that it requires synaptic plasticity that acts in the mushroom body and incorporates the expectation of reward. We began by developing a novel behavioral paradigm to measure choices from individual flies as they learn to associate odor cues with probabilistic rewards. We then built a model of the fly mushroom body to explain each fly’s sequential choice behavior using a family of biologically-realistic synaptic plasticity rules. As predicted by past theoretical work, we found that synaptic plasticity rules could explain fly matching behavior by incorporating stimulus expectations, reward expectations, or both. However, by optogenetically bypassing the representation of reward expectation, we abolished matching behavior and showed that the plasticity rule must specifically incorporate reward expectations. Altogether, these results reveal the first synaptic level mechanisms of operant matching and provide compelling evidence for the role of reward expectation signals in the fly brain.

    View Publication Page
    08/07/23 | Learning produces a hippocampal cognitive map in the form of an orthogonalized state machine.
    Weinan Sun , Johan Winnubst , Maanasa Natrajan , Chongxi Lai , Koichiro Kajikawa , Michalis Michaelos , Rachel Gattoni , Carsen Stringer , Daniel Flickinger , James E. Fitzgerald , Nelson Spruston
    bioRxiv. 2023 Aug 07:. doi: 10.1101/2023.08.03.551900

    Cognitive maps confer animals with flexible intelligence by representing spatial, temporal, and abstract relationships that can be used to shape thought, planning, and behavior. Cognitive maps have been observed in the hippocampus, but their algorithmic form and the processes by which they are learned remain obscure. Here, we employed large-scale, longitudinal two-photon calcium imaging to record activity from thousands of neurons in the CA1 region of the hippocampus while mice learned to efficiently collect rewards from two subtly different versions of linear tracks in virtual reality. The results provide a detailed view of the formation of a cognitive map in the hippocampus. Throughout learning, both the animal behavior and hippocampal neural activity progressed through multiple intermediate stages, gradually revealing improved task understanding and behavioral efficiency. The learning process led to progressive decorrelations in initially similar hippocampal neural activity within and across tracks, ultimately resulting in orthogonalized representations resembling a state machine capturing the inherent structure of the task. We show that a Hidden Markov Model (HMM) and a biologically plausible recurrent neural network trained using Hebbian learning can both capture core aspects of the learning dynamics and the orthogonalized representational structure in neural activity. In contrast, we show that gradient-based learning of sequence models such as Long Short-Term Memory networks (LSTMs) and Transformers do not naturally produce such representations. We further demonstrate that mice exhibited adaptive behavior in novel task settings, with neural activity reflecting flexible deployment of the state machine. These findings shed light on the mathematical form of cognitive maps, the learning rules that sculpt them, and the algorithms that promote adaptive behavior in animals. The work thus charts a course toward a deeper understanding of biological intelligence and offers insights toward developing more robust learning algorithms in artificial intelligence.

    View Publication Page
    01/18/23 | Mesolimbic dopamine adapts the rate of learning from action.
    Coddington LT, Lindo SE, Dudman JT
    Nature. 2023 Jan 18:. doi: 10.1038/s41586-022-05614-z

    Recent success in training artificial agents and robots derives from a combination of direct learning of behavioural policies and indirect learning through value functions. Policy learning and value learning use distinct algorithms that optimize behavioural performance and reward prediction, respectively. In animals, behavioural learning and the role of mesolimbic dopamine signalling have been extensively evaluated with respect to reward prediction; however, so far there has been little consideration of how direct policy learning might inform our understanding. Here we used a comprehensive dataset of orofacial and body movements to understand how behavioural policies evolved as naive, head-restrained mice learned a trace conditioning paradigm. Individual differences in initial dopaminergic reward responses correlated with the emergence of learned behavioural policy, but not the emergence of putative value encoding for a predictive cue. Likewise, physiologically calibrated manipulations of mesolimbic dopamine produced several effects inconsistent with value learning but predicted by a neural-network-based model that used dopamine signals to set an adaptive rate, not an error signal, for behavioural policy learning. This work provides strong evidence that phasic dopamine activity can regulate direct learning of behavioural policies, expanding the explanatory power of reinforcement learning models for animal learning.

    View Publication Page
    12/22/22 | A brainstem integrator for self-localization and positional homeostasis
    Yang E, Zwart MF, Rubinov M, James B, Wei Z, Narayan S, Vladimirov N, Mensh BD, Fitzgerald JE, Ahrens MB
    Cell. 2022 Dec 22;185(26):5011-5027.e20. doi: 10.1101/2021.11.26.468907

    To accurately track self-location, animals need to integrate their movements through space. In amniotes, representations of self-location have been found in regions such as the hippocampus. It is unknown whether more ancient brain regions contain such representations and by which pathways they may drive locomotion. Fish displaced by water currents must prevent uncontrolled drift to potentially dangerous areas. We found that larval zebrafish track such movements and can later swim back to their earlier location. Whole-brain functional imaging revealed the circuit enabling this process of positional homeostasis. Position-encoding brainstem neurons integrate optic flow, then bias future swimming to correct for past displacements by modulating inferior olive and cerebellar activity. Manipulation of position-encoding or olivary neurons abolished positional homeostasis or evoked behavior as if animals had experienced positional shifts. These results reveal a multiregional hindbrain circuit in vertebrates for optic flow integration, memory of self-location, and its neural pathway to behavior.Competing Interest StatementThe authors have declared no competing interest.

    View Publication Page
    08/19/22 | Flexible control of behavioral variability mediated by an internal representation of head direction
    Chuntao Dan , Brad K. Hulse , Vivek Jayaraman , Ann M. Hermundstad
    bioRxiv. 2022 Aug 19:. doi: 10.1101/2021.08.18.456004

    Internal representations are thought to support the generation of flexible, long-timescale behavioral patterns in both animals and artificial agents. Here, we present a novel conceptual framework for how Drosophila use their internal representation of head direction to maintain preferred headings in their surroundings, and how they learn to modify these preferences in the presence of selective thermal reinforcement. To develop the framework, we analyzed flies’ behavior in a classical operant visual learning paradigm and found that they use stochastically generated fixations and directed turns to express their heading preferences. Symmetries in the visual scene used in the paradigm allowed us to expose how flies’ probabilistic behavior in this setting is tethered to their head direction representation. We describe how flies’ ability to quickly adapt their behavior to the rules of their environment may rest on a behavioral policy whose parameters are flexible but whose form is genetically encoded in the structure of their circuits. Many of the mechanisms we outline may also be relevant for rapidly adaptive behavior driven by internal representations in other animals, including mammals.

    View Publication Page
    07/04/22 | Visualizing Synaptic Dopamine Efflux with a 2D Nanofilm.
    Chandima Bulumulla , Andrew T. Krasley , Deepika Walpita , Abraham G. Beyene
    eLife. 2022 Jul 04:. doi: 10.7554/eLife.78773

    Chemical neurotransmission constitutes one of the fundamental modalities of communication between neurons. Monitoring release of these chemicals has traditionally been difficult to carry out at spatial and temporal scales relevant to neuron function. To understand chemical neurotransmission more fully, we need to improve the spatial and temporal resolutions of measurements for neurotransmitter release. To address this, we engineered a chemi-sensitive, two-dimensional nanofilm that facilitates subcellular visualization of the release and diffusion of the neurochemical dopamine with synaptic resolution, quantal sensitivity, and simultaneously from hundreds of release sites. Using this technology, we were able to monitor the spatiotemporal dynamics of dopamine release in dendritic processes, a poorly understood phenomenon. We found that dopamine release is broadcast from a subset of dendritic processes as hotspots that have a mean spatial spread of ≈3.2 µm (full width at half maximum) and are observed with a mean spatial frequency of 1 hotspot per ≈7.5 µm of dendritic length. Major dendrites of dopamine neurons and fine dendritic processes, as well as dendritic arbors and dendrites with no apparent varicose morphology participated in dopamine release. Remarkably, these release hotspots colocalized with Bassoon, suggesting that Bassoon may contribute to organizing active zones in dendrites, similar to its role in axon terminals.

    View Publication Page
    10/01/21 | An adaptive optics module for deep tissue multiphoton imaging in vivo.
    Rodriguez C, Chen A, Rivera JA, Mohr MA, Liang Y, Natan RG, Sun W, Milkie DE, Bifano TG, Chen X, Ji N
    Nature Methods. 2021 Oct 01;18(10):1259-1264. doi: 10.1038/s41592-021-01279-0

    Understanding complex biological systems requires visualizing structures and processes deep within living organisms. We developed a compact adaptive optics module and incorporated it into two- and three-photon fluorescence microscopes, to measure and correct tissue-induced aberrations. We resolved synaptic structures in deep cortical and subcortical areas of the mouse brain, and demonstrated high-resolution imaging of neuronal structures and somatosensory-evoked calcium responses in the mouse spinal cord at great depths in vivo.

    View Publication Page
    01/01/21 | Neural circuit mechanisms of sexual receptivity in Drosophila females.
    Wang K, Wang F, Forknall N, Yang T, Patrick C, Parekh R, Dickson BJ
    Nature. 2021 Jan 01;589(7843):577-81. doi: 10.1038/s41586-020-2972-7

    Choosing a mate is one of the most consequential decisions a female will make during her lifetime. A female fly signals her willingness to mate by opening her vaginal plates, allowing a courting male to copulate. Vaginal plate opening (VPO) occurs in response to the male courtship song and is dependent on the mating status of the female. How these exteroceptive (song) and interoceptive (mating status) inputs are integrated to regulate VPO remains unknown. Here we characterize the neural circuitry that implements mating decisions in the brain of female Drosophila melanogaster. We show that VPO is controlled by a pair of female-specific descending neurons (vpoDNs). The vpoDNs receive excitatory input from auditory neurons (vpoENs), which are tuned to specific features of the D. melanogaster song, and from pC1 neurons, which encode the mating status of the female. The song responses of vpoDNs, but not vpoENs, are attenuated upon mating, accounting for the reduced receptivity of mated females. This modulation is mediated by pC1 neurons. The vpoDNs thus directly integrate the external and internal signals that control the mating decisions of Drosophila females.

    View Publication Page