One-third of the mammalian proteome is comprised of transmembrane and secretory proteins that are synthesized on endoplasmic reticulum (ER). Here, we investigate the spatial distribution and regulation of mRNAs encoding these membrane and secretory proteins (termed "secretome" mRNAs) through live cell, single molecule tracking to directly monitor the position and translation states of secretome mRNAs on ER and their relationship to other organelles. Notably, translation of secretome mRNAs occurred preferentially near lysosomes on ER marked by the ER junction-associated protein, Lunapark. Knockdown of Lunapark reduced the extent of secretome mRNA translation without affecting translation of other mRNAs. Less secretome mRNA translation also occurred when lysosome function was perturbed by raising lysosomal pH or inhibiting lysosomal proteases. Secretome mRNA translation near lysosomes was enhanced during amino acid deprivation. Addition of the integrated stress response inhibitor, ISRIB, reversed the translation inhibition seen in Lunapark knockdown cells, implying an eIF2 dependency. Altogether, these findings uncover a novel coordination between ER and lysosomes, in which local release of amino acids and other factors from ER-associated lysosomes patterns and regulates translation of mRNAs encoding secretory and membrane proteins.

We aim to improve segmentation through the use of machine learning tools during region agglomeration. We propose an active learning approach for performing hierarchical agglomerative segmentation from superpixels. Our method combines multiple features at all scales of the agglomerative process, works for data with an arbitrary number of dimensions, and scales to very large datasets. We advocate the use of variation of information to measure segmentation accuracy, particularly in 3D electron microscopy (EM) images of neural tissue, and using this metric demonstrate an improvement over competing algorithms in EM and natural images.

We present an approach to solving computer vision problems in which the goal is to produce a high-dimensional, pixel-based interpretation of some aspect of the underlying structure of an image. Such tasks have traditionally been categorized as “low-level vision” problems, and examples include image denoising, boundary detection, and motion estimation. Our approach is characterized by two main elements, both of which represent a departure from previous work. The first is a focus on convolutional networks, a machine learning strategy that operates directly on an input image with no use of hand-designed features and employs many thousands of free parameters that are learned from data. Previous work in low-level vision has been largely focused on completely handdesigned algorithms or learning methods with a hand-designed feature space. We demonstrate that a learning approach with high model complexity, but zero prior knowledge about any specific image domain, can outperform existing techniques even in the challenging area of natural image processing. We also present results that establish how convolutional networks are closely related to Markov random fields (MRFs), a popular probabilistic approach to image analysis, but can in practice can achieve significantly greater model complexity. The second aspect of our approach is the use of domain specific cost functions and learning algorithms that reflect the structured nature of certain prediction problems in image analysis. In particular, we show how concepts from digital topology can be used in the context of boundary detection to both evaluate and optimize the high-order property of topological accuracy. We demonstrate that these techniques can significantly improve the machine learning approach and outperform state of the art boundary detection and segmentation methods. Throughout our work we maintain a special interest and focus on application of our methods to connectomics, an emerging scientific discipline that seeks highthroughput methods for recovering neural connectivity data from brains. This application requires solving low-level image analysis problems on a tera-voxel or peta-voxel scale, and therefore represents an extremely challenging and exciting arena for the development of computer vision methods.

Insects constitute the most species-rich radiation of metazoa, a success that is due to the evolution of active flight. Unlike pterosaurs, birds and bats, the wings of insects did not evolve from legs, but are novel structures that are attached to the body via a biomechanically complex hinge that transforms tiny, high-frequency oscillations of specialized power muscles into the sweeping back-and-forth motion of the wings. The hinge consists of a system of tiny, hardened structures called sclerites that are interconnected to one another via flexible joints and regulated by the activity of specialized control muscles. Here we imaged the activity of these muscles in a fly using a genetically encoded calcium indicator, while simultaneously tracking the three-dimensional motion of the wings with high-speed cameras. Using machine learning, we created a convolutional neural network that accurately predicts wing motion from the activity of the steering muscles, and an encoder-decoder that predicts the role of the individual sclerites on wing motion. By replaying patterns of wing motion on a dynamically scaled robotic fly, we quantified the effects of steering muscle activity on aerodynamic forces. A physics-based simulation incorporating our hinge model generates flight manoeuvres that are remarkably similar to those of free-flying flies. This integrative, multi-disciplinary approach reveals the mechanical control logic of the insect wing hinge, arguably among the most sophisticated and evolutionarily important skeletal structures in the natural world.

Recent developments in machine vision methods for automatic, quantitative analysis of social behavior have immensely improved both the scale and level of resolution with which we can dissect interactions between members of the same species. In this paper, we review these methods, with a particular focus on how biologists can apply them to their own work. We discuss several components of machine vision-based analyses: methods to record high-quality video for automated analyses, video-based tracking algorithms for estimating the positions of interacting animals, and machine learning methods for recognizing patterns of interactions. These methods are extremely general in their applicability, and we review a subset of successful applications of them to biological questions in several model systems with very different types of social behaviors.

Connections between neurons can be found by checking whether synapses exist at points of contact, which in turn are determined by neural shapes. Finding these shapes is a special case of image segmentation, which is laborious for humans and would ideally be performed by computers. New metrics properly quantify the performance of a computer algorithm using its disagreement with ’true’ segmentations of example images. New machine learning methods search for segmentation algorithms that minimize such metrics. These advances have reduced computer errors dramatically. It should now be faster for a human to correct the remaining errors than to segment an image manually. Further reductions in human effort are expected, and crucial for finding connectomes more complex than that of Caenorhabditis elegans.

Calreticulin (CALR) is primarily an endoplasmic reticulum chaperone protein that also plays a key role in facilitating programmed cell removal (PrCR) by acting as an "eat-me" signal for macrophages, directing their recognition and engulfment of dying, diseased, or unwanted cells. Recent findings have demonstrated that macrophages can transfer their own CALR onto exposed asialoglycans on target cells, marking them for PrCR. Despite the critical role CALR plays in this process, the molecular mechanisms behind its secretion by macrophages and the formation of binding sites on target cells remain unclear. Our findings show that CALR undergoes C-terminal cleavage upon secretion, producing a truncated form that functions as the active eat-me signal detectable on target cells. We identify cathepsins as potential proteases involved in this cleavage process. Furthermore, we demonstrate that macrophages release neuraminidases, which modify the surface of target cells and facilitate CALR binding. These insights reveal a coordinated mechanism through which lipopolysaccharide (LPS)-activated macrophages regulate CALR cleavage and neuraminidase activity to mark target cells for PrCR. How they recognize the cells to be targeted remains unknown.

Pathogen-mediated activation of macrophages arms innate immune responses that include enhanced surface ruffling and macropinocytosis for environmental sampling and receptor internalization and signaling. Activation of macrophages with bacterial lipopolysaccharide (LPS) generates prominent dorsal ruffles, which are precursors for macropinosomes. Very rapid, high-resolution imaging of live macrophages with lattice light sheet microscopy (LLSM) reveals new features and actions of dorsal ruffles, which redefine the process of macropinosome formation and closure. We offer a new model in which ruffles are erected and supported by F-actin tent poles that cross over and twist to constrict the forming macropinosomes. This process allows for formation of large macropinosomes induced by LPS. We further describe the enrichment of active Rab13 on tent pole ruffles and show that CRISPR deletion of Rab13 results in aberrant tent pole ruffles and blocks the formation of large LPS-induced macropinosomes. Based on the exquisite temporal and spatial resolution of LLSM, we can redefine the ruffling and macropinosome processes that underpin innate immune responses.

Macroscale fluorescence imaging is increasingly used to observe biological samples. However, it may suffer from spectral interferences that originate from ambient light or autofluorescence of the sample or its support. In this manuscript, we built a simple and inexpensive fluorescence macroscope, which has been used to evaluate the performance of Speed OPIOM (Out of Phase Imaging after Optical Modulation), which is a reference-free dynamic contrast protocol, to selectively image reversibly photoswitchable fluorophores as labels against detrimental autofluorescence and ambient light. By tuning the intensity and radial frequency of the modulated illumination to the Speed OPIOM resonance and adopting a phase-sensitive detection scheme that ensures noise rejection, we enhanced the sensitivity and the signal-to-noise ratio for fluorescence detection in blot assays by factors of 50 and 10, respectively, over direct fluorescence observation under constant illumination. Then, we overcame the strong autofluorescence of growth media that are currently used in microbiology and realized multiplexed fluorescence observation of colonies of spectrally similar fluorescent bacteria with a unique configuration of excitation and emission wavelengths. Finally, we easily discriminated fluorescent labels from the autofluorescent and reflective background in labeled leaves, even under the interference of incident light at intensities that are comparable to sunlight. The proposed approach is expected to find multiple applications, from biological assays to outdoor observations, in fluorescence macroimaging.