Main Menu (Mobile)- Block

Main Menu - Block

The Open Connectome Project Data Cluster: Scalable analysis and vision for high-throughput neuroscience.

Our Research / Publications
janelia7_blocks-janelia7_biblio_header | block
Scientific and Statistical Database Management: International Conference, SSDBM ... : Proceedings. International Conference on Scientific and Statistical Database Management. 2013 Jun 18;. doi: 10.1145/2484838.2484870
The Open Connectome Project Data Cluster: Scalable analysis and vision for high-throughput neuroscience. Bock Lab
Burns R, Roncal WG, Kleissas D, Lillaney K, Manavalan P, Perlman E, Berger DR, Bock DD, Chung K, Grosenick L, Kasthuri N, Weiler NC, Deisseroth K, Kazhdan M, Lichtman J, Reid RC, Smith SJ, Szalay AS, Vogelstein JT, Vogelstein RJ
janelia7_blocks-janelia7_biblio_abstract | block

Abstract

We describe a scalable database cluster for the spatial analysis and annotation of high-throughput brain imaging data, initially for 3-d electron microscopy image stacks, but for time-series and multi-channel data as well. The system was designed primarily for workloads that build connectomes- neural connectivity maps of the brain-using the parallel execution of computer vision algorithms on high-performance compute clusters. These services and open-science data sets are publicly available at openconnecto.me. The system design inherits much from NoSQL scale-out and data-intensive computing architectures. We distribute data to cluster nodes by partitioning a spatial index. We direct I/O to different systems-reads to parallel disk arrays and writes to solid-state storage-to avoid I/O interference and maximize throughput. All programming interfaces are RESTful Web services, which are simple and stateless, improving scalability and usability. We include a performance evaluation of the production system, highlighting the effec-tiveness of spatial data organization.

node:body | entity_field
janelia7_blocks-janelia7_biblio_tools | block