Enabling On-Demand Database Computing with MIT SuperCloud Database Management System
Andrew Prout, Jeremy Kepner, Peter Michaleas, William Arcand, David, Bestor, Bill Bergeron, Chansup Byun, Lauren Edwards, Vijay Gadepally, Matthew, Hubbell, Julie Mullen, Antonio Rosa, Charles Yee, Albert Reuther
TL;DR
The paper presents MIT SuperCloud, a system that enables rapid, on-demand deployment and management of scientific databases on high-performance computing clusters, facilitating flexible experimentation and resource allocation.
Contribution
It introduces a system that seamlessly integrates scientific databases with HPC clusters, allowing dynamic creation, migration, snapshotting, and management of databases.
Findings
Supports rapid database deployment on HPC clusters
Enables seamless database migration and snapshotting
Facilitates flexible scientific database experimentation
Abstract
The MIT SuperCloud database management system allows for rapid creation and flexible execution of a variety of the latest scientific databases, including Apache Accumulo and SciDB. It is designed to permit these databases to run on a High Performance Computing Cluster (HPCC) platform as seamlessly as any other HPCC job. It ensures the seamless migration of the databases to the resources assigned by the HPCC scheduler and centralized storage of the database files when not running. It also permits snapshotting of databases to allow researchers to experiment and push the limits of the technology without concerns for data or productivity loss if the database becomes unstable.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.