The Pan-STARRS Data Processing System

Eugene A. Magnier (1); K. C. Chambers (1); H. A. Flewelling (1); J. C.; Hoblitt (2); M. E. Huber (1); P. A. Price (3); W. E. Sweeney (1); C. Z.; Waters (1); L. Denneau (1); P. Draper (4); K. W. Hodapp (1); R. Jedicke (1),; N. Kaiser (1); R.-P. Kudritzki (1); N. Metcalfe (4); C. W. Stubbs (5); R. J.; Wainscoast (1) ((1) UH Institute for Astronomy; (2) LSST Project Management; Office; (3) Department of Astrophysical Sciences Princeton University; (4); Department of Physics Durham University; (5) Harvard-Smithsonian Center for; Astrophysics)

arXiv:1612.05240·astro-ph.IM·November 18, 2020

The Pan-STARRS Data Processing System

Eugene A. Magnier (1), K. C. Chambers (1), H. A. Flewelling (1), J. C., Hoblitt (2), M. E. Huber (1), P. A. Price (3), W. E. Sweeney (1), C. Z., Waters (1), L. Denneau (1), P. Draper (4), K. W. Hodapp (1), R. Jedicke (1),, N. Kaiser (1), R.-P. Kudritzki (1), N. Metcalfe (4)

PDF

TL;DR

The Pan-STARRS Data Processing System manages large-scale image data, enabling real-time detection of astronomical transients and moving objects, and integrates multiple subsystems for comprehensive data handling and analysis.

Contribution

This paper details the design and integration of the Pan-STARRS data processing system, including the image pipeline and its connections to other critical subsystems.

Findings

01

Processed up to 4 terabytes of data nightly

02

Archived over 4 petabytes of raw imagery

03

Enabled real-time detection of transients and moving objects

Abstract

The Pan-STARRS Data Processing System is responsible for the steps needed to downloaded, archive, and process all images obtained by the Pan-STARRS telescopes, including real-time detection of transient sources such as supernovae and moving objects including potentially hazardous asteroids. With a nightly data volume of up to 4 terabytes and an archive of over 4 petabytes of raw imagery, Pan-STARRS is solidly in the realm of Big Data astronomy. The full data processing system consists of several subsystems covering the wide range of necessary capabilities. This article describes the Image Processing Pipeline and its connections to both the summit data systems and the outward-facing systems downstream. The latter include the Moving Object Processing System (MOPS) & the public database: the Published Science Products Subsystem (PSPS).

Peer Reviews

No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.

Videos

No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.