Big Data

TL;DR

This paper reviews the sources, benefits, challenges, and technologies related to big data, especially in emergency management, highlighting Spark and societal concerns.

Contribution

It provides a comprehensive overview of big data sources, technologies like Spark, and ethical issues, specifically in the context of emergency management.

Findings

Big data sources include IoT, social media, and crowdsourcing.

Spark is a key technology for big data processing.

Big data presents ethical and societal challenges.

Abstract

The Internet of Things, crowdsourcing, social media, public authorities, and other sources generate bigger and bigger data sets. Big and open data offers many benefits for emergency management, but also pose new challenges. This chapter will review the sources of big data and their characteristics. We then discuss potential benefits of big data for emergency management along with the technological and societal challenges it poses. We review central technologies for big-data storage and processing in general, before presenting the Spark big-data engine in more detail. Finally, we review ethical and societal threats that big data pose.