Introduction to Big data Technology

TL;DR

This chapter provides a comprehensive overview of big data technology, covering its history, characteristics, technological stacks, and resources, emphasizing its widespread application and evolving complexity.

Contribution

It offers a detailed introduction to big data's evolution, characteristics, and technological infrastructure, serving as a foundational resource for understanding big data systems.

Findings

Big data has evolved from 3V's to 10V's, reflecting increasing complexity.

Big data technology stacks include infrastructure, platforms, and components.

Widespread application of big data across sectors is driven by AI integration.

Abstract

Big data is no more "all just hype" but widely applied in nearly all aspects of our business, governments, and organizations with the technology stack of AI. Its influences are far beyond a simple technique innovation but involves all rears in the world. This chapter will first have historical review of big data; followed by discussion of characteristics of big data, i.e. from the 3V's to up 10V's of big data. The chapter then introduces technology stacks for an or-ganization to build a big data application, from infrastruc-ture/platform/ecosystem to constructional units and components. Finally, we provide some big data online resources for reference.