Big Data: Challenges, Opportunities and Realities

TL;DR

This paper discusses the rapid growth of big data due to IoT and Web 2.0, exploring technological challenges, advancements, and future research directions in data storage, processing, and analytics.

Contribution

It provides a comprehensive overview of big data challenges, technological solutions, and limitations, highlighting recent advancements and future research issues.

Findings

Traditional RDBMS have limitations in handling big data

New technologies are developed for big data storage and processing

Big data analytics offers significant insights despite limitations

Abstract

With the advent of Internet of Things (IoT) and Web 2.0 technologies, there has been a tremendous growth in the amount of data generated. This chapter emphasizes on the need for big data, technological advancements, tools and techniques being used to process big data are discussed. Technological improvements and limitations of existing storage techniques are also presented. Since, the traditional technologies like Relational Database Management System (RDBMS) have their own limitations to handle big data, new technologies have been developed to handle them and to derive useful insights. This chapter presents an overview of big data analytics, its application, advantages, and limitations. Few research issues and future directions are presented in this chapter.