Intelligent Management and Efficient Operation of Big Data

TL;DR

This paper discusses how Big Data can be effectively used in networking and computing infrastructures, focusing on knowledge extraction, infrastructure performance enhancement, and efficient network management with policy-based routing, supported by a case study.

Contribution

It introduces an intelligent management solution for routing data traffic with diverse requirements in large-scale networks, demonstrating its application in an Internet Exchange Point.

Findings

Improved data routing efficiency in large networks.

Enhanced performance of cloud processing and networking infrastructures.

Effective management of heterogeneous, unstructured Big Data sources.

Abstract

This chapter details how Big Data can be used and implemented in networking and computing infrastructures. Specifically, it addresses three main aspects: the timely extraction of relevant knowledge from heterogeneous, and very often unstructured large data sources, the enhancement on the performance of processing and networking (cloud) infrastructures that are the most important foundational pillars of Big Data applications or services, and novel ways to efficiently manage network infrastructures with high-level composed policies for supporting the transmission of large amounts of data with distinct requisites (video vs. non-video). A case study involving an intelligent management solution to route data traffic with diverse requirements in a wide area Internet Exchange Point is presented, discussed in the context of Big Data, and evaluated.