Learnability with Time-Sharing Computational Resource Concerns

TL;DR

This paper introduces a theoretical framework for machine learning that accounts for limited computational resources, emphasizing throughput and adaptive resource management in streaming data scenarios.

Contribution

It proposes the concept of CoRE-Learning and a new framework integrating computational resource constraints into learning theory, applicable to stream learning and supercomputing systems.

Findings

Defines machine learning throughput and CoRE-Learning.

Provides a theoretical model incorporating computational resources.

Applicable to endless data streams and resource-aware system design.

Abstract

Conventional theoretical machine learning studies generally assume explicitly or implicitly that there are enough or even infinitely supplied computational resources. In real practice, however, computational resources are usually limited, and the performance of machine learning depends not only on how many data have been received, but also on how many data can be handled subject to computational resources available. Note that most current ``intelligent supercomputing'' facilities work like exclusive operating systems, where a fixed amount of resources are allocated to a machine learning task without adaptive scheduling strategies considering important factors such as the learning performance demands and learning process status. In this article, we introduce the notion of machine learning throughput, define Computational Resource Efficient Learning (CoRE-Learning), and present a theoretical framework that takes into account the influence of computational resources in learning theory. This framework can be naturally applied to stream learning where the incoming data streams can be potentially endless with overwhelming size and it is impractical to assume that all received data can be handled in time. It may also provide a theoretical perspective for the design of intelligent supercomputing operating systems.