Task queue implementation for edge computing platform

TL;DR

This paper presents the design and implementation of a task queue for an edge computing platform, focusing on reliable asynchronous communication, throughput control, and performance evaluation of different queue aspects.

Contribution

It introduces a task queue with throughput regulation and priority features tailored for edge computing, analyzing its impact on performance and resource efficiency.

Findings

Effective throughput control mechanisms improve system reliability.

Priority queues enhance task management efficiency.

Persistence layer choices significantly affect performance and resource usage.

Abstract

With the rising number of distributed computer systems, from microservice web applications to IoT platforms, the question of reliable communication between different parts of the aforementioned systems is becoming increasingly important. As part of this paper, a task queue, which facilitates reliable asynchronous communication between different services, will be implemented. In order to control the flow of tasks through the queue and limit the load on downstream components, we are going to explore ways of efficiently restricting throughput, and defining priority queues within the task queue service. The research will also take a look at how different aspects of the task queue, such as the underlying persistence layer, affect their performance, reliability, and resource usage. This task queue will be implemented as a component in the already existing platform for managing clusters, constellations