Sedano: A News Stream Processor for Business

TL;DR

Sedano is a scalable, fault-tolerant system that processes, enriches, and indexes business news streams, enabling efficient retrieval and filtering for business intelligence applications.

Contribution

It introduces a flexible, scalable architecture for real-time business news processing with entity linking and classification capabilities.

Findings

Efficient indexing of business news streams

Supports filtering by company and event types

Deployable on commodity hardware

Abstract

We present Sedano, a system for processing and indexing a continuous stream of business-related news. Sedano defines pipelines whose stages analyze and enrich news items (e.g., newspaper articles and press releases). News data coming from several content sources are stored, processed and then indexed in order to be consumed by Atoka, our business intelligence product. Atoka users can retrieve news about specific companies, filtering according to various facets. Sedano features both an entity-linking phase, which finds mentions of companies in news, and a classification phase, which classifies news according to a set of business events. Its flexible architecture allows Sedano to be deployed on commodity machines while being scalable and fault-tolerant.