Universal Reusability in Recommender Systems: The Case for Dataset- and Task-Independent Frameworks

TL;DR

This paper proposes DTIRS, a framework for recommender systems that emphasizes dataset- and task-independence using a novel dataset description language, aiming to improve reusability and reduce configuration efforts.

Contribution

Introduction of DTIRS, a new framework for recommender systems that leverages DsDL for standardized dataset descriptions to enable greater reusability across tasks and datasets.

Findings

DsDL enables standardized dataset descriptions.

DTIRS facilitates autonomous feature engineering and model selection.

Roadmap for transitioning from dataset-agnostic to fully independent systems.

Abstract

Recommender systems are pivotal in delivering personalized experiences across industries, yet their adoption and scalability remain hindered by the need for extensive dataset- and task-specific configurations. Existing systems often require significant manual intervention, domain expertise, and engineering effort to adapt to new datasets or tasks, creating barriers to entry and limiting reusability. In contrast, recent advancements in large language models (LLMs) have demonstrated the transformative potential of reusable systems, where a single model can handle diverse tasks without significant reconfiguration. Inspired by this paradigm, we propose the Dataset- and Task-Independent Recommender System (DTIRS), a framework aimed at maximizing the reusability of recommender systems while minimizing barriers to entry. Unlike LLMs, which achieve task generalization directly, DTIRS focuses on eliminating the need to rebuild or reconfigure recommendation pipelines for every new dataset or task, even though models may still need retraining on new data. By leveraging the novel Dataset Description Language (DsDL), DTIRS enables standardized dataset descriptions and explicit task definitions, allowing autonomous feature engineering, model selection, and optimization. This paper introduces the concept of DTIRS and establishes a roadmap for transitioning from Level-1 automation (dataset-agnostic but task-specific systems) to Level-2 automation (fully dataset- and task-independent systems). Achieving this paradigm would maximize code reusability and lower barriers to adoption. We discuss key challenges, including the trade-offs between generalization and specialization, computational overhead, and scalability, while presenting DsDL as a foundational tool for this vision.