RiverEcho: Real-Time Interactive Digital System for Ancient Yellow River Culture

TL;DR

RiverEcho is an interactive digital system that uses large language models and a cultural knowledge database to provide real-time, informative responses about the ancient Yellow River culture through a talking digital human.

Contribution

The paper introduces RiverEcho, a novel real-time interactive system that combines retrieval-augmented generation with a specialized cultural database for Yellow River culture.

Findings

Enhanced response quality with RAG on the dataset

System provides professional and informative answers

Diversifies methods for promoting Yellow River culture

Abstract

The Yellow River is China's mother river and a cradle of human civilization. The ancient Yellow River culture is, moreover, an indispensable part of human art history. To conserve and inherit the ancient Yellow River culture, we designed RiverEcho, a real-time interactive system that responds to voice queries using a large language model and a cultural knowledge dataset, delivering explanations through a talking-head digital human. Specifically, we built a knowledge database focused on the ancient Yellow River culture, including the collection of historical texts and the processing pipeline. Experimental results demonstrate that leveraging Retrieval-Augmented Generation (RAG) on the proposed dataset enhances the response quality of the Large Language Model(LLM), enabling the system to generate more professional and informative responses. Our work not only diversifies the means of promoting Yellow River culture but also provides users with deeper cultural insights.