Sabi\'a: Um Chatbot de Intelig\^encia Artificial Generativa para Suporte no Dia a Dia do Ensino Superior

TL;DR

This paper presents Sabiá, a generative AI chatbot designed to simplify access to routine university information, addressing fragmentation issues and improving clarity for students in higher education.

Contribution

It introduces a novel chatbot leveraging GenAI and RAG techniques, evaluating multiple models to identify the best options for academic support.

Findings

Gemini 2.0 Flash achieved high quality and speed.

Gemma 3n demonstrated good performance and is open-source.

The chatbot improves access to university information.

Abstract

Students often report difficulties in accessing day-to-day academic information, which is usually spread across numerous institutional documents and websites. This fragmentation results in a lack of clarity and causes confusion about routine university information. This project proposes the development of a chatbot using Generative Artificial Intelligence (GenAI) and Retrieval-Augmented Generation (RAG) to simplify access to such information. Several GenAI models were tested and evaluated based on quality metrics and the LLM-as-a-Judge approach. Among them, Gemini 2.0 Flash stood out for its quality and speed, and Gemma 3n for its good performance and open-source nature.