Lessons from A Large Language Model-based Outdoor Trail Recommendation Chatbot with Retrieval Augmented Generation

TL;DR

This paper presents Judy, an outdoor trail recommendation chatbot using large language models with retrieval augmented generation, demonstrating its accuracy and usability through case studies in Connecticut.

Contribution

It introduces a novel LLM-based chatbot for outdoor trail recommendations utilizing retrieval augmented generation, with practical insights from real-world case studies.

Findings

Judy effectively recommends outdoor trails with high accuracy.

The system demonstrates good usability and user satisfaction.

Retrieval augmented generation improves recommendation relevance.

Abstract

The increasing popularity of outdoor recreational activities (such as hiking and biking) has boosted the demand for a conversational AI system to provide informative and personalized suggestion on outdoor trails. Challenges arise in response to (1) how to provide accurate outdoor trail information via conversational AI; and (2) how to enable usable and efficient recommendation services. To address above, this paper discusses the preliminary and practical lessons learned from developing Judy, an outdoor trail recommendation chatbot based on the large language model (LLM) with retrieval augmented generation (RAG). To gain concrete system insights, we have performed case studies with the outdoor trails in Connecticut (CT), US. We have conducted web-based data collection, outdoor trail data management, and LLM model performance studies on the RAG-based recommendation. Our experimental results have demonstrated the accuracy, effectiveness, and usability of Judy in recommending outdoor trails based on the LLM with RAG.