Bio-Eng-LMM AI Assist chatbot: A Comprehensive Tool for Research and Education
Ali Forootani, Danial Esmaeili Aliabadi, Daniela Thraen

TL;DR
Bio-Eng-LMM AI chatbot is a versatile, open-source platform that combines retrieval-augmented generation, image processing, and web search to support research and education through interactive text and voice responses.
Contribution
It introduces a comprehensive AI chatbot integrating RAG, image understanding, and web search, enhancing research and educational interactions with LLMs.
Findings
Effective retrieval-augmented responses from multiple sources
Supports image generation and understanding within chatbot interactions
Provides coherent multi-modal communication in research and education
Abstract
This article introduces Bio-Eng-LMM AI chatbot, a versatile platform designed to enhance user interaction for educational and research purposes. Leveraging cutting-edge open-source Large Language Models (LLMs), Bio-Eng-LMM operates as a sophisticated AI assistant, exploiting the capabilities of traditional models like ChatGPT. Central to Bio-Eng-LMM is its implementation of Retrieval Augmented Generation (RAG) through three primary methods: integration of preprocessed documents, real-time processing of user-uploaded files, and information retrieval from any specified website. Additionally, the chatbot incorporates image generation via a Stable Diffusion Model (SDM), image understanding and response generation through LLAVA, and search functionality on the internet powered by secure search engine such as DuckDuckGo. To provide comprehensive support, Bio-Eng-LMM offers text summarization,…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsAI in Service Interactions · IoT and Edge/Fog Computing
MethodsRefunds@Expedia|||How do I get a full refund from Expedia? · Attention Is All You Need · Byte Pair Encoding · Softmax · Layer Normalization · WordPiece · Dropout · Attention Dropout · BART · Dense Connections
