FernUni LLM Experimental Infrastructure (FLEXI) -- Enabling Experimentation and Innovation in Higher Education Through Access to Open Large Language Models

TL;DR

FLEXI is an infrastructure at FernUniversität Hagen that facilitates experimentation with open large language models in higher education, aiming to provide evidence for their use and practical guidance for implementation.

Contribution

This paper introduces the FLEXI infrastructure, enabling research and experimentation with open LLMs in higher education, addressing access challenges and supporting informed decision-making.

Findings

FLEXI supports experimentation in teaching and research.

Provides practical guidance for deploying LLM servers.

Aims to generate evidence on open LLMs in education.

Abstract

Using the full potential of LLMs in higher education is hindered by challenges with access to LLMs. The two main access modes currently discussed are paying for a cloud-based LLM or providing a locally maintained open LLM. In this paper, we describe the current state of establishing an open LLM infrastructure at FernUniversit\"at in Hagen under the project name FLEXI (FernUni LLM Experimental Infrastructure). FLEXI enables experimentation within teaching and research with the goal of generating strongly needed evidence in favor (or against) the use of locally maintained open LLMs in higher education. The paper will provide some practical guidance for everyone trying to decide whether to run their own LLM server.