LLM-jp: A Cross-organizational Project for the Research and Development of Fully Open Japanese LLMs

TL;DR

LLM-jp is a collaborative project involving over 1,500 participants aiming to develop open-source, high-quality Japanese large language models through collective research and development efforts.

Contribution

This paper introduces the LLM-jp initiative, highlighting its collaborative approach and summarizing the technical progress in developing Japanese LLMs.

Findings

Successful establishment of a large-scale collaborative research community.

Development of multiple Japanese LLMs with technical reports.

Promotion of open-source Japanese LLMs for broader use.

Abstract

This paper introduces LLM-jp, a cross-organizational project for the research and development of Japanese large language models (LLMs). LLM-jp aims to develop open-source and strong Japanese LLMs, and as of this writing, more than 1,500 participants from academia and industry are working together for this purpose. This paper presents the background of the establishment of LLM-jp, summaries of its activities, and technical reports on the LLMs developed by LLM-jp. For the latest activities, visit https://llm-jp.nii.ac.jp/en/.