Open Korean Corpora: A Practical Report

TL;DR

This paper reviews existing Korean language corpora, highlights resource availability issues, and proposes guidelines for open-source dataset creation to support research in low-resource languages.

Contribution

It curates Korean corpora, reviews current datasets, and offers a practical framework for open-source dataset development for less-resourced languages.

Findings

Identifies gaps in Korean resource availability

Provides a curated list of Korean datasets

Suggests best practices for dataset sharing

Abstract

Korean is often referred to as a low-resource language in the research community. While this claim is partially true, it is also because the availability of resources is inadequately advertised and curated. This work curates and reviews a list of Korean corpora, first describing institution-level resource development, then further iterate through a list of current open datasets for different types of tasks. We then propose a direction on how open-source dataset construction and releases should be done for less-resourced languages to promote research.