Supporting SENCOTEN Language Documentation Efforts with Automatic Speech Recognition

TL;DR

This paper presents an ASR-based pipeline utilizing augmented data and transfer learning to support SENCOTEN language documentation, achieving promising accuracy despite limited data and complex linguistic features.

Contribution

It introduces a novel ASR-driven documentation pipeline combining augmented speech data, cross-lingual transfer, and language modeling for low-resource polysynthetic languages.

Findings

Achieved 19.34% WER and 5.09% CER on SENCOTEN test data.

Improved WER to 14.32% after filtering minor errors.

Demonstrated potential for supporting language revitalization efforts.

Abstract

The SENCOTEN language, spoken on the Saanich peninsula of southern Vancouver Island, is in the midst of vigorous language revitalization efforts to turn the tide of language loss as a result of colonial language policies. To support these on-the-ground efforts, the community is turning to digital technology. Automatic Speech Recognition (ASR) technology holds great promise for accelerating language documentation and the creation of educational resources. However, developing ASR systems for SENCOTEN is challenging due to limited data and significant vocabulary variation from its polysynthetic structure and stress-driven metathesis. To address these challenges, we propose an ASR-driven documentation pipeline that leverages augmented speech data from a text-to-speech (TTS) system and cross-lingual transfer learning with Speech Foundation Models (SFMs). An n-gram language model is also incorporated via shallow fusion or n-best restoring to maximize the use of available data. Experiments on the SENCOTEN dataset show a word error rate (WER) of 19.34% and a character error rate (CER) of 5.09% on the test set with a 57.02% out-of-vocabulary (OOV) rate. After filtering minor cedilla-related errors, WER improves to 14.32% (26.48% on unseen words) and CER to 3.45%, demonstrating the potential of our ASR-driven pipeline to support SENCOTEN language documentation.