GuitarFlow: Realistic Electric Guitar Synthesis From Tablatures via Flow Matching and Style Transfer

TL;DR

GuitarFlow is a novel AI model that synthesizes realistic electric guitar audio from tablatures by combining style transfer with flow matching, enabling expressive and controllable guitar sound generation with minimal training data.

Contribution

The paper introduces GuitarFlow, a new approach that uses tablatures and style transfer with flow matching for realistic guitar synthesis, requiring less than 6 hours of training data.

Findings

Significant improvement in audio realism demonstrated through evaluation and listening tests.

Efficient training process with less than 6 hours of data.

Effective representation of guitar techniques via tablatures.

Abstract

Music generation in the audio domain using artificial intelligence (AI) has witnessed steady progress in recent years. However for some instruments, particularly the guitar, controllable instrument synthesis remains limited in expressivity. We introduce GuitarFlow, a model designed specifically for electric guitar synthesis. The generative process is guided using tablatures, an ubiquitous and intuitive guitar-specific symbolic format. The tablature format easily represents guitar-specific playing techniques (e.g. bends, muted strings and legatos), which are more difficult to represent in other common music notation formats such as MIDI. Our model relies on an intermediary step of first rendering the tablature to audio using a simple sample-based virtual instrument, then performing style transfer using Flow Matching in order to transform the virtual instrument audio into more realistic sounding examples. This results in a model that is quick to train and to perform inference, requiring less than 6 hours of training data. We present the results of objective evaluation metrics, together with a listening test, in which we show significant improvement in the realism of the generated guitar audio from tablatures.