Musical Score Following and Audio Alignment
Lin Hao Lee

TL;DR
This paper reviews score following research, introduces new evaluation datasets, and presents three diverse score followers, notably a CQT-DTW method that outperforms traditional FFT-based approaches in robustness and accuracy.
Contribution
It introduces two open-source evaluation testbenches, a new dataset for qualitative benchmarking, and develops three score followers, including a novel CQT-DTW method that improves robustness in complex musical scenarios.
Findings
CQT-DTW score follower outperforms FFT-based methods.
Introduction of QualScofo dataset for qualitative benchmarking.
Development of diverse score followers demonstrating different applications.
Abstract
Real-time tracking of the position of a musical performance on a musical score, i.e. score following, can be useful in music practice, performance and production. Example applications of such technology include computer-aided accompaniment and automatic page turning. Score following is a challenging task, especially when considering deviations in performance data from the score stemming from mistakes or expressive choices. In this project, the extensive research present in the field is first explored before two open-source evaluation testbenches for score following--one quantitative and the other qualitative--are introduced. A new way of obtaining quantitative testbench data is proposed, and the QualScofo dataset for qualitative benchmarking is introduced. Subsequently, three different score followers, each of a different class, are implemented. First, a beat-based follower for an…
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsMusic and Audio Processing · Diverse Musicological Studies · Music Technology and Sound Studies
