Object-based synthesis of scraping and rolling sounds based on non-linear physical constraints

TL;DR

This paper introduces a novel physically-constrained source-filter model for realistic synthesis of scraping and rolling sounds, capturing complex interactions and material-dependent variations, validated through perceptual experiments.

Contribution

It presents a new non-linear physical model that accurately synthesizes scraping and rolling sounds with controllable parameters based on mechanics principles.

Findings

Synthesizes realistic scraping and rolling sounds

Captures material-dependent and location-based variations

Validated by perceptual experiments confirming realism

Abstract

Sustained contact interactions like scraping and rolling produce a wide variety of sounds. Previous studies have explored ways to synthesize these sounds efficiently and intuitively but could not fully mimic the rich structure of real instances of these sounds. We present a novel source-filter model for realistic synthesis of scraping and rolling sounds with physically and perceptually relevant controllable parameters constrained by principles of mechanics. Key features of our model include non-linearities to constrain the contact force, naturalistic normal force variation for different motions, and a method for morphing impulse responses within a material to achieve location-dependence. Perceptual experiments show that the presented model is able to synthesize realistic scraping and rolling sounds while conveying physical information similar to that in recorded sounds.