Steerable discovery of neural audio effects
Christian J. Steinmetz, Joshua D. Reiss

TL;DR
This paper presents a new method for creating neural audio effects that can be steered and controlled by user-provided examples, expanding creative possibilities beyond traditional analog effects.
Contribution
It introduces a novel approach for designing neural audio effects that are steerable and based on user examples, enabling intuitive sound transformations.
Findings
Produces effects similar to target effects with interesting inaccuracies.
Provides perceptually relevant controls for effect manipulation.
Enables user-guided design of neural audio effects.
Abstract
Applications of deep learning for audio effects often focus on modeling analog effects or learning to control effects to emulate a trained audio engineer. However, deep learning approaches also have the potential to expand creativity through neural audio effects that enable new sound transformations. While recent work demonstrated that neural networks with random weights produce compelling audio effects, control of these effects is limited and unintuitive. To address this, we introduce a method for the steerable discovery of neural audio effects. This method enables the design of effects using example recordings provided by the user. We demonstrate how this method produces an effect similar to the target effect, along with interesting inaccuracies, while also providing perceptually relevant controls.
Peer Reviews
No public reviews on file for this paper yet. If you reviewed it on a platform where reviews are public (OpenReview, ICLR, NeurIPS, ICML), you can paste yours below so the community can read it here.
Code & Models
Videos
No videos yet. Explain this paper in a talk, walkthrough, or lecture? Add one.
Taxonomy
TopicsMusic and Audio Processing · Music Technology and Sound Studies · Speech and Audio Processing
