Structured Interactive Music Scores

TL;DR

This paper proposes a formal framework combining Time Stream Petri nets and ntcc calculus to model and verify complex interactive music scores with global constraints, integrating multimedia processing.

Contribution

It introduces a heterogeneous system architecture for interactive scores, combining Petri nets and ntcc, and discusses plans for an automatic verifier for ntcc.

Findings

Modeling global constraints explicitly in ntcc improves expressiveness.

Combining Petri nets with ntcc enables better control of multimedia scenarios.

Future development of an automatic verifier will enhance validation of interactive scores.

Abstract

Interactive Scores is a formalism for the design and performance of interactive scenarios that provides temporal relations (TRs) among the objects of the scenario. We can model TRs among objects in Time Stream Petri nets, but it is difficult to represent global constraints. This can be done explicitly in the Non-deterministic Timed Concurrent Constraint (ntcc) calculus. We want to formalize a heterogeneous system that controls in one subsystem the concurrent execution of the objects using ntcc, and audio and video processing in the other. We also plan to develop an automatic verifier for ntcc.