MusGU+ Evaluation: SCAPES

The Music-Generative Usable+ AI (MusGU+) framework is a musician-centered evaluation framework designed to assess how generative music models can be adapted, used, and controlled in real-world creative contexts. The framework evaluates models along three complementary dimensions, with each dimension addressing a key question from the musician's perspective:

📖 Read the detailed evaluation criteria, return to the discovery tool or inspect the model's YAML source file.

Affiliation: Music Technology Group, Universitat Pompeu Fabra

Architecture: continuous normalizing flow

Evaluation focuses on SCAPES, a lightweight generative framework for semantically controllable environmental sound synthesis. The paper is forthcoming at DAFx 2026 and is not yet publicly available.

Musical applications

audio synthesis, environmental sound generation

Adaptability

90%

Hardware Requirements

✔︎ Fully supported

SCAPES can be trained on consumer-grade hardware. The paper reports training a 36-million-parameter model on a single NVIDIA RTX 4090 with peak VRAM usage below 8 GB, and the authors additionally report that training can be performed on CPU, although more slowly.

Dataset Size

✔︎ Fully supported

SCAPES is explicitly designed for adaptation with small datasets. The paper demonstrates successful training on approximately 34 minutes of uncurated audio across ten environmental sound categories.

Adaptation Pathways

✔︎ Fully supported

The repository provides a complete training workflow for custom audio datasets, including data preparation and training. SCAPES trains the generative prior over representations from a pretrained EnCodec model, avoiding the need to train the audio codec itself.

Technical Barriers

~ Partially supported

Training requires users to configure a software environment and prepare their dataset themselves. However, a guided Colab notebook covers data preparation and training, substantially reducing the technical barrier compared with an undocumented or code-only training workflow.

Model Redistribution

✔︎ Fully supported

SCAPES is intended for open redistribution of trained and adapted models, with the released weights and derivatives subject only to the attribution requirements of the project's permissive license.

Usability

67%

Interface Availability

✔︎ Fully supported

SCAPES provides a publicly accessible Hugging Face Space with a graphical interface for generation and semantic interpolation. The Gradio interface code is also released in a separate repository for local use.

Access Restrictions

✔︎ Fully supported

SCAPES is publicly available for local use through its released code and example model weights, without subscriptions, usage quotas, or time limits. A publicly accessible Hugging Face Space also allows users to try the model without local installation.

Real-time Capabilities

~ Partially supported

SCAPES does not currently provide a real-time interactive implementation. However, the paper reports inference faster than real time when using 16 ODE steps, indicating sufficient computational efficiency for offline generation and potential future real-time applications.

Workflow Integration

✘ Not supported

No dedicated integration with DAWs, plugins, musical hardware, or other musician-facing production environments is currently provided.

Output Licensing

✔︎ Fully supported

Generated outputs are intended to be freely usable and redistributable without non-commercial restrictions.

Community Support

~ Partially supported

The project provides a public GitHub repository for development and issue reporting, but no dedicated user community, forum, Discord server, or other musician-facing support space is currently identified.

Controllability

75%

Conditioning Inputs

✔︎ Fully supported

SCAPES combines audio-derived semantic conditioning with autoregressive audio context. CLAP embeddings provide high-level semantic guidance, while a memory buffer of previously generated or supplied audio segments conditions each new segment on its preceding acoustic context.

Time-Varying Control

✔︎ Fully supported

SCAPES supports time-varying semantic control at a 10 Hz control rate. The semantic conditioning path can change continuously during generation, enabling smooth transitions and interpolations between environmental sound classes.

Feature Disentanglement

~ Partially supported

Semantic conditioning can steer generation between distinct environmental sound classes and intermediate semantic states. However, the control space does not explicitly isolate individual acoustic or perceptual attributes, and transitions may simultaneously affect multiple properties of the generated sound.

Control Parameters

~ Partially supported

The demo exposes configurable generation parameters including diffusion steps and CFG scale, as well as a timeline-based interface for placing semantic sound anchors and interpolating between them. However, it does not provide a broad set of independent generation parameters or direct manipulation of internal model representations.