MusGU+ Evaluation: Stable Audio 3

The Music-Generative Usable+ AI (MusGU+) framework is a musician-centered evaluation framework designed to assess how generative music models can be adapted, used, and controlled in real-world creative contexts. The framework evaluates models along three complementary dimensions, with each dimension addressing a key question from the musician's perspective:

📖 Read the detailed evaluation criteria, return to the discovery tool or inspect the model's YAML source file.

Affiliation: Stability AI

Architecture: latent diffusion

Evaluation focuses on the publicly released Stable Audio 3 models and workflows. The Small-Music and Medium models are available as open weights, while Large is API-only and is not supported by the repository.

Musical applications

continuation, editing, text-to-music, style transfer

Adaptability

60%

Hardware Requirements

~ Partially supported

The documented LoRA fine-tuning workflow requires a CUDA GPU. The official documentation reports approximately 2 GB of VRAM for the Small model and 5.5–6.5 GB for the Medium model, placing adaptation within the range of consumer-grade GPUs but not practical CPU-only systems.

Dataset Size

✔︎ Fully supported

The LoRA fine-tuning documentation recommends a minimum of approximately 20–50 audio clips, indicating that adaptation is designed to work with relatively small personal datasets.

Adaptation Pathways

✔︎ Fully supported

The repository provides a complete LoRA fine-tuning workflow, including pretrained base checkpoints, raw-audio and pre-encoded dataset modes, a dedicated training script, checkpointing and resume support, and LoRA checkpoint export.

Technical Barriers

✘ Not supported

LoRA fine-tuning is performed through command-line tools and Python-based workflows. Although dedicated documentation is provided, users must configure the software environment, prepare datasets, and run training themselves, and no graphical or notebook-based adaptation interface is provided.

Model Redistribution

~ Partially supported

The Stability AI Community License permits users to create and distribute derivative works, including LoRAs and fine-tuned models. However, commercial use of adapted models is subject to licensing conditions, including an annual revenue threshold above which an Enterprise License may be required.

Usability

75%

Interface Availability

✔︎ Fully supported

Stable Audio 3 provides a publicly accessible Hugging Face Space with a graphical interface for text-to-audio generation. The repository also provides a local Gradio interface for running the model and accessing additional generation and editing workflows.

Access Restrictions

✔︎ Fully supported

Stable Audio 3 can be used through a publicly accessible Hugging Face Space without requiring checkpoint access, a subscription, or a usage tier. The open-weight checkpoints are separately available for local inference, although downloading them requires users to provide contact information and accept the applicable license and terms of use.

Real-time Capabilities

~ Partially supported

Stable Audio 3 is optimized for fast generation and can produce audio within several seconds or less depending on model size, output duration, and hardware. However, it is designed for fast clip generation rather than continuous low-latency streaming or live musical interaction.

Workflow Integration

~ Partially supported

An experimental Ableton Live integration is provided through a MIDI Remote Script and command-line utility. Generated audio files can be inserted into Ableton Live at the current playhead position, with a watch mode for automatically importing new generations. However, the model itself runs externally rather than operating directly within the DAW.

Output Licensing

~ Partially supported

Stability AI states that users own generated outputs and may distribute and commercialize them. However, output use remains subject to the Stability AI Community License and Acceptable Use Policy, including licensing conditions for commercial organizations exceeding the specified annual revenue threshold.

Community Support

✔︎ Fully supported

A public Harmonai Discord server run by the research team is provided for discussion and support, including weekly office hours focused on AI audio and music. GitHub Issues are also available for developer-oriented support and bug reports.

Controllability

38%

Conditioning Inputs

~ Partially supported

Stable Audio 3 supports text prompts and existing audio inputs. Audio can be used as initialization for audio-to-audio generation, or as source/context material for inpainting and continuation.

Time-Varying Control

~ Partially supported

Stable Audio 3 enables time-varying influence through audio initialization, allowing the temporal characteristics of an input recording to guide generation. However, it does not provide explicit or fine-grained time-varying control over musical attributes.

Feature Disentanglement

✘ Not supported

The provided controls are not designed to independently manipulate distinct musical attributes such as timbre, pitch, rhythm, or structure.

Control Parameters

~ Partially supported

The inference workflows expose multiple configurable parameters, including duration, diffusion steps, CFG scale, sampler, seed, and initialization noise level for editing. However, direct manipulation of internal model representations or musically interpretable latent dimensions is not provided.