Evaluating Low-Dimensional Latent Representations as a Creative Interface for Digital Synthesizers

Publication Details

This paper appeared at the 2025 AIMC Conference in Brussels, Belgium.

Paper Link: https://zenodo.org/records/16946459

Summary

This paper presented the results of a user-study that evaluated the latent-representations project I had previously presented in 2023. This study was conducted using mixed-methods and revealed a number of key insights as to how musicians may choose to leverage VAE based representations of synthesizers as part of their existing creative workflows. More information is available in the paper linked above.

Authors

Matthew Peachey, Sageev Oore and Joseph Malloch

Abstract

Description

Synthesizers are musical instruments that typically expose a large set of user-adjustable parameters that shape the sound of the instrument. In this paper, we examine how leveraging low-dimensional latent representations of synthesizer patches enables musicians to generate new patches via exploration of a generative model’s latent space. We evaluate two different latent representations, Latent Coordinates and Timbral Representation, through a mixed-methods user study (n=18). In our study, a mix of novice and experienced musicians engage with both sound matching and sound discovery tasks. Our qualitative results highlight a number of key themes regarding the suitability of our technique with each being supported through related quantitative results. Finally, these results indicate several ways in which this type of support tool may be used in a musician’s existing creative workflow as well as provide a context for discussing the benefits of continuous interactions for generative systems as it relates to creative activities.