diff --git a/README.md b/README.md index a5002c3..18240a9 100644 --- a/README.md +++ b/README.md @@ -1,7 +1,23 @@ # WaveGenSynth synth -WaveGenSynth is a unique synthesizer that leverages diffusion techniques to create playable sounds. It can seamlessly integrate into your musical workflow as a VST, AU, standalone application, or run directly from the source code. +WaveGenSynth is a unique synthesizer that leverages diffusion techniques to create playable sounds. It can seamlessly integrate into your musical workflow as a VST, AU, standalone application, or run directly from the source code. The digital instrument is the result of my bachelor thesis [Text-to-Playable-Sound: synthesizers based on latent diffusion technology](https://github.com/suckrowPierre/BachelorThesis). + +## [Text-to-Playable-Sound: synthesizers based on latent diffusion technology](https://github.com/suckrowPierre/BachelorThesis) + +In this study, the integration and applicability of generative artificial intelligence in the field of music +production was analyzed through the introduction of a digital instrument. Using selected diffusion models, +users can define sounds through textual descriptions and play and manipulate them with standardized music +production tools. The diffusion models used were evaluated for their suitability in the given context and +modified for integration into a digital instrument. Using certain frameworks, the digital instrument was +created, resulting in a user interface. This allows users to edit model and instrument-specific parameters. The +analysis showed that the models used do not always adequately respond to the context of music production, +resulting in unexpected sound patterns or abstract artifacts. Currently, available text-to-audio models do not +provide high-quality reproduction of familiar sounds but offer opportunities for experimental applications. +The implementation of a prototype of the digital instrument allows for such experiments and the exploration +of innovative sound synthesis methods. However, functions are currently missing to reproduce selected areas +of the generated sounds or to play them indefinitely. Nevertheless, fascinating and unusual soundscapes can +already be produced, which could potentially find application in musical compositions. ## Table of Contents - [Installation](#installation) @@ -10,6 +26,7 @@ WaveGenSynth is a unique synthesizer that leverages diffusion techniques to crea - [Mac](#mac) - [Windows](#windows) - [Usage](#usage) +- [Model-evaluation](#modelevaluation) - [Credits](#credits) ## Installation @@ -57,6 +74,9 @@ Operating WaveGenSynth is straightforward: 5. Select the appropriate MIDI input device. 6. Enjoy creating and playing sounds! +## Modelevaluation +The effect of different torch-devices, parameters and prompts on the available pre-trained models are displayed [here](https://suckrowpierre.github.io/TtPS.github.io/) + ## Credits WaveGenSynth was crafted using the following technologies: