MusicGen Melody

⚠️ This module requires at least 16GB RAM ⚠️

Informations

• Module : MusicGen Melody
• Function : Generate music from a prompt with guidance from an input audio, using MusicGen
• Input(s) : Input prompt, Input audio
• Output(s) : Generated music
• HF model page :
  • facebook/musicgen-melody

Help

• Usage :
  • Select an audio source type (file or micro recording)
  • Select an audio source by choosing a file or recording something
  • Fill the prompt by describing the music you want to generate from the audio source
  • (optional) Modify the settings to change audio duration or inferences parameters
  • Click the Generate button
  • After generation, generated music is available to listen in the Generated music field.

Examples

• Source audio : Generated in MusicGen with prompt Heavy metal with drums and electric guitars, heavy bass

musicgen_melody_input.webm

• Prompt : a symphonic orchestra, dynamic opera
• Output :

musicgen_melody_output.webm