LLaVA -> LLM -> AudioLDM-2

Example workflow in the examples folder inside github.

Also you can listen the music inside ComfyUI.

Update the VLM Nodes from github.

https://github.com/gokayfem/ComfyUI_VLM_nodes

Download both from the link below mmproj-model-f16.gguf and llava-v1.6-mistral-7b.Q5_K_M.gguf . Put them into models/LLavacheckpoints

https://huggingface.co/cjpais/llava-1.6-mistral-7b-gguf/tree/main

It will automatically download the necessary files into

custom_nodes/ComfyUI_VLM_nodes/nodes/files_for_audioldm2