Chord conditioned symbolic music generation

Sound Example: https://github.com/gokayfem/ComfyUI_VLM_nodes/assets/88277926/7f22d4f2-b998-402e-88c8-c382a730d624

Project Page: https://ezmonyi.github.io/ChatMusician/

Update VLM Nodes: https://github.com/gokayfem/ComfyUI_VLM_nodes/

Download the GGUF file https://huggingface.co/MaziyarPanahi/ChatMusician-GGUF/tree/main

ChatMusician.Q5_K_M.gguf or ChatMusician.Q5_K_S.gguf recommended. Put them inside models/LLavacheckpoints folder.

You can listen the music inside ComfyUI using PlayMusic Node or directly save it to your output directory with Save Sound

BIG BIG BIG Warning: It does NOT work perfectly, you need to queue prompt again if you got errors.

Text Input: Craft musical works that follow the given chord alterations. 'Am', 'F', 'C', 'G'

Sheet music representation of input chords: X:1 L:1/8 M:2/4 K:Amin |:"Am" A, z C z | E z A z | c4- | c4 | d2 c2 | A2 G2 |"F" A3 G | A2 F2 | E2 F2 | D2 E2 | F4- | F4 | G2 A2 | F2 G2 |1"C" E3 _E | D2 C2 |"G" D4- | D4 :|2 "C" E3 D | C2 B,2 |"Am" A,4- | A,4 :: "Am" A, C E2 | E G A2 |"F" c4 | A4 |"C" c2 d2 | e2 c2 |"G" d3 c | d2 B2 | GA c2 | c2 B2 |"F" A4 | F4 |"G" G3 A | GAGF |1"C" E3 F | EDCB, |"Am" A,4- | A,4 :|2"C" E3 D | C2 B,2 |"Am" A, z3 | z4 :|