IPAdapter

https://github.com/cubiq/ComfyUI_IPAdapter_plus

Update the VLM Nodes from github

https://github.com/gokayfem/ComfyUI_VLM_nodes

Download both from the link below mmproj-model-f16.gguf and llava-v1.6-mistral-7b.Q5_K_M.gguf model and put them into models/LLavacheckpoints

https://huggingface.co/cjpais/llava-1.6-mistral-7b-gguf/tree/main