AnimateDiff vid2vid: Only animate the person & not the background
created a year ago
vid2vid
face
video
controlnet
lora
animatediff
ipadapter
45 nodes

3.0k

469

Credits
AnimeDiff
Outputs
example video output 0 for workflow.
example video output 1 for workflow.
example video output optimized_comfy_workflows_user_uploads/eb8a17d2-0b28-42c5-8e49-ace0b64faa65/assets/AnimateDiff_00102.webp for workflow.
Description

This is a vid2vid AnimateDiff workflow that only animates the main person in the video, and NOT the background.

I've also uploaded the sample source videos I've used for the outputs shown, in the custom files.

Built-in nodes
Custom nodes
UltralyticsDetectorProvider
SAMLoader
SaveImage
FreeU_V2
FaceDetailer
EmptyLatentImage
CannyEdgePreprocessor
VHS_VideoCombine
SAMModelLoader (segment anything)
GroundingDinoModelLoader (segment anything)
VAEDecode
MaskToImage
ControlNetLoaderAdvanced
HintImageEnchance
Cut By Mask
Paste By Mask
DepthAnythingPreprocessor
LoraLoader
ADE_AnimateDiffLoaderGen1
KSampler
PreviewImage
CheckpointLoaderSimple
GroundingDinoSAMSegment (segment anything)
ACN_AdvancedControlNetApply
ADE_StandardStaticContextOptions
CLIPTextEncode
IPAdapterModelLoader
CLIPVisionLoader
VHS_LoadVideo
Custom files
new

These are separate files that the creator has uploaded for this workflow.

spidey-clip.mp4

drake-silence.mp4

Models
0
0
1
0