f-f Workflows - Flux ControlNets

1. Required Models and Files

• Main Model Checkpoints:

• realflux10b_10bTransformerDev.safetensors

• Download: https://civitai.com/models/788550/realflux-10b

• flux1-schnell.safetensors

• Download: https://huggingface.co/black-forest-labs/FLUX.1-schnell/tree/main

• flux1-dev.safetensors

• Download: https://huggingface.co/black-forest-labs/FLUX.1-dev/tree/main

• ae.safetensors (VAE)

• Download: https://huggingface.co/black-forest-labs/FLUX.1-schnell/blob/main/ae.safetensors

• clip_l.safetensors (CLIP model)

• Download: https://huggingface.co/comfyanonymous/flux_text_encoders/blob/main/clip_l.safetensors

• t5xxl_fp8_e4m3fn.safetensors (T5 encoder)

• Download: https://huggingface.co/comfyanonymous/flux_text_encoders/blob/main/t5xxl_fp8_e4m3fn.safetensors

• LoRA Files (optional):

• InteriorDesigner-Flux_v4.safetensors

• Download: https://form-finder.squarespace.com/download-models/p/interiordesigner-flux

• FormFinder-Flux_v2.safetensors

• Download: https://form-finder.squarespace.com/download-models/p/formfinder-flux

• ControlNet Models:

• flux-jasper-normal-controlnet.safetensors

• Download: https://huggingface.co/jasperai/Flux.1-dev-Controlnet-Surface-Normals/tree/main

• flux-canny-controlnet-v3.safetensors

• Download: https://huggingface.co/XLabs-AI/flux-controlnet-canny-v3/tree/main

2. Placement of Downloaded Models

• Place the Transformer (Unet): Place in ComfyUI/models/unet/

• LoRA Models: Place in ComfyUI/models/loras/

• VAE: Place in ComfyUI/models/vae/

• CLIP Models: Place in ComfyUI/models/clip/

• ControlNet Models: Place in ComfyUI/models/controlnet/

3. Custom Nodes Used

The workflow utilizes the following custom nodes:

• Derfuu_ComfyUI_Modde dNodes

  • Automates calculations based on image sizes or other parameters.

  • Author: Derfuu

• Various ComfyUI Nodes by Type

  • Nodes include JWInteger, JWFloat, JWString, JWImageLoadRGB, JWImageResize, etc.

  • Author: jamesWalker

• rgthree's ComfyUI Nodes

  • Includes Seed, Reroute, Context, Lora Loader Stack, Context Switch, Fast Muter.

  • Author: rgthree

• Save Image with Generation Metadata

  • Saves images with metadata and is compatible with Civitai & Prompthero geninfo auto-detection.

  • Author: Girish Gopalakrishnan

• ComfyUI Easy Use

  • Enhances usability with optimizations and integrations for commonly used nodes.

  • Author: yolain

• ComfyUI's ControlNet Auxiliary Preprocessors

  • Plug-and-play nodes for making ControlNet hint images.

  • Author: Fannovel16

• ComfyUI-Advanced-ControlNet

  • Schedules ControlNet strength across timesteps and latents, with weights and masks.

  • Author: Kosinkadink

• UltimateSDUpscale

  • Nodes for the Ultimate Stable Diffusion Upscale script.

  • Author: ssitu

These custom nodes are part of ComfyUI's extended capabilities and may require installing additional custom node packs. Ensure you have the latest versions of these nodes by checking the ComfyUI GitHub repository or its community plugins.

By following this guide, you should be able to set up your ComfyUI workflow with the necessary models and custom nodes.