Need to catch up?

The plan for this stream

  1. Quick Setup
  2. Find the right ControlNet models
  3. Get started with ControlNet in ComfyUI
  4. Do some more creative work with depth maps
  5. Generate the image from the thumbnail

Quick Run Through the Requirements and Setup

What do I need?

(Windows/Linux)

GPU (4GB+ VRAM)
RAM (12GB+)
20GB+ space

What do I need?

(MacOS)

Apple Silicon (M1, M2, M3)
RAM (12GB+)
20GB+ space

Install Stability Matrix

Search for "Stability Matrix"
or click on this link

SDXL ControlNet Workflow

Or download as JSON

SDXL ControlNet References

SD15 ControlNet Workflow

Or download as JSON

SD15 ControlNet References

Sources for ControlNet References

  • General Public Domain References
  • Photographic References

Working with Unsplash References

Reference on Unsplash

Recap

  • You can find the ControlNet models via the Hugging Face section in the model browser in Stability Matrix
  • ControlNet models have to be compatible with the Checkpoint model!
  • SD15 ControlNets only work with SD15 models
  • SDXL ControlNets only work with SDXL models

Video to Depth Map Workflow

Or download as JSON

Video to Depth Map References

Pexels Reference

Video to Depth Map References

Result

Creating the Thumbnail