Just compiled my hands-on impressions running DreamBooth on a few cards I’ve got. Unlike inference, DreamBooth is one of the most VRAM-hungry tasks in consumer-grade AI, because it modifies the entire model weights, not just a tiny part like LoRA.
Bottom line: 4090’s 24GB is the sweet spot. For SD1.5, if that’s all you’re doing, 4070 Ti Super’s 16GB with some optimizations can barely get by. Two variables to watch for VRAM: enabling gradient checkpointing saves a ton, without it you’ll need 30-50% more headroom; FP16 is a must.
SDXL full fine-tuning is another tier above 1.5, and prior preservation pushes it even higher. Some cards claim they can run it, but that’s just barely scraping by with model offloading—training speed will be 3-5x slower.
Strictly speaking, that’s “runnable” but not “usable.” Anyone here managed to finish SDXL DreamBooth stably on a 16GB card? Mind sharing what optimizations you used?