Model
Trends
.ai
Model
Trends
.ai
the best open source ai models

Running Stable Diffusion, SDXL and Flux on a Mac (Apple Silicon): Draw Things, ComfyUI and what to expect

Topic: Apps
By Captain
Published 2026-01-21
Share

Overview

Apple Silicon Macs run image models through Metal (MPS in PyTorch, or Apple's own CoreML path in Draw Things). There is no CUDA, so the memory number that matters is the Mac's unified RAM, shared between the CPU and GPU: a 16 GB MacBook Air can run
SDXL
, a 32 GB machine can run
Flux
in fp8 and small video models, a 64 or 128 GB Mac Studio can load almost anything, slowly. Speed is the trade: an M2 Max takes 30 to 60 seconds for an SDXL image that an RTX 4070 does in 6.
Three tools matter. Draw Things is a free native app (Mac, iPhone, iPad) with a model library,
LoRA
import,
ControlNet
,
inpainting
and the best Mac performance because it converts models to CoreML; it is the right first choice for most Mac users.
ComfyUI
runs on Mac from source with PyTorch MPS; it supports everything ComfyUI supports, with some nodes needing fp32 and some custom nodes failing on non-CUDA hardware. DiffusionBee is the simplest one-click app, limited to older models.
Because speed is the bottleneck, Mac users lean on the cloud more than PC users: generate drafts on the cloud partners, bring the keepers to Draw Things for inpainting and personal LoRAs, or simply do everything heavy (Flux at full precision, video) on
PirateDiffusion
or
BitVector
and keep the Mac for browsing this site and editing.

Reference

Name
Type
What it is
8 GB Mac
SD 1.5
only
Draw Things with
SD 1.5
fine-tunes at 512x768; SDXL swaps and crawls.
16 GB Mac
SDXL at 1024x1024 in Draw Things (CoreML 8-bit) or ComfyUI with --force-fp16; Flux via Draw Things 8-bit works but slowly.
32 GB Mac
adds
Flux
fp8,
Z-Image
, small
Wan
Flux dev
8-bit at 1024 in 1 to 3 minutes on M2/M3 Pro-Max;
Wan 2.2 5B
short clips.
64-128 GB Mac Studio / MacBook Pro Max
adds
FLUX.2
,
Qwen Image
,
Wan
14B
Fits in memory; expect 5 to 15 minutes per
Flux.2
image and tens of minutes per video clip.
Draw Things
app
Free, App Store. Model manager, LoRA/ControlNet import, inpainting,
upscalers
, scripts. CoreML speeds up repeated runs after a first compile.
ComfyUI
on MPS
from source
Python 3.12, PyTorch nightly or stable with MPS. Flags: --force-fp16 (M1/M2) or default; --use-split-cross-attention helps memory.
DiffusionBee
app
One-click, SD 1.5/SDXL, limited settings. Fine for a first try.
iogpu.wired_limit_mb
sysctl
Raises the memory macOS lets the GPU allocate (default ~70 percent of RAM). Set to RAM minus 8 GB for large models.
AD
Flux at full speed from your Mac
BitVector Prism runs in Safari: the Flux, FLUX.2 and Qwen models that crawl on Apple Silicon render in seconds on its GPUs. Keep the Mac for Draw Things and editing; send the heavy prompts here.

Step by step

  1. Check your chip and memory: Apple menu > About This Mac. Find your tier in the table.
  2. Install Draw Things from the App Store. Open it, pick a model from its library (SDXL base or DreamShaper XL for a 16 GB Mac), let it download and convert.
  3. Generate a first image at 1024x1024, 20 steps, DPM++ 2M Karras,
    CFG
    6. The first run compiles the CoreML model and is slow; later runs are faster.
  4. Import a LoRA from this site: Models > LoRA > Import, choose the .safetensors; Draw Things converts it. Add the trigger word to the prompt.
  5. For ComfyUI: install Homebrew, Python 3.12 and git; git clone ComfyUI; pip install -r requirements.txt with the MPS-enabled PyTorch; run python main.py; load the default workflow as the ComfyUI beginner guide describes.
  6. In ComfyUI on a 16 GB Mac add --force-fp16 and keep batch size 1; use VAE Decode (Tiled) for sizes above 1024.
  7. For Flux on a 32 GB+ Mac use the fp8 or GGUF Q8 build, the fp8 T5 encoder and expect minutes per image; raise the wired limit if you see memory errors.
  8. Keep heavy jobs for the cloud: open any model page, press the PirateDiffusion or BitVector button and run the same prompt there in seconds.

Examples

ComfyUI start commands on Mac

brew install python@3.12 git
git clone https://github.com/comfyanonymous/ComfyUI && cd ComfyUI && pip3 install -r requirements.txt
python3 main.py --force-fp16 --use-split-cross-attention

Raising the GPU memory limit (64 GB Mac)

sudo sysctl iogpu.wired_limit_mb=57344

Same prompt on the cloud from the Mac

/render <flux-dev> a quiet harbour at dawn, fishing boats, mist, 35mm film look /size:1216x832 /steps:24

Tips

  • Draw Things on an iPhone 15 Pro or newer runs SD 1.5 and small SDXL variants locally; useful for travel, not for volume.
  • Black or blank images on MPS are almost always fp16 overflow: use --force-fp32 for that model or the fp16-fix SDXL VAE.
  • Close memory-hungry apps (browsers with many tabs) before generating; unified memory means Safari and the model compete.
  • Draw Things supports many ComfyUI-era models (Flux,
    Z-Image
    ,
    Qwen Image
    ,
    Wan
    ) earlier than people expect; check its model list before building a ComfyUI setup.
  • Custom nodes that import CUDA-only libraries (xformers, some face tools) fail on Mac; the ComfyUI node guide marks the common ones.
  • Benchmarks to set expectations: SDXL 1024x1024, 25 steps: M1 Pro 90-120 s, M2 Max 35-50 s, M3 Max 25-35 s, M4 Max 18-25 s.

Troubleshooting

Black or grey images

Why it happens
fp16 precision overflow on MPS.

How to fix it
Add --force-fp32 for that model, or use the SDXL fp16-fix VAE; in Draw Things switch the model to the 8-bit or fp32 variant.

"MPS backend out of memory"

Why it happens
macOS GPU allocation limit reached before the RAM is full.

How to fix it
Raise iogpu.wired_limit_mb, lower resolution, use quantised weights.

A custom node fails to import

Why it happens
It depends on CUDA-only packages.

How to fix it
Remove the node or find a Mac-compatible alternative; the core nodes all work.

Very slow first generation in Draw Things

Why it happens
CoreML compilation of the model on first use.

How to fix it
Wait once; subsequent runs are faster. Keep the model loaded between runs.

Flux takes 10 minutes per image

Why it happens
Full-precision weights swapping, or an M1/M2 base chip.

How to fix it
Use the 8-bit build at 20 steps, or run Flux on the cloud and SDXL locally.

AD
PirateDiffusion
Video from a MacBook Air
PirateDiffusion generates Wan 2.2, LTX-2 and H3 clips on its servers and delivers them to Telegram on your Mac or iPhone. Thousands of models, unlimited renders, a fixed monthly price.

Questions

Should I buy a Mac for AI images?

Buy a Mac for other reasons and enjoy that it can do SDXL; buy an NVIDIA PC if AI images or video are the main purpose. Unified memory capacity is great, speed is not.

Does Automatic1111 or Forge run on Mac?

A1111 runs on MPS with the --skip-torch-cuda-test flag and is slower than ComfyUI;
Forge
has limited Mac support. Draw Things or ComfyUI are the practical choices.

Can I train LoRAs on a Mac?

SD 1.5 and SDXL LoRAs train in Draw Things and in kohya with MPS, at a fraction of NVIDIA speed. Flux and video LoRAs: use a cloud trainer.

Is video possible on a Mac?

Wan 2.2 5B and
LTX-2
small variants on 32 GB+ Macs, minutes per clip. For anything larger, the cloud partners.

Which models are worth it locally on a Mac?

SDXL fine-tunes, Illustrious/Pony for anime,
Z-Image Turbo
for fast drafts, SD 1.5 inpainting. Everything else runs better on the cloud.

Links and sources

Models in this guide

Written by
Captain

Related guides

Errors & fixes
GPU and VRAM guide for AI image and video: what each model needs and what to buy (or not)
How much graphics memory each model family really needs at usable speed (SD 1.5, SDXL, Flux, FLUX.2, Qwen Image, Z-Image, Wan 2.2, LTX-2, H3), what fp8 and GGUF quantisation buy you, why system RAM and disk matter too, a tier list of cards from 8 to 32 GB, Mac and AMD notes, and the point at which renting is cheaper than buying.
By Quartermaster
2026-01-07
ComfyUI
What is ComfyUI? A beginner's guide to nodes, workflows and the first graph
ComfyUI explained for people coming from Automatic1111, Fooocus or a web app: why it is a graph, the seven nodes in the default workflow and what each does, how to load a workflow from an image, where models go, the Manager for missing nodes, and when a simpler tool or the cloud is the better choice.
By Lookout
2025-12-17
Apps
How to install a LoRA: folders, file checks and first use in ComfyUI, Forge, Automatic1111 and Draw Things
The practical installation walkthrough: where to download a LoRA from, how to check the file hash against the model page, which folder it goes in for every popular UI, how to refresh the list, how to load it the first time, and the three ways to use one on the cloud without installing anything.
By Lookout
2025-09-24
Models
Which AI image models to try first, and why: a ranked starting list
Seven models for a first week, chosen for forgiveness rather than hype: one SDXL photo fine-tune, one anime fine-tune, Flux dev, a fast turbo model, an inpainting model, a video model and an upscaler, each with the reason, the memory it needs and the prompt style it expects.
By Captain
2025-09-10

More guides

Cloud services
Flat fee vs tokens: why unlimited plans like Graydient.ai are the best value for AI creators in 2026
A ranked cost comparison, with prices checked on 8 October 2026, of flat-fee unlimited plans like Graydient.ai against token and credit pricing from Midjourney, Leonardo, fal.ai, Replicate, Runway and Kling: what 1,000 images and 1,000 videos a month really cost on each, and why one fixed fee for unlimited images, video, audio, Grok LLM chat and web apps is the best value for creators who iterate.
By Captain
2026-10-08
Models
FLUX.1 Dev: how to prompt it, best settings and creative ideas
A practical guide to FLUX.1 Dev by Black Forest Labs: natural-language prompting, guidance and step settings, LoRA stacking, text rendering and prompt ideas that play to its strengths.
By Captain
2026-09-30
Models
Stable Diffusion XL 1.0: prompts, settings and what it still does best
How to get the most out of the official SDXL 1.0 base model: native resolutions, CFG and sampler settings, the refiner, negative prompts and ideas for styles where SDXL still shines.
By Captain
2026-10-01
Models
Stable Diffusion 1.5: the classic model, prompted properly
Stable Diffusion 1.5 is still worth knowing: the right resolution, CFG and sampler, how to use its huge library of LoRAs and embeddings, and creative prompt ideas suited to a 512-pixel model.
By Captain
2026-10-02
Models
FLUX.2 Dev: prompting the newest Black Forest Labs model
FLUX.2 Dev brings larger prompts, better text, stronger realism and multi-reference editing. This guide covers the turbo workflow, guidance and resolution settings, prompt structure and ideas that use its new strengths.
By Captain
2026-10-03
Models
Qwen-Image: long prompts, perfect text and bilingual posters
Qwen-Image is the model to reach for when the words in the picture matter. Learn how to write its long descriptive prompts, render English and Chinese text accurately, set CFG and steps, and explore layout-heavy creative ideas.
By Captain
2026-09-29