InstructPix2Pix vs Palette.fm

InstructPix2Pix edits a photo from a plain-language instruction such as "make the sky sunset orange" or "turn this into a watercolor." You provide an input image and a short text command, and the model returns an edited version in seconds without training on that specific photo first. It was published as a CVPR 2023 Highlight by researchers at UC Berkeley.

Mask-based editors make you paint regions before changing anything. InstructPix2Pix runs a single forward pass from text alone, skipping per-image fine-tuning or inversion steps that slow other diffusion edit workflows. The trade-off shows up in the paper's failure cases: viewpoint changes, object swaps, and tight local edits remain weak spots.

The project ships open source code on GitHub and a Hugging Face demo space for trying edits in a browser. Training combined GPT-3 and Stable Diffusion to synthesize instruction pairs, and the released model generalizes to real photos up to about 768 pixels wide despite 256x256 training resolution.

Palette.fm colorizes black-and-white photos through a browser upload flow with 21+ filter presets and keyword-based color tweaks. Upload an image, pick a filter, adjust descriptive keywords if needed, then download a full-resolution result or keep iterating on previews. The photo editing workflow targets family historians, photographers, and creators restoring old prints without opening Photoshop.

Most colorizers lean on heavy sepia and purple casts with little room to steer skin tones or fabric colors. Palette.fm lets you click a filter then fine-tune hues through plain-language keywords, and it sells one-time credit packs alongside subscriptions. Free previews cap at 500x500 pixels with a watermark, while paid credits remove the logo and support files up to 5000x5000 pixels.

Genealogy researchers, photo archivists, and YouTube educators use Palette.fm to batch-test color looks before committing credits. The site reports 54 million photos colorized and 6.6 million registered users, with an API option for teams that want programmatic access.