arxiv6.0 / 10
Fast and Strong Image Protection against Diffusion Personalization
Jiwon Park, Jihye Kang, Namhyuk Ahn
Abstract
Personalized text-to-image diffusion models can reproduce a person from a handful of photographs. Image protection perturbs each image before publication so that fine-tuning on it fails, but it optimizes every perturbation from scratch, so its cost grows with the number of images. We present the protective diffusion model (PDM), which is trained once and samples the perturbation of a new image over many denoising steps. PDM distills an iterative teacher and is then post-trained with the target residual projection (TRP) loss as a reward, a stronger objective than existing ones. PDM outperforms nine baselines on faces and artworks and nearly matches its teacher at a tenth of the cost.
Research area
adversarial robustnessmodel robustnessprivacy
Published
17 Nov 2026
Source
arxiv
Org
Inha University
Sign in to read and join the discussion.