Drag Your GAN

Drag Your GAN

Drag Your GAN lets you reshape a generated image by dragging handle points to target spots on the canvas. Instead of training on labeled pose data or 3D priors, DragGAN moves pixels inside a pretrained GAN's image manifold so edits stay photorealistic even when occluded regions get hallucinated. The project page hosts the SIGGRAPH 2023 paper, demo clips, and links to open source code.

Most GAN editors rely on fixed training annotations or 3D meshes, which limits what you can deform. DragGAN pairs feature-based motion supervision with discriminative point tracking so handle points follow your cursor while staying on the object surface. That makes it useful for nudging animal poses, facial expressions, car angles, and landscape layouts without retraining the generator.

Researchers, graphics students, and computer vision engineers use it to prototype interactive image editing workflows. The Max Planck Institute page distributes the paper PDF and GitHub repo under a non-commercial Creative Commons license, with contact details for the lead author.

Top Features:
  1. Drag handle points to target positions for precise pixel-level control

  2. Feature-based motion supervision drives handles without 3D priors

  3. Point tracking uses discriminative GAN features to localize handles

  4. Deforms animals, cars, humans, landscapes, and inverted real photos

  5. Open source code published at github.com/XingangPan/DragGAN

  6. Paper and demo videos from SIGGRAPH 2023 Conference Proceedings

Pros:
  1. Precise interactive control without manual training annotations

  2. Produces realistic edits inside the GAN image manifold

  3. Handles occluded content and rigid shape deformations

  4. Open source code and paper available for free

  5. Works across animals, humans, vehicles, and landscapes

Cons:
  1. Non-commercial license limits commercial deployment

  2. Requires GAN expertise to run the research codebase

  3. No hosted web app for casual users on the project page

  4. Research project page with last update in May 2023

FAQs:

Is Drag Your GAN free to use?

Yes, Drag Your GAN is free for non-commercial use. The project page distributes the paper PDF and GitHub code under the Creative Commons CC BY-NC 4.0 license, with attribution required to the paper title and authors.

What does Drag Your GAN do?

Drag Your GAN lets you drag points on a generated image so pixels move to user-defined targets. DragGAN combines motion supervision and point tracking inside a GAN latent space to deform pose, shape, expression, and layout.

Where can I download Drag Your GAN code?

Drag Your GAN links to the open source repository at github.com/XingangPan/DragGAN from its project page. The same page also hosts the SIGGRAPH 2023 paper PDF for download.

What image types does Drag Your GAN support?

Drag Your GAN demo clips cover lions, cats, dogs, horses, elephants, human faces, cars, microscopes, and landscapes. The method also shows manipulation of real photos through GAN inversion.

Who created Drag Your GAN?

Drag Your GAN was authored by researchers from the Max Planck Institute for Informatics, MIT, University of Pennsylvania, and Google AR/VR. Xingang Pan is listed as the contact on the project page.

Can Drag Your GAN be used commercially?

Drag Your GAN site materials are released under CC BY-NC 4.0, which restricts commercial use. Review the license file on the project page before using images, text, or video in commercial projects.

Pricing:

Free

Tags:

GAN Editing
Point-based Control
Image Manipulation
SIGGRAPH 2023
Computer Vision
Open Source
Feature-based motion supervision
Point tracking

Tech used:

GANs
GitHub
Google Cloud
Google Fonts
Ruby

Reviews:

Give your opinion on Drag Your GAN :-

Overall rating

Join thousands of AI enthusiasts in the World of AI!

Best Free Drag Your GAN Alternatives (and Paid)

By Rishit