GET3D | Nvidia

GET3D | Nvidia

GET3D generates textured 3D mesh assets you can drop straight into a rendering engine, trained only from collections of 2D images. NVIDIA researchers built it to output explicit meshes with geometry and texture, not neural radiance fields that need custom renderers to use.

Most 3D generative models at the time either skipped textures, locked you into fixed topology, or required neural rendering pipelines to view results. GET3D uses differentiable marching tetrahedra (DMTet) plus adversarial losses on rasterized RGB images and silhouettes, so the output is a standard textured mesh. The trade-off is research-grade access: this is an NVIDIA Toronto AI Lab project from NeurIPS 2022, not a hosted SaaS with an upload button.

The model handles cars, chairs, animals, motorbikes, human characters, and buildings. It also supports text-guided shape generation via CLIP-based finetuning, similar to StyleGAN-NADA, and can disentangle geometry from texture through separate latent codes.

Top Features:
  1. Outputs explicit textured 3D meshes usable in standard rendering engines

  2. Trained from 2D image collections using adversarial losses on RGB and silhouettes

  3. Generates cars, chairs, animals, motorbikes, humans, and buildings

  4. Disentangles geometry and texture through separate latent codes

  5. Supports text-guided shape generation via CLIP-based finetuning

  6. Published at NeurIPS 2022 by NVIDIA, University of Toronto, and Vector Institute

Pros:
  1. Outputs standard textured meshes compatible with common 3D software

  2. Trains from 2D image collections without requiring 3D ground truth

  3. Disentangled geometry and texture codes let you swap materials without regenerating shape

  4. Supports text-guided generation via CLIP finetuning

  5. Free research project from a top-tier NeurIPS 2022 paper

Cons:
  1. Research project only, not a hosted commercial product

  2. No self-serve SaaS interface or API for casual users

  3. Business use requires separate NVIDIA Research Licensing

  4. Paper dates to 2022; newer 3D generation models have since emerged

FAQs:

What is GET3D by NVIDIA?

GET3D is a generative model from NVIDIA Toronto AI Lab that creates explicit textured 3D meshes from 2D image collections. It was published at NeurIPS 2022 and outputs assets ready for standard 3D rendering engines.

Is GET3D free to use?

GET3D is a free NVIDIA research project. There is no commercial pricing or hosted SaaS product. Business licensing inquiries go through NVIDIA Research Licensing.

What 3D categories can GET3D generate?

GET3D generates textured meshes across multiple categories including cars, chairs, animals, motorbikes, human characters, and buildings. Demo videos on the project page show detailed geometry like wheels, windows, and clothing textures.

How does GET3D differ from neural radiance fields?

GET3D outputs standard textured mesh files via DMTet surface extraction rather than neural radiance field representations. This means generated assets can be imported into common 3D software without a custom neural renderer.

Can GET3D generate shapes from text prompts?

Yes. GET3D supports text-guided shape generation by finetuning the 3D generator with directional CLIP loss on rendered 2D images, following the StyleGAN-NADA approach described on the project page.

Who developed GET3D?

GET3D was developed by researchers at NVIDIA, the University of Toronto, and the Vector Institute. Lead authors include Jun Gao, Tianchang Shen, and Sanja Fidler, among others listed on the NeurIPS 2022 paper.

Pricing:

Free

Tags:

3D Mesh Generation
Textured Models
NeurIPS Research
Generative Adversarial
Text-to-3D
NVIDIA Research
Virtual Worlds
GET3D

Tech used:

PyTorch
CLIP
DMTet

Reviews:

Give your opinion on GET3D | Nvidia :-

Overall rating

Join thousands of AI enthusiasts in the World of AI!

Best Free GET3D | Nvidia Alternatives (and Paid)

By Rishit