CSM vs Text-To-4D

Cube by Common Sense Machines is an AI platform that turns photos and videos into 3D worlds. With just a few clicks, users can upload their photo or video and watch Cube magically generate a 3D asset. The platform supports artists of all levels and workflows, offering powerful products across web, mobile, and Discord. Cube's goal is to make 3D content creation easier than ever, breaking the limitations of the 2D internet. Users can choose from different subscription plans based on their needs and access features like unlimited turbo preview models, fast dedicated servers, and API access. Let your worldbuilding journey begin with Cube.

Meta present MAV3D (Make-A-Video3D), a method for generating three-dimensional dynamic scenes from text descriptions. Our approach uses a 4D dynamic Neural Radiance Field (NeRF), which is optimized for scene appearance, density, and motion consistency by querying a Text-to-Video (T2V) diffusion-based model.

The dynamic video output generated from the provided text can be viewed from any camera location and angle, and can be composited into any 3D environment. MAV3D does not require any 3D or 4D data and the T2V model is trained only on Text-Image pairs and unlabeled videos.