Luma AI is a startup that has developed an AI-powered app and API for creating high-quality 3D models and environments from video inputs.
The app, available on the iOS App Store, allows users to easily capture 3D scenes, products, and objects using their iPhone 11 or newer. The resulting 3D content can be shared on the web or exported for use in 3D engines and VFX pipelines.
Luma AI's mission is to build multimodal AI systems that can see, understand, and interact with the world in order to expand human imagination and capabilities. The company has recently launched its Dream Machine, a text-to-video AI model that can generate high-quality, realistic video clips from textual prompts.
However, Luma AI's debut of Dream Machine has sparked controversy due to the appearance of a character resembling Mike Wazowski from Pixar's Monsters, Inc. in a Dream Machine-generated trailer for an animated series called Monster Camp. This has raised questions about the transparency of the datasets used to train the AI model and concerns about potential intellectual property infringement.
Luma AI offers its 3D modeling API to developers for $1 per capture, allowing them to access the company's advanced 3D reconstruction capabilities. The API expects video walkthroughs of objects or scenes and outputs interactive 3D scenes, textured models, and pre-rendered images and videos.