TH
โ† Back
news 2026-04-15 ยท huggingface-papers

๐ŸŒ Lyra 2.0 โ€” NVIDIA's AI That Builds Explorable 3D Worlds From Scratch

๐ŸŒ Lyra 2.0 โ€” NVIDIA's AI That Builds Explorable 3D Worlds From Scratch

AI can generate images. AI can generate videos. But what about entire 3D worlds you can actually walk through?

That's exactly what NVIDIA's Lyra 2.0 does โ€” and it solves two massive problems that made previous attempts fall apart.

**The problems:** When AI generates 3D environments, it "forgets" what areas looked like when you revisit them (spatial forgetting), and quality degrades the longer it generates (temporal drifting). Walk around a corner and come back โ€” everything's different.

**The solution:** Lyra 2.0 generates camera-controlled walkthrough videos, then lifts them into full 3D scenes you can explore freely.

What makes it work:

๐ŸŽฏ **No more forgetting** โ€” The system maintains per-frame 3D geometry, tracking every region you've seen. Revisit a spot and it looks exactly as you left it.

๐ŸŽฏ **Self-correcting generation** โ€” Instead of letting errors compound, the model trains on its own accumulated mistakes, learning to fix drift rather than propagate it.

๐ŸŽฏ **Complex camera paths** โ€” Large viewpoint changes, location revisits, and extended trajectories all stay 3D-consistent.

The implications are huge: indie game developers building levels in minutes instead of weeks, architects offering virtual walkthroughs before breaking ground, filmmakers creating entire sets with a text prompt.

We're moving from AI that creates pictures to AI that creates *places*.

๐Ÿ“„ Source

huggingface-papers
Share: Facebook ๐•
โ† Previous
๐ŸŽฌ IC LoRAs for LTX2 โ€” Train SOTA Video Control on
Next โ†’
๐Ÿค– Top AI Models Score Just 40% When Instructions