Slashdot
Follow
New AI Model Turns Photos Into Explorable 3D Worlds, With Caveats
Tencent has released HunyuanWorld-Voyager, an open-weights AI model capable of generating 3D-consistent video from a single image. This allows users to navigate virtual scenes by piloting a camera path. The model produces both RGB video and depth information, facilitating direct 3D reconstruction without traditional modeling. While not generating true 3D models, it creates 2D video frames with spatial consistency, mimicking camera movement in 3D space. Each generation yields approximately two seconds of video, which can be extended by chaining clips. Objects maintain their relative positions and perspective shifts accurately as the virtual camera moves. The depth map information can be converted into 3D point clouds for reconstruction. However, the tool has limitations, including compounding errors in complex camera motions like 360-degree rotations. Its generalization ability is also restricted by its reliance on training data patterns. Running the model effectively requires substantial GPU power, specifically 60-80GB of memory. Additionally, licensing restricts its use in the EU, UK, and South Korea. Large-scale deployments necessitate special agreements. Tencent has made the model weights available on Hugging Face.