Tencent Open-Sources HY-World 2.0: 3D Scene Construction From Text, Image, or Video
Tencent has open-sourced HY-World 2.0, a multimodal world model that generates navigable 3D scenes rather than video streams. The distinction is architectural and consequential: where most world models predict the next frame, HY-World 2.0 reconstructs geometry, depth, camera pose, and renderable 3D assets that persist across new viewpoints.
Input can be text, a single image, multiview images, or video. Output is meshes and Gaussian splats — compact 3D point representations that render efficiently from arbitrary angles and import directly into Blender, Unity, Unreal Engine, or NVIDIA Isaac Sim.
Four-Stage Pipeline
HY-World 2.0 runs a staged reconstruction approach:
- HY-Pano 2.0 — generates a 360° panorama from the input
- WorldNav — plans a camera traversal path through the reconstructed space
- WorldStereo 2.0 — expands the world geometry across the planned path
- WorldMirror 2.0 — composites the final 3D scene in a single feed-forward pass
The single-pass reconstruction in WorldMirror 2.0 is the enabling step for production use: it makes the pipeline fast enough for interactive applications rather than offline batch processing.
What Changes For Practitioners
The practical gap this closes is reusability. A video world model can look interactive while remaining a pixel stream — fine for a demo, but not importable as an asset. HY-World 2.0 outputs persistent 3D geometry, which means a scene generated from a photo or a text prompt can be re-rendered from new angles, edited in standard tools, and embedded in simulation environments without re-generation.
That property is directly relevant to robotics training data, where Isaac Sim integration means synthetic 3D environments can be generated at scale from reference images rather than hand-built by artists. It is also relevant to game asset pipelines and digital twin construction for industrial applications.
Availability
HY-World 2.0 is available on GitHub at github.com/Tencent-Hunyuan/HY-World-2.0 and on Hugging Face at huggingface.co/tencent/HY-World-2.0. The full technical report is linked from the project page. Apply-for-access inference is available at 3d.hunyuan.tencent.com/sceneTo3D.