LiveScene: Language Embedding Interactive Radiance Fields for Physical Scene Rendering and Control

Paper | Project Page | Video

LiveScene: Language Embedding Interactive Radiance Fields for Physical Scene Rendering and Control
Delin Qu*, Qizhi Chen*, Pingrui Zhang Xianqiang Gao, Binzhao, Zhigang Wang, Dong Wang†, Xuelong Li† Neurips 2024

This repository contains the code and dataset for the paper LiveScene: Language Embedding Interactive Radiance Fields for Physical Scene Rendering and Control, the first scene-level language embedded interactive radiance field that efficiently reconstructs and controls complex physical scenes, allowing for the control of multiple interactive objects within the neural scene with diverse interaction variations and even facilitating language-based interaction.

Update

• Project Pages for LiveScene: Language Embedding Interactive Radiance Fields for Physical Scene Rendering and Control [2024-5-18]
• DATASET for LiveScene
• Video and slides
• Code for LiveScene

Acknowledgement

We adapt codes from some awesome repositories, including Nerfstudio, Omnigibson, Kplanes_nerfstudio, Lerf, and Conerf. Thanks for making the code available! 🤗

Citation

If you use this work or find it helpful, please consider citing: (bibtex)

@misc{livescene2024,
  title={LiveScene: Language Embedding Interactive Radiance Fields for Physical Scene Rendering and Control}, 
  author={Anonymized Author},
  year={2024},
  eprint={2406.16038},
  archivePrefix={arXiv},
}