Free-SurGS: SfM-Free 3D Gaussian Splatting for Surgical Scene Reconstruction

Jiaxin Guo¹    Jiangliu Wang¹    Di Kang²    Wenzhen Dong¹    Wenting Wang¹    Yun-hui Liu^{1, 3   
1}CUHK    ²Tencent AI Lab    ³HKCLR   

The repository contains the official implementation for the MICCAI 2024 paper Free-SurGS: SfM-Free 3D Gaussian Splatting for Surgical Scene Reconstruction.

3DGS with SfM fails to recover accurate camera poses and geometry in surgical scenes due to the challenges of minimal textures and photometric inconsistencies. In our paper, we propose Free-SurGS as the first SfM-free 3DGS-based method for surgical scene reconstruction from monocular video by jointly optimizing the camera poses and scene representation.

Demo

video_reduce.mp4

Pipeline

Update

• Code: coming soon.