Gaussian Opacity Fields: Efficient and Compact Surface Reconstruction in Unbounded Scenes
Approach for efficient and high-quality surface reconstruction in unbounded scenes
The proposed method, Gaussian Opacity Fields (GOF), introduces a novel approach for efficient and high-quality surface reconstruction from 3D Gaussians directly. GOF leverages a ray-tracing-based volume rendering technique to establish a Gaussian opacity field, ensuring consistency with RGB rendering. This approach allows for the direct extraction of geometry from 3D Gaussians by identifying their level sets, eliminating the need for Poisson reconstruction or TSDF fusion. Surface normals of Gaussians are approximated using intersection planes with rays, enhancing geometry fidelity. An efficient mesh extraction technique based on tetrahedral grids is employed, focusing opacity evaluations on potential surface locations indicated by 3D Gaussians.
In terms of optimization, the regularization terms from 2DGS are extended to optimize 3D Gaussians, including depth distortion and normal consistency losses. The depth distortion loss helps address noisy results in 3D reconstruction from multi-views, while the normal consistency loss enhances geometric accuracy. The model is optimized using a combination of RGB reconstruction loss, regularization terms, and a decoupled appearance modeling strategy to account for uneven illumination in the dataset.
Implementation details involve custom CUDA kernels for ray-tracing-based volume rendering, regularizations, and opacity evaluation. Regularization parameters are set based on scene characteristics, and adaptations to the adaptive densification strategy are made to improve Gaussian uniformity and mitigate over-reconstruction. Mesh extraction is facilitated using the Marching Tetrahedra algorithm with a binary search approach, extracting meshes for the 0.5 level-set. All experiments are conducted on an NVIDIA A100 GPU, showcasing the efficiency and effectiveness of the proposed GOF method for surface reconstruction from 3D Gaussians.
Comments
None