Gaussian Splatting: 3D Reconstruction and Novel View Synthesis, a Review
Discusses image-based 3D reconstruction, focusing on learning-based estimation 3D shapes and generation of novel views
The paper discusses the implementation and methods of Gaussian Splatting for 3D reconstruction and novel view synthesis. It introduces innovative approaches such as the 4D Gaussian Splatting (4D-GS) method, which combines Spatial-Temporal Structure Encoder and Multi-head Gaussian Deformation Decoder for real-time rendering at high resolutions. Another approach proposed is the Spatial-Temporal 4D volume approximation using 4D primitives parameterized by anisotropic ellipsoids and view-dependent appearance modeled by 4D spherical harmonics.
Furthermore, the paper presents the Dual-Domain Deformation Model (DDDM) explicitly designed to model attribute deformations for each Gaussian point using Fourier series fitting in the frequency domain and polynomial fitting in the time domain. It also discusses the GaussianDiffusion framework, which leverages Gaussian Splatting and Langevin dynamics diffusion models for accelerated rendering and enhanced realism. Additionally, the study introduces PhysGaussian, a framework for generating physics-based dynamics and photo-realistic renderings simultaneously.
Moreover, the paper explores techniques like GaussianEditor for delicate 3D scene editing based on 3D Gaussian Splatting, enabling precise and localized editing by leveraging the explicit properties of 3D Gaussians. It also covers the integration of 3D Gaussian Splatting with feature field distillation to advance 3D scene representation for semantic tasks. The methods discussed aim to address challenges in 3D reconstruction, interactive object manipulation, 3D segmentation, and scene editing, showcasing the versatility and potential applications of Gaussian Splatting techniques in various fields.
Comments
None