Artificial intelligence

3D Gaussian splatting

Definition

3D Gaussian splatting is an explicit scene-representation and rendering method that models appearance with optimised three-dimensional Gaussian primitives. The primitives are projected and blended into an image, enabling novel-view rendering and, in some robotics systems, dense visual mapping.

Also known as: 3DGS, Gaussian splatting

Updated

An explicit set of soft 3D primitives

The original 3D Gaussian splatting paper represents a scene with Gaussian primitives initialised from sparse calibration points. Each primitive has a position and an anisotropic covariance that controls its three-dimensional extent, together with opacity and view-dependent colour parameters. A visibility-aware rasteriser projects and blends the primitives to render a requested camera view.

This representation is explicit in the sense that the scene is stored as a collection of optimised primitives. It differs from a basic point cloud, whose points do not by themselves define the same continuous footprint, opacity, and view-dependent appearance model.

A rendering method can become a robot map

Robotics researchers have adapted Gaussian primitives to estimation and mapping. SplaTAM reports an online system that tracks a single RGB-D camera while expanding and optimising a Gaussian scene representation. Its use of depth and camera tracking ties the representation to simultaneous localization and mapping, rather than novel-view synthesis alone.

For a mobile or humanoid robot, a dense renderable map can support remote inspection, viewpoint prediction, or visual matching. The SplaTAM results apply to its particular RGB-D method and evaluations, not to every system described as Gaussian splatting.

Photorealistic rendering is not geometric certainty

The original method optimises appearance from multiple calibrated views. Unseen surfaces, moving objects, exposure changes, and inaccurate camera poses can produce missing or misleading content. A Gaussian may also cover space differently from the real surface even when rendered images look convincing.

Collision checking and foot placement need geometry and uncertainty suited to physical interaction. A 3D Gaussian map may contribute to those systems, but visual quality alone does not prove metric accuracy, free space, or contact safety.

Sources