Triplane-based implicit representations offer a highly promising structured framework for modeling static and dynamic 3D scenes. To meet the rigorous bandwidth and latency demands of immersive real-time streaming with practical deployment considerations, pioneering methods leverage established video coding standards like HEVC and VVC to compress these high-dimensional implicit representations. This talk focuses on state-of-the-art technologies engineered for compressing dynamic 3D scenes using Triplane-Video 3D Gaussian Splatting (TVGS), while exploring their extended applications across various domains.
The presentation begins with the introduction of 3D Gaussian Splatting foundations, covering primitive attributes, scene construction, parallel rendering, and end-to-end optimization pipelines. We then examine how dynamic scenes are efficiently represented using three interconnected components: coarse geometry anchor points, triplane feature vectors, and MLP decoders. We also detail the bit-plane splitting and packing strategies used to map these heterogeneous components into standard 2D video frames, fully exploiting hardware-accelerated video compression infrastructures. To ensure robust spatial-temporal stability, satisfactory visual fidelity, and optimal rate-distortion performance, several critical design paradigms will be presented, including channel-to-spatial mapping, anchor tracking, coordinate remapping, and dynamic range reshaping.
Furthermore, we demonstrate diverse downstream applications built on top of the TVGS framework. Specifically, we discuss converting conventional physically-based rendering (PBR) 3D mesh assets into fully relightable TVGS representations to achieve better visual quality, faster rendering, and higher data compactness. We also address a novel framework leveraging TVGS to represent multiple articulated 3D objects simultaneously and show the high effectiveness on rate-distortion-joint accuracy metrics. The talk concludes with a comprehensive overview of the latest international standardization efforts and critical future research trajectories. Ultimately, this presentation aims to provide ICIP 2026 attendees with a deep understanding of TVGS technology, motivating them to identify new research topics and inspiring innovative solutions in this rapidly evolving domain.
