EndoMD-SLAM: Endoscopic Gaussian Splatting SLAM under Optical Degradation

Memory and Static-Transient Decomposition for robust online endoscopic reconstruction and tracking.

Nuo Chen1*, Kangqi Ni2*, Lulin Liu1,3, Joga Ivatury4, Ying Ding4, Farshid Alambeigi4, Tianlong Chen2, Zhiwen Fan1

1Texas A&M University   2UNC Chapel Hill   3University of Minnesota   4UT Austin

* Equal contribution.

Project video for EndoMD-SLAM under degraded endoscopic observations.

Abstract

Dense 3D reconstruction is critical for clinical endoscopic navigation and documentation. While Gaussian Splatting SLAM systems show promise in this domain, they fundamentally rely on strict multi-view photometric consistency. In routine procedures, this assumption is severely violated by intermittent optical degradations like moving debris and water flushing. Standard systems erroneously fuse these camera-attached artifacts into the persistent 3D geometry, causing severe tracking drift and irreversible map corruption. To address this limitation, we propose EndoMD-SLAM, a framework designed to maintain stability under optical degradation through specialized tracking and mapping mechanisms. On the tracking side, a memory-driven gating mechanism detects unreliable observations to suspend map updates and utilizes historical keyframes for drift-aware relocalization. On the mapping side, a self-supervised static-transient decomposition isolates visual contaminants into a dedicated transient field. This explicit separation prevents artifacts from structurally entangling with the persistent anatomical map. We curate a degradation-focused benchmark from colonoscopy videos to systematically evaluate these failure modes. Extensive experiments show that while standard baselines fail under severe optical degradation, EndoMD-SLAM preserves geometric integrity, reducing absolute trajectory error by 91% and improving rendering fidelity by 9.9 dB PSNR.

Methodology

EndoMD-SLAM architecture overview
Overview of the EndoMD-SLAM architecture. Input frames are first evaluated by a reliability gate. Non-degraded observations proceed to tracking optimization and update the global static map. Degraded frames activate the temporal memory, which queries a keyframe memory bank to perform drift-aware relocalization while safely suspending static map updates. Concurrently, a static-transient decomposition explicitly factorizes the scene. It absorbs camera-attached occluders into a per-view transient field, thereby protecting the persistent anatomy within the global static field. The static and transient renders are finally alpha-blended to reconstruct the degraded observation and compute the loss against the ground truth.

Results

EndoMD-SLAM is evaluated on a degradation-focused C3VDv2 benchmark containing sequences tagged with water and debris on lens.

Table 1 main quantitative results on the degradation-focused benchmark
Table 1. Main results on degradation-focused benchmark. EndoMD-SLAM establishes a new state-of-the-art across all metrics under severe optical degradation. Best results are highlighted in bold.
Table 2 quantitative ablation of the proposed components
Table 2. Quantitative ablation of our proposed components. Both the temporal memory and spatial decomposition modules are critical for maximizing tracking robustness and rendering fidelity. Best results are highlighted in bold.

Qualitative Analysis

Static-transient decomposition qualitative results
Qualitative comparison of novel view synthesis and field decomposition under severe optical degradation. Standard baselines (EndoGSLAM, MonoGS, NICE-SLAM) exhibit prominent rendering artifacts and geometric distortions under degraded visual evidence. EndoMD-SLAM explicitly factorizes the scene via a static-transient decomposition. The transient field (Ours-transient) absorbs optical degradations, yielding a clean anatomical map (Ours-static), while the blended output (Ours-blend) reconstructs the degraded observation.
Estimated camera trajectories compared with ground truth
Qualitative comparison of estimated camera trajectories across diverse colonoscopy sequences.
3D reconstruction comparison under severe lens contamination
Qualitative 3D reconstruction of global colon anatomy under severe lens contamination.