Skip to content

3D-KNN Blind-Spot Desnowing

What It Is

  • 3D-KNN Blind-Spot Desnowing refers to the Remote Sensing paper "Self-Supervised LiDAR Desnowing with 3D-KNN Blind-Spot Networks."
  • It is a self-supervised LiDAR snow-removal method that improves on the PR-Net/RD-Net reconstruction-difficulty line used by SLiDE.
  • The method focuses on snowfall, not general rain, fog, road spray, steam, dust, or multipath denoising.
  • It redesigns the point reconstruction network with a blind-spot architecture and a 3D-KNN encoder.
  • It should be read as a research improvement to self-supervised snow filtering, not as a production perception subsystem.

Core Technical Idea

  • Blind-spot training reconstructs a target measurement without allowing the network to directly copy that target.
  • A 3D-KNN encoder aggregates neighbor features in Euclidean 3D space instead of relying only on 2D range-map neighbors.
  • This reduces geometric errors caused by spherical projection, where nearby range-image pixels may not be true 3D neighbors.
  • Residual state-space blocks, RSSB, capture long-range context with linear computational complexity.
  • RD-Net uses reconstruction difficulty to infer whether a point is snow-contaminated.
  • The heavy PR-Net reconstruction path is used for training, while RD-Net provides the efficient inference path.

Inputs and Outputs

  • Input: snowy LiDAR point clouds with enough geometry to perform 3D KNN neighborhood lookup.
  • Training input: unlabeled snowy scans for self-supervised blind-spot reconstruction.
  • Intermediate output: PR-Net reconstructions based on 3D-KNN neighborhood features and RSSB context.
  • Intermediate output: RD-Net reconstruction-difficulty predictions.
  • Output: point-wise snow/noise predictions after applying a reconstruction-difficulty threshold.
  • Non-output: no object detections, no radar fusion, no explicit rain/fog/spray classes, and no reconstruction of occluded scene geometry.

Architecture or Pipeline

  • Project point clouds into a structured form for network processing while retaining access to 3D coordinates.
  • Select target measurements under a blind-spot constraint so the network cannot learn an identity shortcut.
  • Use 3D-KNN to gather geometrically valid neighbor features directly in Euclidean space.
  • Feed the encoded features through RSSB modules to model longer-range context efficiently.
  • Train PR-Net to reconstruct the hidden target from its surrounding context.
  • Train RD-Net to predict reconstruction difficulty from the learned reconstruction behavior.
  • Classify high-difficulty points as likely snow and remove them from the output cloud.

Training and Evaluation

  • The paper evaluates on synthetic and real-world snow datasets, including SnowyKITTI and WADS.
  • The authors report improved self-supervised desnowing over prior methods, with up to 0.06 IoU improvement in the abstract.
  • Ablations compare the 3D-KNN encoder against centrally masked convolution and range-map KNN.
  • The discussion reports that 3D-KNN performs best across snow intensities because it retrieves neighbors in 3D space.
  • Runtime analysis separates PR-Net cost from RD-Net cost; the heavy 3D-KNN reconstruction path is a training cost, while RD-Net is the deployment module.
  • The paper reports sensitivity to the reconstruction-difficulty threshold and adopts a default threshold after ablation.

Strengths

  • Fixes a real weakness in range-image blind spots by using true 3D adjacency.
  • Keeps the no-clean-label advantage of self-supervised snow-removal methods.
  • Separates expensive training-time reconstruction from efficient inference-time difficulty prediction.
  • RSSB context helps with long-range structure without quadratic attention cost.
  • More interpretable than a pure black-box classifier because the score is tied to reconstruction difficulty.
  • Better suited than pure 2D range-map methods near depth discontinuities and irregular beam layouts.

Failure Modes

  • It remains snow-specific; rain, fog attenuation, road spray, de-icing mist, steam, dust, and multipath ghosts need independent training and evaluation.
  • KNN search and coordinate normalization can be sensitive to LiDAR density, beam layout, mounting height, and occlusion.
  • Sparse valid objects can still look hard to reconstruct and may be removed.
  • Airport-specific objects such as chocks, cones, tow bars, wing tips, personnel legs, cables, and belt-loader edges need false-positive testing.
  • The method removes points rather than restoring points hidden by snow.
  • Synthetic snow performance may not transfer to dense wet snow, mixed rain/snow, or de-icing spray.
  • A recent academic method with no production safety case should not be placed directly in a safety-critical path.

Airside AV Fit

  • Good candidate for airside research where snow labels are scarce but unlabeled winter logs are available.
  • More promising than pure range-map self-supervision around complex 3D geometry because it uses Euclidean neighborhoods.
  • Still weak for non-snow airport artifacts such as glycol mist, road spray, steam vents, dust, and reflective wet surfaces.
  • Needs explicit integration with Radar-LiDAR Fusion in Adverse Weather before filtering points near safety-critical obstacles.
  • Production use would require the monitoring, replay, and fallback controls described in Production Perception Systems.
  • Compare against SLiDE, LIORNet, and 3D-OutDet on identical airport log slices.

Implementation Notes

  • Use GPU-accelerated spatial indexing if training-time PR-Net throughput matters.
  • Keep RD-Net threshold calibration separate by sensor model, scan pattern, and weather severity.
  • Store reconstruction difficulty maps and removed point indices in replay logs.
  • Include hard negative cases with sparse valid structure and dynamic objects.
  • Validate that KNN neighbors are physically plausible after ego-motion compensation if using accumulated frames.
  • Measure downstream object-detection and freespace effects, not just snow IoU.
  • Add explicit unknown-weather routing so rain, fog, spray, dust, steam, and multipath are not silently treated as snow.

Sources

Public research notes collected from public sources.