Cross-LiDAR perception · 2026

Seeing the Lost Spectrum of Sparse LiDARs

Different LiDARs do not see different worlds; they see different spectra of the same world.

LiEqualizer equalizes a sparse-LiDAR student's spectrum against a dense teacher — during training only. The deployed network is unchanged.

Zikun Xu1,2, Shuocheng Yang1, Jianqiang Wang1,*, Keqiang Li1,*, Gim Hee Lee2,*, Shaobing Xu1,*

1 · School of Vehicle and Mobility, Tsinghua University, Beijing, China
2 · Department of Computer Science, National University of Singapore
* Corresponding authors

Drag the two faders, or pluck either curve — grab it anywhere and pull.
TL;DR

Main takeaway: read a LiDAR scan as a spectrum and the sensor gap becomes a band problem. A dense teacher still holds the bands a sparse scan lost, so a student can be taught to match them — restoring real detail in the encoder's code and suppressing invented detail in the decoder's logits. This buys up to +11.5 zero-shot cross-sensor mIoU with zero change to the architecture, the parameter count or the inference cost.

MotivationEngineers and researchers pay twice for LiDAR perception: a cheap sensor with few beams sees less of the scene, and every new sensor means new data, labels and training, team after team. Recent work cuts that cost by randomizing the sampling pattern during training, but ignoring a pattern does not return the measurements it never took, and putting them back has meant reconstructing the scan before the network reads it.

PerspectiveRead as frequencies, sparse sampling keeps a scan's coarse shape but weakens real detail and invents false detail — which a filter cannot do, but a sampler can. We prove sparse scans alone cannot bring the weakened detail back, but a teacher trained on densified scenes can.

MethodLiEqualizer distills the spectrum. A low-frequency branch restores what sampling weakened, in the encoder's compressed code, returning structure its beams missed; a high-frequency branch removes what sampling faked, in the decoder's voxel logits, so false detail cannot pass as real. Each acts only where the teacher's own response marks something to restore or remove.

ResultsAcross SemanticKITTI, Waymo and nuScenes, LiEqualizer delivers consistent zero-shot gains, raising cross-sensor mIoU by up to 11.5 points without altering the network, its parameter count, or the cost of training it. Its losses act only in training, so the deployed model keeps the baseline's architecture and inference cost, and the unchanged model transfers to three vehicles carrying unseen LiDARs.

The idea

One undersampling, two opposite symptoms

On raw point clouds, sparse sampling attenuates real high frequencies. On the voxel grid the network actually reads, it injects near-white high frequencies — about 32× the teacher's, with the low-frequency shape left intact. A filter can only do the first. A sampler does both, which is why the method has two branches.

Conceptual illustration: against spatial position, the dense teacher's profile carries fine ripple all along its envelope while the sparse student's profile is smooth and its envelope sits in the wrong place.
Fig 1. Different LiDARs observe different spectra of the same world. Sparse sampling attenuates real high frequencies in the point domain and, unlike a filter, creates near-white fake high frequencies on the voxel grid. LiEqualizer distills the spectrum from a teacher trained on densified scenes and equalizes the student's spectral response — matching detail where the teacher has it, suppressing ripple where it does not.
Method

Match where the teacher has structure, suppress where it does not

Both branches read responses of the same diffusion family, and both are gated by the frozen teacher: the gate decides where to match and where to suppress. The two branches differ in where in the network they act, which is what fixes their band.

The LiEqualizer framework: frozen dense teacher, active sparse student, LF distiller on the TPV planes and HF distiller on the voxel logits.
Fig 2. The frozen teacher reads densified scenes; the student reads the sensor's own sparse scan. The LF distiller acts on the three tri-perspective-view planes, the HF distiller on the common-support voxel logits. Neither adds a trainable parameter to the deployed model.
Low frequency · the boost

Restore what sampling weakened

In the encoder's compressed code, the student's smoothed response is matched to the teacher's where the teacher's gate is open, and driven toward zero where it is closed. That returns structure the student's beams never measured.

High frequency · the cut

Remove what sampling faked

In the decoder's voxel logits, the student's high-pass response is matched to the teacher's where the teacher has detail, and suppressed toward the teacher's own level where it does not — so aliasing cannot pass as real detail.

The low-frequency branch.
The low-frequency branch. Teacher and student planes are smoothed by the same diffusion pyramid; the gate comes from the teacher's projected class map, not from the planes themselves.
The high-frequency branch.
The high-frequency branch. Acts on the voxel logits over the cells teacher and student share, matching detail the teacher holds and shrinking the rest toward it.
Results

Zero-shot across sensors, with the network untouched

Every number below is the same backbone, the same schedule and the same generated data as the randomized-sampling baseline. Only the training objective differs.

+11.5mIoU
Largest zero-shot cross-sensor gain over the randomized-sampling baseline (Waymo → SemanticKITTI).
0extra params
The deployed model is the baseline network: 32,277,463 parameters, 0.224 s per frame, 5.66 GiB peak.
3vehicles
The unchanged model transfers to three platforms carrying LiDARs it never saw in training.
Fig 3. Source-to-unseen generalization. Three training sources × three test sets × three methods. Diagonal cells are same-sensor; the paper's claim is about the off-diagonal ones. Rendered live from the paper's table.
Fig 4. LiEqualizer's gain over the randomized-sampling baseline in every cell.
The main table drawn as grouped 3-D bars: grey single-sensor baseline, orange randomized-sampling baseline, blue LiEqualizer.
Fig 5. The same table, as bars. Grey is the single-sensor baseline, orange the randomized-sampling baseline, blue LiEqualizer. Arrows mark the gain over the orange bars.
Ablation

What each piece buys

Read downwards from the undistilled student; each row adds one module. Brackets are the difference from the first row.

Comparison

Against other distillation objectives

Re-implemented under one pipeline with the same teacher, the same student, the same signals and the same schedule, so that only the objective differs.

On-vehicle

Real platforms, unseen LiDARs

The deployed network is identical to the baseline's, so on-vehicle testing needs no re-integration. Results are qualitative: these platforms carry no labelled ground truth.

unseen sensor

CS55

Stable segmentation on a LiDAR never seen in training.

unseen sensor

AVT

Same weights, different beam pattern, no re-tuning.

unseen sensor

Courier

A low-speed delivery platform with a sparser scan.

Real-vehicle qualitative results
Fig 6. On-vehicle platforms and qualitative results. The three vehicles and their LiDARs are the same testbed the sibling release used, so the platform panels stand as shown. The prediction panels are carried over from that release and will be replaced with LiEqualizer's own run. Real-vehicle data carries no labelled ground truth, so these results are qualitative and no numbers are attached to them.
Video

Three parts

The film, the table it is built on, and the vehicles. Parts I and III are in preparation.

Part IOverview: the lost spectrum in two minutes

A two-minute overview film, in preparation. Until it lands, Fig 1 carries the same argument. Subtitled, not narrated.

Part IICross-sensor generalization, built up cell by cell

Grey is the single-sensor baseline, orange the randomized-sampling baseline, blue LiEqualizer. Arrows mark the gain over the orange bars.

Part IIIOn three vehicles, with LiDARs the model never saw

Real-vehicle clips, in preparation — the same ones the Downloads list promises. The still frames are in the On-vehicle section above.

Analysis

What the distillation actually moved

The two diagnostic figures from the manuscript, re-drawn here from the released measurements rather than pasted in as pictures. Both read band by band, from the lowest-frequency band on the left.

Fig 7. Alignment, band by band. Agreement between the student's field and the teacher's within each band, scaled so that one is the agreement the teacher reaches with itself when its input is re-drawn under the same budget. Higher is better in all three columns. This is the manuscript's Fig. 3, re-drawn here from the released measurements.
Fig 8. How much energy a band carries, and how much of it the teacher accounts for. The manuscript's Fig. 4, re-drawn from the released measurements.
Downloads

Code, data and checkpoints

The spectral measurement protocol is released with the code so the diagnosis can be reproduced on any sensor pair.

Documentation
Citation

BibTeX

@article{xu2026liequalizer,
  title   = {LiEqualizer: Seeing the Lost Spectrum of Sparse LiDARs via Spectral-Invariant Distillation},
  author  = {Xu, Zikun and Yang, Shuocheng and Wang, Jianqiang and Li, Keqiang
             and Lee, Gim Hee and Xu, Shaobing},
  year    = {2026},
  note    = {Preprint}
}
Spectrum

An open protocol for measuring what a sensor loses

The diagnosis is a separate contribution: a measurement protocol that reports what sparse sampling does to a signal, and whether distillation repaired it. Every figure below is rendered live from the released measurements.