Publications / 2023 / Towards uniform point distribution in feature-preserving point cloud filtering

Towards uniform point distribution in feature-preserving point cloud filtering

S Chen, J Wang, Wei Pan, S Gao, M Wang, X Lu
Computational Visual Media, 9(2):249–263

In one sentenceA point cloud filter that pairs an edge-aware data term with a repulsion term, removing noise and keeping sharp edges while the filtered points stay evenly spread instead of leaving gaps near edges.

The problem

Raw point clouds from scanners contain noise, so they are usually filtered before upsampling, surface reconstruction or other downstream use. A good filter should move the noisy points back onto the underlying surface, keep sharp edges and corners, and leave the points evenly spread. Existing methods tend to manage only part of this. Position-based methods such as CLOP smooth well but, since they ignore normals, tend to smear sharp features. Normal-based methods keep sharp edges better, but their filtered points are often unevenly distributed, and some that include a repulsion term still leave gaps near the edges. Deep learning methods need noisy training data with ground truth and work on local patches; they too give uneven distributions, even with a repulsion loss, and sparse or unevenly sampled inputs are hard for them.

The paper builds on the edge-aware point update of an earlier low-rank filtering method. On its own, that update moves points towards sharp edges, where they concentrate and leave gaps beside the edge. These gaps hurt downstream steps such as upsampling and surface reconstruction.

Four small diagrams of two neighbouring points, yellow and green, near the corner of a blue sampled surface, with red normal arrows and the angle α between their connecting vector and a normal.
How the edge-aware update moves points near a sharp edge. In (a, b) the green point moves while the yellow one is fixed; in (c, d) the yellow point moves. The points move towards the edge and concentrate there, leaving gaps around it. Redrawn from Fig. 3 of the paper.

How it works

The method has two phases. It first smooths the point normals, then updates the point positions using those normals. The position update minimises the sum of two terms: an edge-aware data term that approximates the noisy surface while preserving geometric features, and a repulsion term that controls the point distribution.

  1. Noisy input. The input is a noisy point cloud with normals. If it has only positions, initial normals are estimated with principal component analysis (PCA).
  2. Normal filtering. The normals are smoothed with bilateral filtering. The quality of the filtered points depends heavily on the quality of these normals.
  3. Data term. For each point and each neighbour in its local patch, the update adjusts the angles between the vector joining the two points and their normals so that the vector becomes perpendicular to both normals. This brings points onto the underlying surface and preserves sharp features, but used alone it moves points towards the edges and leaves gaps.
  4. Repulsion term. A repulsion term based on point coordinates and normals pushes neighbouring points apart perpendicular to the neighbour’s normal, with a weight that decays smoothly with distance. A parameter µ sets its strength.
  5. Iterate. Both terms are combined in one gradient-descent update per point (Eq. 6 of the paper), computed on a patch of the k nearest neighbours and repeated for t iterations. Most experiments use k = 30, µ = 0.3 and t = 5 (Table 1).
Pipeline on an octahedron: red noisy points, blue filtered normals, a panel showing the data term and repulsion term acting on points with results after 1, 5 and 15 iterations, the filtered point cloud, and a grey reconstructed mesh.
Overview: (a) noisy input; (b) filtered normals; (c) position update, with a data term for feature preservation and a repulsion term for uniform distribution, over several iterations; (d) filtered point cloud; (e) mesh reconstructed from (d). Fig. 1 of the paper.

Results

The method is compared with a position-based method (CLOP), two normal-based methods (GPF and RIMLS) and three deep learning methods (TotalDenoising, PointCleanNet and Pointfilter, abbreviated TD, PCN and PF). The quantitative tests use five models with synthetic Gaussian noise of 0.5 % or 1.0 % (Bunnyhi, Rockerarm, Icosahedron, Dodecahedron and Kitten). The method has the lowest Chamfer distance on four of the five models and the lowest mean square error on three. On raw scans (Nefertiti, BuddhaStele, Realscan and David) there is no ground truth, so these are compared visually; the paper reports that its method keeps details such as sharp edges, the steps of BuddhaStele and facial features better than the others. The authors attribute the low errors to the more uniform point distribution: RIMLS, for example, gives comparable visual results in some cases but larger errors in most, owing to its uneven distribution. Without the repulsion term, some points concentrate at the edges.

Further tests cover point density, noise levels from 0.5 % to 3.0 %, irregular sampling, holes and an indoor scene. The authors state two limitations: as a normal-based method it depends on the quality of the input normals, and it may give less desirable results at very high noise (1.5 % is already more challenging than 0.5 % and 1.0 %). Big holes that severely disrupt the surface are also hard to fill, and the best neighbourhood size k depends strongly on point density.

Bunny point clouds coloured green and red: noisy input and filtered results of CLOP, GPF, RIMLS, TD, PCN, PF and the proposed method, with zoomed patches and grey reconstructed meshes below.
Bunnyhi with 0.5 % synthetic noise: filtered points (top) and surface reconstructions (bottom) for CLOP, GPF, RIMLS, TD, PCN, PF and the proposed method (h). Fig. 4 of the paper.
Two filtered polyhedron point clouds with zoomed insets of one corner: on the left points crowd at the edges, on the right they are spread evenly.
Filtered results without (a) and with (b) the repulsion term. Without it, some points concentrate at the edges; with it, the distribution is more even. Fig. 16 of the paper.

Cite

@article{chen2023towards,
  title={Towards uniform point distribution in feature-preserving point cloud filtering},
  author={Chen, Shuaijun and Wang, Jinxi and Pan, Wei and Gao, Shang and Wang, Meili and Lu, Xuequan},
  journal={Computational Visual Media},
  volume={9},
  number={2},
  pages={249--263},
  year={2023},
  publisher={TUP},
  doi={10.1007/s41095-022-0278-4}
}
Type
Article Journal
Topic
Geometry Processing
Venue
Computational Visual Media, 9(2):249–263
Year
2023
DOI