Skip to content

Validate public real-data pipelines#63

Merged
rsasaki0109 merged 1 commit into
mainfrom
agent/public-real-data-validation
Jul 16, 2026
Merged

Validate public real-data pipelines#63
rsasaki0109 merged 1 commit into
mainfrom
agent/public-real-data-validation

Conversation

@rsasaki0109

Copy link
Copy Markdown
Owner

Summary

  • validate SpatialRust 1.1.0 on the public 460,400-point PCL table scan through Rust PCD→COPC→bounds/LOD→MVP and Python clean→cluster→FPFH→ICP pipelines
  • add an assertion-based Python real-data harness with dataset hash, structural counts, convergence, and transform-error gates
  • strengthen the ignored Autzen HTTP COPC smoke so a non-empty bounded ROI is required and a full 10.6M-point download is avoided
  • record the measured receipt and add the real-data E2E row to the roadmap

Root cause

The existing Autzen smoke selected a corner XY region plus a narrow Z slice. On the live dataset it returned zero points, but the test still passed because it only compared the empty ROI against a full download. The new central XY query requires 0 < roi_count < header_point_count.

Observed real-data results

  • PCL file: 5,649,007 bytes, SHA-256 E285D415641E0D9DE695B611DB874CC8FE995E8089B77A50D6056D24D8CBCC58
  • local COPC: 460,400 source, 76,919 ROI, 26 ROI+LOD, 54 plane inliers, 36 clusters
  • Python: 4,004 outliers removed, 9,840 voxel points, 4 clusters, FPFH error 0.1124, refined error 1.0587e-05
  • remote Autzen: 10,653,336 header points, 889,058 central ROI points

Validation

  • python bench/public_copc/run.py
  • python bench/public_copc/run.py --http
  • .venv/Scripts/python.exe bench/public_copc/validate_python.py
  • cargo test -p spatialrust --features mvp --test mvp_public_copc --release -- --nocapture mvp_public_pcd_copc_bounds_resolution_and_pipeline
  • cargo test -p spatialrust --features mvp,mvp-http --test mvp_public_copc --release -- --ignored --nocapture mvp_http_autzen_copc_bounds_smoke
  • cargo clippy -p spatialrust --features mvp,mvp-http --test mvp_public_copc -- -D warnings
  • cargo clippy --workspace --all-targets -- -D warnings
  • RUSTFLAGS="-D warnings" cargo test --workspace --no-run

@rsasaki0109
rsasaki0109 merged commit d64d887 into main Jul 16, 2026
88 checks passed
@rsasaki0109
rsasaki0109 deleted the agent/public-real-data-validation branch July 16, 2026 11:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant