Skip to content
Merged
Changes from all commits
Commits
Show all changes
35 commits
Select commit Hold shift + click to select a range
121bf9d
Add hybrid scan multifile reader basics
mhaseeb123 May 21, 2026
b763cdb
Minor
mhaseeb123 May 21, 2026
c9bf419
Clean up claude's comments
mhaseeb123 May 21, 2026
795f058
Add gtests
mhaseeb123 May 21, 2026
ec0b59e
Merge branch 'main' into fea/hybrid-scan-multifile-base
mhaseeb123 May 21, 2026
f8b90ea
Apply suggestions from code review
mhaseeb123 May 21, 2026
90aef61
Update cpp/src/io/parquet/experimental/hybrid_scan_multifile.cpp
mhaseeb123 May 21, 2026
8876f57
Apply suggestions from @PointKernel (thanks!)
mhaseeb123 May 21, 2026
a575276
Minor
mhaseeb123 May 21, 2026
c7d7cb6
Minor changes
mhaseeb123 May 21, 2026
467a628
Allow more than 2B rows
mhaseeb123 May 21, 2026
1909146
Minor bug fix
mhaseeb123 May 21, 2026
17fd247
Minor
mhaseeb123 May 21, 2026
0493395
Merge branch 'main' into fea/hybrid-scan-multifile-base
mhaseeb123 May 21, 2026
e0319ab
Merge branch 'main' into fea/hybrid-scan-multifile-base
mhaseeb123 May 28, 2026
bf25506
Merge branch 'main' into fea/hybrid-scan-multifile-base
mhaseeb123 May 29, 2026
e013fda
Add multifile row group filtering with stats and byte ranges
mhaseeb123 May 29, 2026
209a9e2
Merge branch 'main' into fea/hybrid-scan-multifile-row-group-filter-p…
mhaseeb123 Jun 2, 2026
c164897
Revert unneeded changes
mhaseeb123 Jun 2, 2026
7a35f6e
Style fix
mhaseeb123 Jun 2, 2026
8c7b183
Address comments
mhaseeb123 Jun 2, 2026
140e90d
Address review comments
mhaseeb123 Jun 2, 2026
9fcbb0a
Apply suggestions
mhaseeb123 Jun 3, 2026
a35f429
Style
mhaseeb123 Jun 3, 2026
269212c
Merge branch 'main' of https://github.com/rapidsai/cudf into fea/hybr…
mhaseeb123 Jun 4, 2026
0d404b1
Multifile hybrid scan APIs for row mask construction
mhaseeb123 Jun 4, 2026
db305f0
Simplify test
mhaseeb123 Jun 5, 2026
6b9d7af
Merge branch 'main' into fea/hybrid-scan-multifile-row-mask
mhaseeb123 Jun 5, 2026
06d492f
Merge branch 'main' into fea/hybrid-scan-multifile-row-mask
mhaseeb123 Jun 8, 2026
24ae476
style
mhaseeb123 Jun 8, 2026
aedc4d2
Update test
mhaseeb123 Jun 9, 2026
f47ab1f
Merge branch 'main' into fea/hybrid-scan-multifile-row-mask
mhaseeb123 Jun 10, 2026
bcc6489
Merge branch 'main' into fea/hybrid-scan-multifile-row-mask
Matt711 Jun 11, 2026
ebf3b26
Merge branch 'main' into fea/hybrid-scan-multifile-row-mask
mhaseeb123 Jun 13, 2026
d08ba9d
Merge branch 'main' into fea/hybrid-scan-multifile-row-mask
mhaseeb123 Jun 15, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
Expand Up @@ -21,6 +21,7 @@

#include <algorithm>
#include <cstdint>
#include <functional>
#include <memory>
#include <vector>

Expand Down Expand Up @@ -356,9 +357,13 @@ TEST_F(HybridScanMultifileFiltersTest, BuildAllTrueRowMask)
[&](cudf::host_span<std::vector<cudf::size_type> const> row_group_indices) {
auto const row_mask = reader->build_all_true_row_mask(row_group_indices, stream, mr);

auto const expected_num_rows = reader->total_rows_in_row_groups(row_group_indices);

EXPECT_EQ(row_mask->type().id(), cudf::type_id::BOOL8);
EXPECT_EQ(row_mask->size(), reader->total_rows_in_row_groups(row_group_indices));
EXPECT_EQ(row_mask->size(), expected_num_rows);
EXPECT_EQ(row_mask->null_count(), 0);
auto const host_row_mask = host_row_mask_data<bool>(row_mask->view(), stream);
EXPECT_EQ(std::count(host_row_mask.begin(), host_row_mask.end(), true), expected_num_rows);
};
Comment thread
vuule marked this conversation as resolved.

auto row_group_indices = std::vector<std::vector<cudf::size_type>>{{0, 2}, {1, 3}};
Expand Down
Loading