[DataLoader] Support concurrent multi-file reads per split - #539

Merged

robreeves merged 9 commits into

linkedin:mainfrom

robreeves:pyice2

Apr 13, 2026

Commits on Apr 8, 2026

[DataLoader] Re-add ArrivalOrder API and batch_size support via li-pyiceberg
robreeves
committed
518fbe2

Commits on Apr 9, 2026

[DataLoader] Support concurrent multi-file reads per split via files_per_split
robreeves
committed
ec8ec80

Commits on Apr 11, 2026

Merge upstream/main into pyice2
robreeves
committed
29e6a5a
Simplify task chunking with itertools.batched
robreeves
committed
cdc7e59
Remove redundant files_per_split tests
robreeves
committed
a6cf283
Reuse _make_real_catalog in files_per_split tests
robreeves
committed
a185b5d
Trim redundant multi-file split tests
robreeves
committed
035b4a2
Simplify multi-file test to reuse _create_test_split
robreeves
committed
1e79b36
Test that split id is stable regardless of file order
robreeves
committed
12f00fd