Initial implementation to add parallelization. - #275
Conversation
…sey1 using GPT5 for the bulk of the work on this implementation.
… adding better parameter validation for parallel merging.
|
Ran a couple performance tests between serial and parallel, and including the summary below. The dataset and testing are based on the what is used in the thicket tutorial notebook 08A_composing_parallel_sorting_data.ipynb (https://github.com/LLNL/thicket-tutorial/blob/develop/notebooks/08A_composing_parallel_sorting_data.ipynb) Summary: Test 1:12,916 files Serial: Parallel: Test 2:25,832 files (test 1 file set duplicated) Serial: Parallel: |
Initial implementation to add parallelization.
Credit to michaelmckinsey1 using GPT5 for the bulk of the work on this implementation.