Skip to content

Initial implementation to add parallelization. - #275

Merged
slabasan merged 4 commits into
llnl:developfrom
kshoga1:develop
Jul 23, 2026
Merged

Initial implementation to add parallelization. #275
slabasan merged 4 commits into
llnl:developfrom
kshoga1:develop

Conversation

@kshoga1

@kshoga1 kshoga1 commented May 14, 2026

Copy link
Copy Markdown
Collaborator

Initial implementation to add parallelization.

Credit to michaelmckinsey1 using GPT5 for the bulk of the work on this implementation.

…sey1 using GPT5 for the bulk of the work on this implementation.
@kshoga1 kshoga1 self-assigned this May 14, 2026
@kshoga1 kshoga1 added the area-thicket Issues and PRs involving Thicket's core Thicket datastructure and associated classes label May 14, 2026
@kshoga1
kshoga1 marked this pull request as draft May 14, 2026 18:44
@kshoga1

kshoga1 commented Jul 21, 2026

Copy link
Copy Markdown
Collaborator Author

Ran a couple performance tests between serial and parallel, and including the summary below. The dataset and testing are based on the what is used in the thicket tutorial notebook 08A_composing_parallel_sorting_data.ipynb (https://github.com/LLNL/thicket-tutorial/blob/develop/notebooks/08A_composing_parallel_sorting_data.ipynb)

Summary:

Test 1:

12,916 files

Serial:
Reading Thickets: 2min 23 sec
Creating Thickets: 2min 47sec
Total runtime: 5 min 14 seconds

Parallel:
Reading Thickets: 28 seconds
Creating Thickets: 53 seconds
Total runtime: 1 min 23 seconds
Improvement: 73.5% faster

Test 2:

25,832 files (test 1 file set duplicated)

Serial:
Reading Thickets: 4min 52 seconds
Creating Thickets: 5min 47 seconds
Total runtime: 10min 54 seconds

Parallel:
Reading Thickets: 1min 4 seconds
Creating Thickets: 2min 5 seconds
Total runtime: 3min 13 seconds
Improvement: 70.4% faster

@kshoga1
kshoga1 marked this pull request as ready for review July 21, 2026 23:19
@slabasan
slabasan merged commit 4ee4aa4 into llnl:develop Jul 23, 2026
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area-thicket Issues and PRs involving Thicket's core Thicket datastructure and associated classes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants