Parallelize Soroban pre-apply step. - #5402
Open
dmkozh wants to merge 1 commit into
Open
Conversation
dmkozh
force-pushed
the
par_pre_apply
branch
2 times, most recently
from
August 4, 2026 01:07
b7896a9 to
be994a5
Compare
Contributor
There was a problem hiding this comment.
Pull request overview
Parallelizes Soroban pre-apply validation while preserving serial ledger mutations.
Changes:
- Splits pre-apply into parallel read-only and sequential write phases.
- Adds a ledger view combining classic-phase changes with LCL state.
- Adds concurrency and signer/sequence regression tests with updated baselines.
Reviewed changes
Copilot reviewed 18 out of 18 changed files in this pull request and generated 5 comments.
Show a summary per file
| File | Description |
|---|---|
test-tx-meta-baseline-next/InvokeHostFunctionTests.json |
Updates next-protocol test baselines. |
test-tx-meta-baseline-current/InvokeHostFunctionTests.json |
Updates current-protocol test baselines. |
src/util/BatchExecutor.h |
Exposes preferred parallelism controls. |
src/util/BatchExecutor.cpp |
Computes preferred worker count. |
src/transactions/TransactionFrameBase.h |
Splits the pre-apply interface. |
src/transactions/TransactionFrame.h |
Declares read/write pre-apply paths. |
src/transactions/TransactionFrame.cpp |
Implements separated pre-apply processing. |
src/transactions/test/TransactionTestFrame.h |
Adapts the test transaction interface. |
src/transactions/test/TransactionTestFrame.cpp |
Delegates split pre-apply calls. |
src/transactions/test/SorobanTxTestUtils.cpp |
Corrects footprint deduplication. |
src/transactions/test/ParallelApplyTest.cpp |
Tests worker-count independence. |
src/transactions/test/InvokeHostFunctionTests.cpp |
Adds pre-apply regression coverage. |
src/transactions/ParallelApplyUtils.h |
Declares parallel pre-apply orchestration. |
src/transactions/ParallelApplyUtils.cpp |
Runs parallel reads and serial writes. |
src/transactions/FeeBumpTransactionFrame.h |
Splits fee-bump pre-apply APIs. |
src/transactions/FeeBumpTransactionFrame.cpp |
Implements fee-bump pre-apply phases. |
src/ledger/ImmutableLedgerView.h |
Defines the pre-apply ledger view. |
src/ledger/ImmutableLedgerView.cpp |
Implements combined ledger lookups. |
Suppressed comments (3)
src/transactions/ParallelApplyUtils.cpp:442
- Cap the task count at the number of bundles.
BatchExecutor::ensureWorkerscreates and retains one worker per submitted task, so a small ledger on a many-core host currently starts dozens of workers whose ranges are empty, adding startup and wake-up overhead to the path this PR is optimizing.
size_t taskCount = app.getBatchExecutor().preferredTaskCount();
src/transactions/ParallelApplyUtils.cpp:400
- This rationale has the direction backwards: removing a signer decreases the owner's sub-entry count (and, when sponsored, the sponsor's sponsoring count), which can only increase available balance. State that monotonic effect explicitly because it is the reason deferring these writes cannot invalidate another transaction.
// - The removal of one-time pre-authorized tx signers - this is also fine
// because any given transaction in a ledger is unique, and increasing the
// sub-entry count of a source/sponsor account is not relevant at that
// point, as the fees have already been successfully charged.
src/transactions/ParallelApplyUtils.cpp:391
- Correct the typo “separatation” to “separation”.
// This phase separatation hinges on the fact that the validation outcome
While the current logic intertwines reads and writes, in fact it can be cleanly separated into a read-only validation step, and a sequential commit step that simply bumps the sequence numbers and removes pre-authorized tx signers. This is possible because that while the writes change the entries that take part in validation, none of these changes are relevant during the validation. Specifically, sequence number bump is only observable by a single transaction (the one that has the respective account as a source), and the pre-authorized tx signer by definition belongs to a single transaction. There is also a subtle caveat to the latter operation: it increases the available balance of the signer owner (or its sponsor), but since at the pre-apply time the fees have already been charged, we're only checking that the account available balance is non-negative, which is an invariant that must always hold in the current protocol. The change is not protocol-gated because it's not a protocol change for the *current* protocol. It was technically a protocol change prior to p26 where we had a bug that actually did allow overcharging the fee bump source accounts and thus making their available balance to go negative. However, the bug has been fixed without the behavior ever triggering on-chain, and thus this replay-only behavior change should be non-observable. This change significantly speeds up the pre-apply step. On the local high TPL benchmarks I'm getting 30-60ms improvement locally compared to the main branch version.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
While the current logic intertwines reads and writes, in fact it can be cleanly separated into a read-only validation step, and a sequential commit step that simply bumps the sequence numbers and removes pre-authorized tx signers. This is possible because that while the writes change the entries that take part in validation, none of these changes are relevant during the validation. Specifically, sequence number bump is only observable by a single transaction (the one that has the respective account as a source), and the pre-authorized tx signer by definition belongs to a single transaction. There is also a subtle caveat to the latter operation: it increases the available balance of the signer owner (or its sponsor), but since at the pre-apply time the fees have already been charged, we're only checking that the account available balance is non-negative, which is an invariant that must always hold in the current protocol.
The change is not protocol-gated because it's not a protocol change for the current protocol. It was technically a protocol change prior to p26 where we had a bug that actually did allow overcharging the fee bump source accounts and thus making their available balance to go negative. However, the bug has been fixed without the behavior ever triggering on-chain, and thus this replay-only behavior change should be non-observable.
This change significantly speeds up the pre-apply step. On the local high TPL benchmarks I'm getting 30-60ms improvement locally compared to the main branch version.
This PR also adds test coverage for the edge case pre-apply interactions that weren't covered well (or at all), such as pre-auth signer removal, tx invalidation due to sequence bumps etc. This also contains a randomized acceptance test that ensures that parallel pre-apply logic is deterministic across any number of worker threads.
Checklist
clang-formatv8.0.0 (viamake formator the Visual Studio extension)