Skip to content

Switch back to cuCascade main during development cycle - #1153

Draft
pentschev wants to merge 1 commit into
rapidsai:mainfrom
pentschev:cucascade-main
Draft

Switch back to cuCascade main during development cycle#1153
pentschev wants to merge 1 commit into
rapidsai:mainfrom
pentschev:cucascade-main

Conversation

@pentschev

@pentschev pentschev commented Aug 17, 2026

Copy link
Copy Markdown
Member

#1145 pinned to NVIDIA/cuCascade@d515bb0 for two reasons:

  1. Pinning is always required before a RAPIDS release;
  2. NVIDIA/cuCascade@8a3b42f broke RapidsMPF.

This unpins cuCascade now that the issue has been fixed.

@pentschev pentschev self-assigned this Aug 17, 2026
@pentschev pentschev added improvement Improves an existing functionality non-breaking Introduces a non-breaking change labels Aug 17, 2026
@copy-pr-bot

copy-pr-bot Bot commented Aug 17, 2026

Copy link
Copy Markdown

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

@pentschev

Copy link
Copy Markdown
Member Author

/ok to test

@pentschev

Copy link
Copy Markdown
Member Author

Current cuCascade main NVIDIA/cuCascade@76a5966 still doesn't fix the original issue NVIDIA/cuCascade@8a3b42f introduced. This state was confirmed with a nightly image with rebuilt rapidsmpf+(lib)cudf_streaming+cudf_polars in a 2xNVL72 nodes:

RuntimeError: Multiple ranks share the same GPU (UUID collision detected). UUIDs: ['5961bd98-29e9-6744-49bb-e2e2b7a7b79a', '5961bd98-29e9-6744-49bb-e2e2b7a7b79a', '5961bd98-29e9-6744-49bb-e2e2b7a7b79a', '5961bd98-29e9-6744-49bb-e2e2b7a7b79a', 'f53cc9a3-3fa5-5ec2-6d0a-b9a933a737de', 'f53cc9a3-3fa5-5ec2-6d0a-b9a933a737de', 'f53cc9a3-3fa5-5ec2-6d0a-b9a933a737de', 'f53cc9a3-3fa5-5ec2-6d0a-b9a933a737de']. Set allow_gpu_sharing=True to allow this.

@pentschev

Copy link
Copy Markdown
Member Author

The issue above should be fixed by NVIDIA/cuCascade#191, once that is merge we should then be able to safely do the same to this PR.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

improvement Improves an existing functionality non-breaking Introduces a non-breaking change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant