Skip to content

[PERF]: kvikio byte range prefetch backend for hybrid scan #23535

Description

@Matt711

Byte range prefetch backend using kvikio's pread API to fetch data into pinned host memory ahead of evaluation. kvikio supports two remote IO backends: EASY_THREADPOOL (default, thread pool based) and MULTI_POLL (reactor based, similar to cuCascade). We need to evaluate both.

PR: #23317

Metadata

Metadata

Assignees

No one assigned

    Labels

    PerformancePerformance related issuecudf-polarsIssues specific to cudf-polars

    Type

    No type

    Projects

    Status
    Todo
    Status
    No status
    Status
    In Progress

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions