Skip to content

Reproducing the CEDAR and IEDB benchmarks: random seeds and data splits #9

Description

@Yongrui-Wang

We are attempting to reproduce the CEDAR and IEDB benchmark experiments reported in the ImmunoStruct paper.

The manuscript states that the experiments were performed under five random seeds. We could not identify the exact five seeds or the corresponding train/validation/test split indices for either the CEDAR or IEDB experiments in the repository.

Could you please provide either:

  1. the exact five random seeds used for the reported CEDAR and IEDB experiments, or preferably
  2. the corresponding train/validation/test indices (or split files) for each of the five runs?

Having the exact splits would help us reproduce the reported benchmark results under the same evaluation setting.

Thank you very much for making the code, datasets, and model weights publicly available.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions