Submission/conpara v216

[MohamedMady19]

No description provided.

[MohamedMady19]

Hi @liamdugan, please feel free to process this when possible.

[MohamedMady19]

Hi @liamdugan, We kindly remind you to process this submission as it's necessary for our paper. Thank you!

[github-actions]

It looks like this eval run failed. Please check the workflow logs to see what went wrong, then push a new commit to your PR to rerun the eval.

[MohamedMady19]

@liamdugan , the evaluation is failing due to a GitHub Actions security restriction on pull_request_target with fork PRs:

"Refusing to check out fork pull request code from a pull_request_target' workflow"

This is not a problem with our submission files. The fix requires adding allow-unsafe-pr-checkout: true to the actions/checkout step in leaderboard-submission.yml, or alternatively merging and running evaluation from main.

Our previous PRs (#172) went through fine — this appears to be a recent GitHub Actions policy change. Happy to help debug if needed. Thank you!

I would very much appreciate merging #172 with v2.14b to the leaderboard until this is solved. Thank you.

[liamdugan]

Apologies @MohamedMady19 seems like there's an issue on our end with the evaluation bot (GitHub updated some default permission setting). Will follow up on this tonight.

[MohamedMady19]

Apologies @MohamedMady19 seems like there's an issue on our end with the evaluation bot (GitHub updated some default permission setting). Will follow up on this tonight.

Hi @liamdugan , are there any updates?

[github-actions]

Eval run succeeded! Link to run: link

Here are the results of the submission(s):

DeBERTa-ConPara-v2.16

Release date: 2026-07-20

I've committed detailed results of this detector's performance on the test set to this PR.

On the RAID dataset as a whole (aggregated across all generation models, domains, decoding strategies, repetition penalties, and adversarial attacks), it achieved an AUROC of 96.91 and a TPR of 98.88% at FPR=5% and 87.20% at FPR=1%.
Without adversarial attacks, it achieved AUROC of 97.39 and a TPR of 98.67% at FPR=5% and 90.87% at FPR=1%.

DeBERTa-ConPara-v2.14b

Release date: 2026-07-07

I've committed detailed results of this detector's performance on the test set to this PR.

Warning

Failed to find threshold values that achieve False Positive Rate(s): (['1%']) on all domains. This submission will not appear in the main leaderboard for those FPR values; it will only be visible within the splits in which the target FPR was achieved.
On the RAID dataset as a whole (aggregated across all generation models, domains, decoding strategies, repetition penalties, and adversarial attacks), it achieved an AUROC of 95.70 and a TPR of 98.90% at FPR=5%.
Without adversarial attacks, it achieved AUROC of 96.18 and a TPR of 98.69% at FPR=5%.

If all looks well, a maintainer will come by soon to merge this PR and your entry/entries will appear on the leaderboard. If you need to make any changes, feel free to push new commits to this PR. Thanks for submitting to RAID!

[MohamedMady19]

Eval run succeeded! Link to run: link

Here are the results of the submission(s):

DeBERTa-ConPara-v2.16

Release date: 2026-07-20

I've committed detailed results of this detector's performance on the test set to this PR.

On the RAID dataset as a whole (aggregated across all generation models, domains, decoding strategies, repetition penalties, and adversarial attacks), it achieved an AUROC of 96.91 and a TPR of 98.88% at FPR=5% and 87.20% at FPR=1%. Without adversarial attacks, it achieved AUROC of 97.39 and a TPR of 98.67% at FPR=5% and 90.87% at FPR=1%.

DeBERTa-ConPara-v2.14b

Release date: 2026-07-07

I've committed detailed results of this detector's performance on the test set to this PR.

Warning

Failed to find threshold values that achieve False Positive Rate(s): (['1%']) on all domains. This submission will not appear in the main leaderboard for those FPR values; it will only be visible within the splits in which the target FPR was achieved. On the RAID dataset as a whole (aggregated across all generation models, domains, decoding strategies, repetition penalties, and adversarial attacks), it achieved an AUROC of 95.70 and a TPR of 98.90% at FPR=5%. Without adversarial attacks, it achieved AUROC of 96.18 and a TPR of 98.69% at FPR=5%.

If all looks well, a maintainer will come by soon to merge this PR and your entry/entries will appear on the leaderboard. If you need to make any changes, feel free to push new commits to this PR. Thanks for submitting to RAID!

Thanks @liamdugan, both entries look clean. Can you please merge v2.16 to the leaderboard?

[liamdugan]

@MohamedMady19 would you like to also add v2.14 as well? If not, can you please remove it from this PR?

[MohamedMady19]

@MohamedMady19 would you like to also add v2.14 as well? If not, can you please remove it from this PR?

Please add V2.16 only; I will remove V2.14 from the PR. Thank You @liamdugan