Skip to content

Add Cohen's h effect size to the statistics module #17

Description

@anilmurty

We report Wilson intervals and a McNemar p-value, but not a standardized effect size. Cohen's h is a small,
self-contained addition that helps readers judge how large a pass-rate difference is, not just whether it's
significant.

Add cohens_h(p1, p2) to tjbench/stats.py beside the existing functions (pure Python, no scipy), and
surface it in the stats block. Add unit tests for known values in tests/test_stats.py.

Acceptance criteria: cohens_h implemented + unit-tested; matches reference values for a few known
proportions.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions