Skip to content

Treat architecture design as a convention - #812

Draft
Sun Haoran (haoranpb) with Copilot wants to merge 7 commits into
mainfrom
copilot/explore-module-communication-ideas
Draft

Treat architecture design as a convention#812
Sun Haoran (haoranpb) with Copilot wants to merge 7 commits into
mainfrom
copilot/explore-module-communication-ideas

Conversation

Copilot AI commented Aug 21, 2026

Copy link
Copy Markdown
Contributor

Summary

Reframe dependency design as a Copilot Instruction convention and remove the deterministic import-graph test.

Decision

The dependency direction is a design convention best evaluated with implementation context and review, similar to convention-driven frameworks. Copilot Instructions preserve that guidance without the maintenance burden and rigidity of encoding every architectural relationship in a deterministic test.

Validation

uv run pytest: 746 passed, 1 skipped.

Copilot AI and others added 5 commits August 21, 2026 12:25
Co-authored-by: haoranpb <27280733+haoranpb@users.noreply.github.com>
Co-authored-by: haoranpb <27280733+haoranpb@users.noreply.github.com>
Co-authored-by: haoranpb <27280733+haoranpb@users.noreply.github.com>
Co-authored-by: haoranpb <27280733+haoranpb@users.noreply.github.com>
Co-authored-by: haoranpb <27280733+haoranpb@users.noreply.github.com>
from bcbench.config import get_config
from bcbench.dataset import TestEntry, TestGenEntry
from bcbench.evaluate.base import EvaluationPipeline
from bcbench.evaluate.base import AgentRunner, EvaluationPipeline


class AgentRunner[E: BaseDatasetEntry](Protocol):
def __call__(self, context: EvaluationContext[E], /) -> tuple[AgentMetrics | None, ExperimentConfiguration | None]: ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants