Add human review gates to code review skill - #19434
Open
David Pine (IEvangelist) wants to merge 1 commit into
Open
Add human review gates to code review skill#19434David Pine (IEvangelist) wants to merge 1 commit into
David Pine (IEvangelist) wants to merge 1 commit into
Conversation
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Contributor
|
🚀 Dogfood this PR with:
curl -fsSL https://raw.githubusercontent.com/microsoft/aspire/main/eng/scripts/get-aspire-cli-pr.sh | bash -s -- 19434Or
iex "& { $(irm https://raw.githubusercontent.com/microsoft/aspire/main/eng/scripts/get-aspire-cli-pr.ps1) } 19434" |
Contributor
There was a problem hiding this comment.
Copilot encountered an error and was unable to review this pull request. You can try again by re-requesting a review.
Note
This error may be related to your runner configuration. You can now configure runners for Copilot code review separately from Copilot cloud agent by creating a copilot-code-review.yml file with your setup steps. Read the docs for details.
Copilot stopped reviewing on behalf of
David Pine (IEvangelist) due to an error
August 17, 2026 13:52
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Issue #19370 exposed a gap in our AI-assisted review workflow. PR #18858 changed a public npm registry to an internal feed, propagated that choice into customer-facing CLI and generated artifacts, changed supply-chain checks, and added tests that asserted the new internal default. Material behavior also changed after the last human approval. The review process found several local issues but did not challenge whether internal build infrastructure should become shipped customer behavior.
This PR keeps the
code-reviewskill's existing high-confidence findings model and adds a separate, provenance-neutral semantic risk pass. A single sensitive trigger now requires human review:Triggered changes appear in a distinct Human review required section rather than being presented as proven defects. Each item must identify the exact evidence, affected surfaces, implications, required human validation, and whether an existing approval covers the current head. The skill will not recommend or submit
APPROVEuntil the user explicitly confirms that the listed human review occurred.The review guidance also now requires tracing sensitive values to shipped sinks, separating repository infrastructure from product behavior, comparing removed security controls with their replacements, preferring outcome-oriented boundary validation over implementation-shaped tests, and checking approval freshness. Issue #19370 is included as a calibration case so the guidance generalizes to registries, mirrors, endpoints, credentials, and security controls without special-casing npm.
docs/contributing.mdnow describes the new human-review escalation and approval gate.Note
These Copilot skills are living guidance. If these triggers become too noisy or over-escalate routine changes, we can continue to tune the categories, wording, and threshold based on real review experience.
Validation
aspire agent init, and ships as the customer default #19370 scenario as a regression calibration against PR [auto-sec] Consolidate Aspire JavaScript template dependency security remediations #18858, including its internal-customer default, security-control change, generated-artifact default, implementation-shaped test, and ten material commits after the last human approval.Related to #19370
Checklist
<remarks />and<code />elements on your triple slash comments?