Skip to content

Sync eng/common directory with azure-sdk-tools for PR 16431 - #49989

Open
azure-sdk-automation[bot] wants to merge 1 commit into
mainfrom
sync-eng-common-feat/cleanup-pre-vally-eval-infra-16431
Open

Sync eng/common directory with azure-sdk-tools for PR 16431#49989
azure-sdk-automation[bot] wants to merge 1 commit into
mainfrom
sync-eng-common-feat/cleanup-pre-vally-eval-infra-16431

Conversation

@azure-sdk-automation

Copy link
Copy Markdown
Contributor

Sync eng/common directory with azure-sdk-tools for PR Azure/azure-sdk-tools#16431 See eng/common workflow

Copilot AI review requested due to automatic review settings July 29, 2026 18:45
@azure-sdk-automation
azure-sdk-automation Bot requested a review from a team as a code owner July 29, 2026 18:45
@azure-sdk-automation
azure-sdk-automation Bot requested a review from helen229 July 29, 2026 18:45
@azure-sdk-automation azure-sdk-automation Bot added EngSys This issue is impacting the engineering system. Central-EngSys This issue is owned by the Engineering System team. labels Jul 29, 2026

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Note

Copilot could not run the full agentic suite for this review because it was automatically requested on a bot-authored pull request. Request a review from Copilot under Reviewers to retry with the full agentic suite. Improved support for bot-authored pull requests is coming soon.

Removes Azure Pipelines definitions used to run Copilot instruction AI evaluation tests.

Changes:

  • Deleted the reusable job template that executes the eval dotnet test run.
  • Deleted the pipeline entrypoint that triggered the eval job on changes to Copilot instructions.

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated no comments.

File Description
eng/common/pipelines/templates/jobs/ai-eval-job.yml Removes the shared job template that performed sparse checkout + AzureCLI-based eval execution.
eng/common/pipelines/ai-evals-tests.yml Removes the pipeline that triggered and extended the shared eval job template.
Comments suppressed due to low confidence (2)

eng/common/pipelines/ai-evals-tests.yml:1

  • Deleting this pipeline removes the only visible trigger that runs AI evals when .github/copilot-instructions.md (and related instruction paths) change. If the intent is to keep eval coverage, add/point to a replacement pipeline (or migrate this trigger elsewhere) so instruction changes still get validated automatically; otherwise, document the decommissioning and how/when evals are expected to run going forward.
    eng/common/pipelines/templates/jobs/ai-eval-job.yml:1
  • With the job template removed, any remaining pipeline(s) or docs that referenced /eng/common/pipelines/templates/jobs/ai-eval-job.yml will now fail or become stale. If this is an intentional removal, consider also removing/updating any references in-repo (e.g., other pipeline YAMLs, docs) to avoid broken extends/template paths.

@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines:
Successfully started running 1 pipeline(s).
35 pipeline(s) were filtered out due to trigger conditions.
There may be pipelines that require an authorized user to comment /azp run to run.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Central-EngSys This issue is owned by the Engineering System team. EngSys This issue is impacting the engineering system.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants