Skip to content

Sync .github/skills directory with azure-sdk-tools for PR 17350 - #49671

Merged
Helen Gao (helen229) merged 3 commits into
mainfrom
sync-.github-skills-fix/eval-mcp-app-runtime-17350
Oct 22, 2026
Merged

Helen Gao (helen229) merged 3 commits into
mainfrom
sync-.github-skills-fix/eval-mcp-app-runtime-17350

Conversation

@azure-sdk-automation

Copy link
Copy Markdown
Contributor

Sync .github/skills directory with azure-sdk-tools for PR Azure/azure-sdk-tools#17350 See eng/common workflow

@azure-sdk-automation
azure-sdk-automation Bot requested review from Helen Gao (helen229) and a balanced review from Copilot October 22, 2026 21:30
@azure-sdk-automation azure-sdk-automation Bot added EngSys This issue is impacting the engineering system. Central-EngSys This issue is owned by the Engineering System team. labels Oct 22, 2026
@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines:
10 pipeline(s) were filtered out due to trigger conditions.
There may be pipelines that require an authorized user to comment /azp run to run.

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟢 Approval recommended

The changes are narrowly scoped to evaluation configuration and prompts, with no blocking issues identified.

No open issues 🎉

What changed in this PR

Syncs Azure SDK skill evaluations with azure-sdk-tools PR #17350. These changes update evaluation configuration and routing checks without changing SDK runtime code.

Changes:

  • Replace top-level config with defaults in four evaluation files.
  • Explicitly load skills and update skill-invocation assertions.
  • Use next calendar month for the release-plan target so the scenario does not become outdated.
File Description
.github/​skills/​azsdk-common-sdk-release/​evals/​eval.yaml Updates defaults, skill loading, and invocation grading.
.github/​skills/​azsdk-common-sdk-breaking-change/​evals/​trigger.eval.yaml Explicitly loads the breaking-change skill.
.github/​skills/​azsdk-common-prepare-release-plan/​evals/​schedule-risk.eval.yaml Uses a relative future target while retaining the mock’s overdue-plan warning.
.github/​skills/​azsdk-common-prepare-release-plan/​evals/​eval.yaml Migrates evaluation settings to defaults.
.github/​skills/​azsdk-common-generate-sdk-locally/​evals/​trigger.eval.yaml Loads both routing candidates and requires the breaking-change skill for its scenario.
.github/​skills/​azsdk-common-generate-sdk-locally/​evals/​eval.yaml Migrates evaluation settings to defaults.
.github/​skills/​azsdk-common-apiview-feedback-resolution/​evals/​eval.yaml Migrates evaluation settings to defaults.

Review effort: Balanced

@helen229 Helen Gao (helen229) left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approving the shared-skill eval sync from Azure/azure-sdk-tools#17350. All seven file changes match the source and the referenced breaking-change skill is present in this repository.

@helen229
Helen Gao (helen229) merged commit eb4f27d into main Oct 22, 2026
40 of 41 checks passed
@helen229
Helen Gao (helen229) deleted the sync-.github-skills-fix/eval-mcp-app-runtime-17350 branch October 22, 2026 21:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Central-EngSys This issue is owned by the Engineering System team. EngSys This issue is impacting the engineering system.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants