Skip to content

Select only changed live-test methods - #56

Merged
Aditya Pujara (a0x1ab) merged 1 commit into
mainfrom
fix/live-test-method-selection
Sep 26, 2026
Merged

Aditya Pujara (a0x1ab) merged 1 commit into
mainfrom
fix/live-test-method-selection

Conversation

@a0x1ab

Copy link
Copy Markdown
Member

Summary

Root cause

The failed live-test run for Azure/azure-cli#34126 checked out the correct PR head (f116f590) but treated replacement hunks as unsafe deletions and selected three entire test files. This ran 30 tests and failed first in unrelated test_storage_blob_batch_copy, whose unchanged preparer requested legacy kind=Storage.

With this change, the same PR revision selects only:

  • storage.test_storage_blob_batch_download_scenarios
  • storage.test_storage_blob_download_batch (new focused file)
  • storage.test_storage_blob_batch_oauth_scenarios

Validation

  • python3 -m unittest discover -s .github/scripts -p "test_*.py" (18 passed)
  • reproduced selector output against Azure/azure-cli commit f116f590a4910615264740f32c056655e5840342

Handle replacement hunks inside test methods without falling back to the entire file. Preserve conservative file-level fallback for shared helpers, imports, deletion-only changes, and ambiguous selectors.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>

Copilot-Session: eb18b819-160c-48b7-a183-407ee5c12a2f

@x-engineering-agent x-engineering-agent Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Selector regression coverage passes and the change safely narrows live-test execution while retaining conservative fallbacks.

@a0x1ab
Aditya Pujara (a0x1ab) merged commit ad51e01 into main Sep 26, 2026
2 of 3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant