Repository navigation
Smoke Test: Claude - 24941211951 #28508
Description
Summary
Smoke test run for Claude engine completed on 2026-04-25. Overall status: PARTIAL (1 failure, 2 skipped).
Run URL: https://github.com/github/gh-aw/actions/runs/24941211951
Timestamp: 2026-04-25T21:38 UTC
PR used for review tests: #28496 (already merged)
Test Results
| # | Test | Result | Notes |
|---|---|---|---|
| 1 | GitHub MCP Testing | ✅ | Reviewed PRs #28496 and #28494 (last 2 merged) |
| 2 | MCP Scripts GH CLI Testing | ✅ | Got PRs #28502, #28501 via gh CLI |
| 3 | Serena MCP Testing | ✅ | Project activated; 10+ symbols found in gemini_engine.go |
| 4 | Make Build Testing | ✅ | make build succeeded, binary built |
| 5 | Playwright Testing | ✅ | github.com loaded, title contains "GitHub" |
| 6 | Tavily Web Search Testing | ✅ | 3 results for "GitHub Agentic Workflows" |
| 7 | File Writing Testing | ✅ | /tmp/gh-aw/agent/smoke-test-claude-24941211951.txt created |
| 8 | Bash Tool Testing | ✅ | File content verified via cat |
| 9 | Discussion Interaction Testing | ✅ | Comic-book comment added to discussion #28504 |
| 10 | Agentic Workflows MCP Testing | ❌ | Error: "failed to get workflow statuses" |
| 11 | Slack Safe Output Testing | ✅ | Message posted to #smoke-tests |
| 12 | Code Scanning Alert Testing | ✅ | Dummy warning alert created for README.md:1 |
| 13 | Update PR Testing | ✅ | PR #28496 body updated with append |
| 14 | PR Review Comment Testing | ✅ | 2 comments added to gemini_engine.go lines 169, 177 |
| 15 | Submit PR Review Testing | ✅ | COMMENT review submitted |
| 16 | Resolve Review Thread Testing | Skipped — PR data integrity-filtered, cannot read threads | |
| 17 | Add Reviewer Testing | ✅ | copilot added as reviewer |
| 18 | Push to PR Branch Testing | ✅ | smoke-test-files/smoke-claude-push-test.md pushed |
| 19 | Close PR Testing | Skipped — no safe test PR to close |
Failure Details
Test #10 — Agentic Workflows MCP Status:
- Error:
MCP error -32603: calling "tools/call": failed to get workflow statuses - Both attempts returned same error
- Status file written to
/tmp/gh-aw/agent/smoke-claude-status-24941211951.txt
Skipped Details
Test #16 — Resolve Review Thread:
PR #28496 data is filtered by integrity policy (integrity below "approved"), preventing reading of review thread IDs via GitHub MCP.
Test #19 — Close PR:
No test/bot PR available to safely close.
References:
- §24941211951 — This smoke test run
Note
🔒 Integrity filter blocked 1 item
The following item was blocked because it doesn't meet the GitHub integrity level.
- fix: add --skip-trust to Gemini CLI command to prevent yolo override in AWF sandbox #28496
pull_request_read: has lower integrity than agent requires. The agent cannot read data with integrity below "approved".
To allow these resources, lower min-integrity in your GitHub frontmatter:
tools:
github:
min-integrity: approved # merged | approved | unapproved | none💥 [THE END] — Illustrated by Smoke Claude · ● 178.1K · ◷
- expires on Apr 25, 2026, 11:44 PM UTC
Activity
github-actions commentedon Apr 26, 2026
This issue was automatically closed because it expired on 2026-04-25T23:44:48.246Z.