Smoke Test: Claude - 22023265398 #15760
Description
Test Results
Core Tests:
- ✅ Test rejig docs #1: GitHub MCP - Reviewed last 2 merged PRs (Add max limit enforcement to add_comment handler (SEC-003) #15745 and others)
- ✅ Test Add workflow: githubnext/agentics/weekly-research #2: Safe Inputs GH CLI - Queried 2 PRs (Disable agent sandbox firewall for smoke-copilot-sdk workflow #15756, Add error detection for git tool usage in workflows and fix affected workflows #15749)
- ✅ Test Add workflow: githubnext/agentics/weekly-research #3: Serena MCP - Activated project and found 100+ symbols
- ✅ Test Add workflow: githubnext/agentics/weekly-research #4: Make Build - Built successfully (c7466cc)
⚠️ Test Add workflow: githubnext/agentics/weekly-research #5: Playwright - Skipped (MCP tool not available in environment)- ✅ Test add cli flag to guard dropping a agentic workflow instructinos file #6: Tavily Web Search - Found 3 results for "GitHub Agentic Workflows"
- ✅ Test Weekly Research Report: AI Workflow Automation Landscape and Market Opportunities - August 2025 #7: File Writing - Created test file at
/tmp/gh-aw/agent/smoke-test-claude-22023265398.txt - ✅ Test Add workflow: githubnext/agentics/weekly-research #8: Bash Tool - Verified file creation successful
- ✅ Test Weekly Research Report: AI Workflow Automation Landscape and Strategic Opportunities - August 2025 #9: Discussion Query - Retrieved discussion copilot was here #15753
- ✅ Test Remove ai-inference, opencode, genaiscript agentic engines for now #10: Agentic Workflows MCP - Queried smoke-claude workflow status
PR Review Tests (using PR #15756):
- ✅ Test Fix orphan removal on "gh aw remove" #11: Update PR - Appended test message to PR body
- ✅ Test Weekly Research Report: AI Workflow Automation Landscape and Strategic Opportunities - August 2025 #12: PR Review Comments - Added 2 review comments on
.github/workflows/smoke-copilot-sdk.md - ✅ Test Add codex test action #13: Submit PR Review - Submitted consolidated review with COMMENT event
⚠️ Test codex naming #14: Resolve Review Thread - Skipped (no existing threads to resolve)- ✅ Test Revise caution note in README (#674) #15: Add Reviewer - Added copilot as reviewer
⚠️ Test Update default model in Codex engine to o4-mini and adjust test expectations #16: Push to PR Branch - Skipped (not on PR branch, oncopilot/update-codex-agentic-engine)⚠️ Test Enhance timestamp and token usage extraction for Codex format in logs #17: Close PR - Skipped (no safe test PR to close)
Overall Status
PARTIAL - All critical tests passed, some optional tests skipped
Details
- Run URL: https://github.com/github/gh-aw/actions/runs/22023265398
- Timestamp: 2026-02-14 19:51:36 UTC
- PR Used for Testing: Disable agent sandbox firewall for smoke-copilot-sdk workflow #15756 (Disable agent sandbox firewall for smoke-copilot-sdk workflow)
- Current Branch: copilot/update-codex-agentic-engine
- Discussion Tested: copilot was here #15753
Notes
- Playwright MCP tools not available in this execution environment
- PR push test skipped as workflow is running on a different branch
- All safe output operations succeeded
- Agentic Workflows MCP successfully queried workflow status
💥 [THE END] — Illustrated by Smoke Claude for issue #15748
- expires on Feb 14, 2026, 9:55 PM UTC