-
Notifications
You must be signed in to change notification settings - Fork 235
Closed as not planned
Labels
Description
Smoke Test Results - Claude Engine
Run ID: 22121258785
Timestamp: 2026-02-18 00:26 UTC
Overall Status:
Core Tests (1-10)
- ✅ GitHub MCP Testing - Retrieved last 2 merged PRs from github/gh-aw
- ✅ Safe Inputs GH CLI Testing - Queried 2 PRs using safeinputs-gh tool
- ✅ Serena MCP Testing - Activated project and found 3+ symbols (130,117 symbols found)
- ✅ Make Build Testing - Built project successfully using safeinputs-make
- ✅ Playwright Testing - Navigated to github.com, verified title contains "GitHub"
- ✅ Tavily Web Search Testing - Found 3 results for "GitHub Agentic Workflows"
- ✅ File Writing Testing - Created test file at /tmp/gh-aw/agent/smoke-test-claude-22121258785.txt
- ✅ Bash Tool Testing - Verified file creation with cat command
- ✅ Discussion Interaction Testing - Retrieved discussion Daily Compiler Code Quality Report - 2026-02-18 #16476 and added comment
- ✅ Agentic Workflows MCP Testing - Queried smoke-claude workflow status, wrote results to file
PR Review Safe Outputs Tests (11-17)
Test PR: #16470 (Enable LLM gateway for Copilot engine and upgrade firewall to v0.20.0)
- ✅ Update PR Testing - Appended test message to PR body
- ✅ PR Review Comment Testing - Added 2 review comments on different files
- ✅ Submit PR Review Testing - Submitted consolidated review with COMMENT event
⚠️ Resolve Review Thread Testing - SKIPPED (no existing threads to resolve)- ✅ Add Reviewer Testing - Added "copilot" as reviewer
⚠️ Push to PR Branch Testing - SKIPPED (cannot add files outside repo to git)⚠️ Close PR Testing - SKIPPED (no safe test PR to close)
Test Summary
- Passed: 13/17 tests
- Skipped: 4/17 tests (tests 14, 16, 17 - expected limitations)
- Failed: 0/17 tests
All critical functionality tests passed. Skipped tests were due to environmental constraints (no review threads to resolve, git limitations for files outside repo, no safe test PR to close).
Run URL: https://github.com/github/gh-aw/actions/runs/22121258785
💥 [THE END] — Illustrated by Smoke Claude for issue #16470
- expires on Feb 18, 2026, 2:30 AM UTC
Reactions are currently unavailable