-
Notifications
You must be signed in to change notification settings - Fork 253
Closed as not planned
Description
Summary
Automated smoke test for Claude engine validation. Run §22187312231 — 2026-02-19.
Overall Status: PARTIAL (core tests all passed; 2 PR review sub-tests skipped due to tool/environment limitations)
PR used for review testing: #16842 (Add safe output items manifest for audit trail)
Core Test Results
| # | Test | Result | Notes |
|---|---|---|---|
| 1 | GitHub MCP | ✅ | Last 2 merged PRs: #16847 (docs), #16842 (safe output manifest) |
| 2 | Safe Inputs GH CLI | ✅ | Got 2 open PRs via safeinputs-gh pr list |
| 3 | Serena MCP | ✅ | Project activated; 6 symbols found for "Run" pattern |
| 4 | Make Build | ✅ | make build succeeded, binary compiled with version 79656dff |
| 5 | Playwright | ✅ | GitHub page title: "GitHub · Change is constant. GitHub keeps you ahead." |
| 6 | Tavily Search | ✅ | 3 results returned for "GitHub Agentic Workflows" |
| 7 | File Writing | ✅ | /tmp/gh-aw/agent/smoke-test-claude-22187312231.txt created |
| 8 | Bash Tool | ✅ | File contents verified via cat |
| 9 | Discussion Interaction | ✅ | Discussion #16828 found; comic-book comment added |
| 10 | Agentic Workflows MCP | ✅ | smoke-claude workflow: status=active, compiled=Yes |
PR Review Test Results
| # | Test | Result | Notes |
|---|---|---|---|
| 11 | Update PR body | ✅ | Appended "✨ PR Review Safe Output Test - Run 22187312231" to PR #16842 |
| 12 | Add review comments | ✅ | 2 inline comments on actions/setup/js/safe_output_manifest.cjs lines 10 & 17 |
| 13 | Submit PR review | ✅ | COMMENT review submitted with summary |
| 14 | Resolve review thread | Skipped — review thread node IDs (PRRT_kwDO...) require GraphQL; safeinputs-gh restricts multi-arg queries |
|
| 15 | Add reviewer | ✅ | copilot added as reviewer to PR #16842 |
| 16 | Push to PR branch | ✅ | Committed smoke-test-22187312231.md and pushed to copilot/update-safe-output-logging |
| 17 | Close test PR | Skipped — no suitable bot/test PR found that can be safely closed |
Details
Agentic Workflows Status
{
"workflow": "smoke-claude",
"engine_id": "claude",
"compiled": "Yes",
"status": "active",
"triggers": "pull_request (labeled: smoke), reaction (heart), schedule (every 12h)"
}Serena Symbol Search Results
Found 6 symbols matching Run:
SafeInputToolConfig/Run—pkg/workflow/safe_inputs_parser.go:33WorkflowStep/Run—pkg/workflow/step_types.go:18CopilotWorkflowStep/Run—pkg/cli/copilot_setup.go:115ProcessedRun/Run—pkg/cli/logs_models.go:69RunSummary/Run—pkg/cli/logs_models.go:177DownloadResult/Run—pkg/cli/logs_models.go:193
References:
💥 [THE END] — Illustrated by Smoke Claude for issue #16842
- expires on Feb 19, 2026, 5:20 PM UTC
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels