[smoke-detector] Comment on #2157 #2207
Description
🚨 Issue #2157 Recurrence - 4th Occurrence
Recurrence Alert
Issue #2157 was closed as "not_planned" on 2025-10-23 01:21:42Z, but the same failure continues to occur on every scheduled smoke test run.
Latest Failure Details
- Run: #18747816413
- Timestamp: 2025-10-23 12:08:41Z (UTC)
- Trigger: schedule (automated smoke test)
- Duration: 4.3 minutes
- Commit: 6b2c9e7
- Status: ❌ FAILED
Failure Pattern
This is the 4th occurrence of the identical error:
| Run ID | Timestamp | Trigger | Hours Since Previous | Status |
|---|---|---|---|---|
| 18727962258 | 2025-10-22 19:45:52Z | workflow_dispatch | - | Issue #2157 created |
| 18733557489 | 2025-10-23 00:19:22Z | schedule | ~5.5 hours | Issue still open |
| 18739169072 | 2025-10-23 06:07:04Z | schedule | ~6.2 hours | Issue closed |
| 18747816413 | 2025-10-23 12:08:41Z | schedule | ~6.6 hours | This failure |
Root Cause (Unchanged)
Still using invalid model: openai:gpt-4.1
The same error as described in #2157:
TypeError: Cannot read properties of undefined (reading 'text')
at githubActionSetOutputs ((redacted))
Location: .github/workflows/shared/genaiscript.md - GH_AW_AGENT_MODEL_VERSION: "openai:gpt-4.1"
Impact
- Failure Rate: 100% of scheduled GenAIScript smoke tests (3 consecutive scheduled runs since issue closed)
- Frequency: Failing every ~6 hours on scheduled runs
- Affected Workflows: All GenAIScript-based workflows
- Blocked Functionality: Threat detection and smoke test validation
Request for Action
Since this issue was closed as "not_planned" but the failure persists and continues to occur on every scheduled run, I'm requesting reconsideration:
Option 1: Fix the Configuration (Recommended - 1 minute fix)
Update .github/workflows/shared/genaiscript.md line 6:
# Change from:
GH_AW_AGENT_MODEL_VERSION: "openai:gpt-4.1"
# Change to:
GH_AW_AGENT_MODEL_VERSION: "openai:gpt-4o"Option 2: Disable the Scheduled Workflow
If GenAIScript smoke tests are not planned to be maintained, disable the scheduled trigger to stop generating failed runs.
Option 3: Update Issue Status
If this is expected behavior, please add a comment explaining why GenAIScript smoke tests failing every 6 hours is acceptable, so future investigations understand the context.
Historical Context
From pattern database (/tmp/gh-aw/cache-memory/patterns/genaiscript_invalid_model.json):
- First occurrence: 2025-10-22 19:45:52Z
- Total occurrences: 4
- Pattern: GENAISCRIPT_INVALID_MODEL
- Failure rate: 100% since first occurrence
Investigation Data
- Investigation Record:
/tmp/gh-aw/cache-memory/investigations/2025-10-23-18747816413.json - Pattern Record:
/tmp/gh-aw/cache-memory/patterns/genaiscript_invalid_model.json - Investigator Run: #18747929881
🤖 AI generated by Smoke Detector - Smoke Test Failure Investigator
This is an automated investigation of recurring smoke test failures.
AI generated by Smoke Detector - Smoke Test Failure Investigator