-
Notifications
You must be signed in to change notification settings - Fork 232
Closed as not planned
Description
Daily News - Intermittent Workflow Failures
Status Summary
Priority: P2 - HIGH
Success Rate: 40% (4 success / 6 failures in last 10 runs)
Health Score: 40/100
Impact: Daily digest delivery inconsistent, users missing repository updates
Failure Pattern
Recent Runs (Intermittent)
- Run Add --before and --after time filtering with relative time support to gh aw inspect #103: Failed on 2026-01-15 - https://github.com/githubnext/gh-aw/actions/runs/21025829982
- Run [copilot] update
gh aw inspecttime filter (--before, --after) to support relative time (-24) #102: Failed on 2026-01-14 - https://github.com/githubnext/gh-aw/actions/runs/20988673480 - Run Implement goccy/go-yaml with line offset support for frontmatter error reporting #101: Failed on 2026-01-13 - https://github.com/githubnext/gh-aw/actions/runs/20951135921
- Run [copilot] yaml syntax errors with location #100: Failed on 2026-01-12 - https://github.com/githubnext/gh-aw/actions/runs/20913901067
- Run Add --engine filter to gh aw logs command #99: Failed on 2026-01-09 - https://github.com/githubnext/gh-aw/actions/runs/20846973162
Pattern: 6 failures in last 10 runs, intermittent (not consecutive)
Impact Assessment
User Impact
- Daily Digest: Users not receiving daily repository activity summaries
- Visibility: Missing updates on issues, PRs, discussions, and workflow runs
- Engagement: Reduced team awareness of repository activity
Scheduling Impact
- Trigger: Weekday schedule (Mon-Fri at 9am UTC)
- Coverage: Business days only (Sat-Sun excluded)
- Frequency: Once per day when working
Configuration Analysis
Workflow: .github/workflows/daily-news.md
engine: copilot
timeout-minutes: 30
tracker-id: daily-news-weekday
network:
allowed:
- defaults
- python
- node
sandbox:
agent: awf # Firewall enabled
tools:
repo-memory:
branch-name: memory/daily-news
file-glob: ["memory/daily-news/*.json", "*.jsonl", "*.csv", "*.md"]
max-file-size: 102400 # 100KB
edit:
bash: ["*"]
web-fetch:
safe-outputs:
upload-asset:
create-discussion:
expires: 3d
category: "daily-news"
max: 1
close-older-discussions: trueKnown Issues
Previous Reports
- Issue [P1] Daily News Workflow Timeout Failures - 50% Success Rate #9899: Reported as open with timeout issues
- Error Pattern: Exit code 7 (timeout) mentioned in previous analysis
- Similar to: CI Doctor timeout issues (which were resolved)
Timeout Pattern Analysis
- Configuration: 30-minute timeout (reduced from 45 minutes)
- Note: "Reduced from 45 since pre-fetching data is faster"
- CI Doctor Fix: Successfully resolved similar timeout issues
- Opportunity: Apply CI Doctor's fix to Daily News
Investigation Required
Immediate Actions
- Review Issue [P1] Daily News Workflow Timeout Failures - 50% Success Rate #9899 - Check current status and investigation progress
- Analyze timeout patterns - Determine if exceeding 30-minute limit
- Check pre-fetch logic - Verify if data pre-downloading works correctly
- Test network access - Validate firewall and network permissions
- Compare with CI Doctor - Apply similar timeout resolution approach
Likely Root Causes
- ✅ Timeout exceeding 30 minutes
- ✅ Network connectivity issues (firewall restrictions)
- ✅ Repo-memory access delays
- ✅ GitHub API rate limiting
- ✅ Pre-fetch logic not optimized
- ✅ Tool invocation overhead
Recommended Fix Approach
Short-term (Immediate)
- Increase timeout back to 45 minutes temporarily
- Monitor run duration to establish baseline
- Check pre-fetch effectiveness - Verify it actually speeds up execution
- Test without firewall to isolate network issues
Long-term (Optimization)
- Apply CI Doctor fix - Use similar timeout resolution strategy
- Optimize data collection - Reduce API calls and tool invocations
- Improve caching - Better use of repo-memory for historical data
- Parallel processing - Fetch data concurrently where possible
Success Criteria
- Workflow runs successfully with >80% success rate
- No timeout errors (runs complete within 30 minutes)
- Daily digest delivered consistently on weekdays
- Discussion created with repository activity summary
- Asset uploaded with detailed news data
Related Issue: #9899
Workflow Run: https://github.com/githubnext/gh-aw/actions/runs/21053929777
Generated: 2026-01-16T02:53:12Z
Generated by: Workflow Health Manager
AI generated by Workflow Health Manager - Meta-Orchestrator
Reactions are currently unavailable