[observability] Observability Coverage Report - 2026-02-22

[github-actions[bot]]

Executive Summary

Across the last 7 days, 25 workflow runs were analyzed (2026-02-22 window). AWF Firewall coverage is partial, while MCP Gateway coverage is missing the expected gateway.jsonl artifact across all MCP-enabled runs. This leaves a major observability blind spot for MCP tool execution traces.

Firewall telemetry is present in 13 of 20 firewall-enabled runs (65%). The remaining 7 runs (mostly Issue Monster plus PR Triage Agent) have no access.log artifact, which is critical for diagnosing egress issues. MCP telemetry shows 14 MCP-enabled runs but 0 runs with gateway.jsonl present, which is a critical gap.

Key Alerts and Anomalies

🔴 Critical Issues:

• Missing gateway.jsonl in all 14 MCP-enabled runs.
• Missing firewall access.log in 7 firewall-enabled runs.

⚠️ Warnings:

• MCP logs exist as mcp-logs/rpc-messages.jsonl and mcp-logs/mcp-gateway.log, but the canonical gateway.jsonl artifact is absent, preventing standardized metrics extraction.

Coverage Summary

Component	Runs Analyzed	Logs Present	Coverage	Status
AWF Firewall (access.log)	20	13	65%	⚠️
MCP Gateway (gateway.jsonl)	14	0	0%	🔴

📋 Detailed Run Analysis

Firewall-Enabled Runs

Workflow	Run ID	access.log	Entries	Allowed	Blocked	Status
Duplicate Code Detector	22270034425	✅	42	16	26	✅
Daily Documentation Updater	22270286615	✅	72	35	37	✅
Issue Monster	22270287153	❌	0	0	0	🔴
Chroma Issue Indexer	22270520796	✅	80	53	27	✅
Smoke Temporary ID	22270553175	✅	15	10	5	✅
Smoke Project	22270553186	✅	20	14	6	✅
Copilot PR Prompt Pattern Analysis	22270828761	✅	60	27	33	✅
Issue Monster	22270879317	❌	0	0	0	🔴
GitHub Remote MCP Authentication Test	22270912981	✅	82	52	30	✅
Contribution Check	22271070447	✅	91	49	42	✅
Issue Monster	22271471765	❌	0	0	0	🔴
Artifacts Summary	22271526407	✅	68	24	44	✅
Dictation Prompt Generator	22271802744	✅	92	30	62	✅
PR Triage Agent	22271898819	❌	0	0	0	🔴
Issue Monster	22271941742	❌	0	0	0	🔴
Auto-Triage Issues	22271990014	✅	34	20	14	✅
Issue Monster	22272286748	❌	0	0	0	🔴
Plan Command	22272377820	✅	32	14	18	✅
Issue Monster	22272702112	❌	0	0	0	🔴
Workflow Health Manager - Meta-Orchestrator	22272741315	✅	75	30	45	✅

Missing Firewall Logs (access.log)

Workflow	Run ID	Date	Link
Issue Monster	22270287153	2026-02-22	§22270287153
Issue Monster	22270879317	2026-02-22	§22270879317
Issue Monster	22271471765	2026-02-22	§22271471765
PR Triage Agent	22271898819	2026-02-22	§22271898819
Issue Monster	22271941742	2026-02-22	§22271941742
Issue Monster	22272286748	2026-02-22	§22272286748
Issue Monster	22272702112	2026-02-22	§22272702112

MCP-Enabled Runs

Workflow	Run ID	gateway.jsonl	Status
Duplicate Code Detector	22270034425	❌	🔴
Daily Documentation Updater	22270286615	❌	🔴
Chroma Issue Indexer	22270520796	❌	🔴
Smoke Temporary ID	22270553175	❌	🔴
Smoke Gemini	22270553183	❌	🔴
Smoke Project	22270553186	❌	🔴
Copilot PR Prompt Pattern Analysis	22270828761	❌	🔴
GitHub Remote MCP Authentication Test	22270912981	❌	🔴
Contribution Check	22271070447	❌	🔴
Artifacts Summary	22271526407	❌	🔴
Dictation Prompt Generator	22271802744	❌	🔴
Auto-Triage Issues	22271990014	❌	🔴
Plan Command	22272377820	❌	🔴
Workflow Health Manager - Meta-Orchestrator	22272741315	❌	🔴

Missing Gateway Logs (gateway.jsonl)

Workflow	Run ID	Date	Link
Duplicate Code Detector	22270034425	2026-02-22	§22270034425
Daily Documentation Updater	22270286615	2026-02-22	§22270286615
Chroma Issue Indexer	22270520796	2026-02-22	§22270520796
Smoke Temporary ID	22270553175	2026-02-22	§22270553175
Smoke Gemini	22270553183	2026-02-22	§22270553183
Smoke Project	22270553186	2026-02-22	§22270553186
Copilot PR Prompt Pattern Analysis	22270828761	2026-02-22	§22270828761
GitHub Remote MCP Authentication Test	22270912981	2026-02-22	§22270912981
Contribution Check	22271070447	2026-02-22	§22271070447
Artifacts Summary	22271526407	2026-02-22	§22271526407
Dictation Prompt Generator	22271802744	2026-02-22	§22271802744
Auto-Triage Issues	22271990014	2026-02-22	§22271990014
Plan Command	22272377820	2026-02-22	§22272377820
Workflow Health Manager - Meta-Orchestrator	22272741315	2026-02-22	§22272741315

🔍 Telemetry Quality Analysis

Firewall Log Quality

• Total access.log entries analyzed: 763
• Allowed requests: 374
• Blocked requests: 389 (51%)
• Most accessed allowed domains: api.githubcopilot.com:443, api.anthropic.com:443, api.openai.com:443, api.github.com:443, github.com:443, raw.githubusercontent.com:443
• Blocked domains appear as - (redacted/unknown) in the firewall summary

Gateway Log Quality

• Expected gateway.jsonl was not present in any MCP-enabled run
• MCP artifacts do include mcp-logs/rpc-messages.jsonl and mcp-logs/mcp-gateway.log, but the canonical JSONL stream required by the report is missing

Healthy Runs Summary

• Firewall: 13 runs with access.log artifacts
• MCP: 0 runs with gateway.jsonl artifacts

Recommended Actions

1. Ensure MCP Gateway emits and uploads gateway.jsonl for every MCP-enabled run (or update the report pipeline if rpc-messages.jsonl is the intended canonical log).
2. Investigate why Issue Monster and PR Triage Agent runs are missing sandbox/firewall/logs/access.log despite firewall being enabled.
3. Add a validation step in the agent job to fail or warn when expected firewall or gateway artifacts are missing.

📊 Historical Trends

No historical baseline available in this run’s artifacts; recommend persisting daily coverage metrics to enable week-over-week comparisons.

---

Report generated automatically by the Daily Observability Report workflow
Analysis window: 2026-02-15 to 2026-02-22 | Runs analyzed: 25

References:

• §22272741315
• §22271526407
• §22270286615

AI generated by Daily Observability Report for AWF Firewall and MCP Gateway

• expires on Feb 23, 2026, 7:50 AM UTC

[github-actions[bot]]

This discussion was automatically closed because it expired on 2026-02-23T07:50:06.254Z.

Closed by Workflow