Skip to content

Conversation

Copy link
Contributor

Copilot AI commented Dec 11, 2025

Task: Add Workflow Run URL Detection to Debug Agent

Plan

  • Update debug-agentic-workflow.agent.md to detect workflow run URLs
  • Add instructions for analyzing missing tool calls
    • Parse safe-outputs section for missing tools
    • Identify which tool the agent tried to call but couldn't
    • Provide recommendations on fixing tool availability
  • Add example flow for URL-based debugging
  • Test the updated agent instructions manually
  • Add note about using agentic-workflows tool when gh aw is not authenticated
  • Use engine-agnostic tool names (not MCP-specific name mangling)
  • Merge main branch

Changes Made

  1. Added Quick Start Example - Shows how the agent should respond when given a workflow run URL
  2. Enhanced Initial Discovery - Added support for accepting workflow run URLs in addition to workflow names
  3. New Debug Flow: Workflow Run URL Analysis - Complete section with:
    • Run ID extraction from URLs
    • Audit command usage
    • Missing tool analysis steps
    • Common scenarios and fixes
    • Specific recommendations for different types of tool issues
  4. Added Missing Tools Section - New subsection (Add workflow: githubnext/agentics/weekly-research #8) in "Common Issues to Look For" with:
    • Tool name mismatches
    • Configuration issues
    • Diagnostic steps
    • Common patterns and solutions
  5. Added agentic-workflows Tool Alternative - Important note about using engine-agnostic agentic-workflows tool when gh aw is not authenticated
  6. Used Engine-Agnostic Tool Names - Changed from MCP-specific names like agentic_workflows__audit to generic names like "Use the audit tool"
  7. Merged main branch - Resolved conflicts and updated all lock files

Key Features

The debug agent now:

  • ✅ Recognizes GitHub Actions workflow run URLs
  • ✅ Extracts run IDs automatically
  • ✅ Uses gh aw audit or agentic-workflows tool (engine-agnostic)
  • ✅ Analyzes missing tool reports
  • ✅ Provides specific fix recommendations
  • ✅ Documents tool alternatives without MCP-specific name mangling
  • ✅ Updated with latest changes from main branch
Original prompt

Investigate the reason there is a missing tool call in this run. It is not create a pull request

  • update the debug agentic workflow agent source to detect workflow run URLs, use the audit tool to receive information about the run, review missing tools

Reference: https://github.com/githubnext/gh-aw/actions/runs/20135841934/job/57789059104#step:36:1

Custom agent used: debug-agentic-workflow
Debug and refine agentic workflows using gh-aw CLI tools - analyze logs, audit runs, and improve workflow performance


💡 You can make Copilot smarter by setting up custom instructions, customizing its development environment and configuring Model Context Protocol (MCP) servers. Learn more Copilot coding agent tips in the docs.

Copilot AI and others added 2 commits December 11, 2025 14:22
Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
@pelikhan
Copy link
Contributor

@copilot update the debug agentic workflow with this important note:

if gh aw is not auth (running in copilot agent), use the corresponding tools exposed by the GitHub-agentic-workflows MCP server

Copilot AI changed the title [WIP] Update debug agent workflow to detect run URLs Add workflow run URL detection and missing tool analysis to debug agent Dec 11, 2025
Copilot AI requested a review from pelikhan December 11, 2025 14:35
…s not authenticated

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Copy link
Contributor Author

Copilot AI commented Dec 11, 2025

@copilot update the debug agentic workflow with this important note:

if gh aw is not auth (running in copilot agent), use the corresponding tools exposed by the GitHub-agentic-workflows MCP server

Added note in commit abbd6a1. The debug agent now documents the GitHub-agentic-workflows MCP server tools as alternatives when gh aw is not authenticated:

  • agentic_workflows__statusgh aw status
  • agentic_workflows__auditgh aw audit
  • agentic_workflows__logsgh aw logs
  • agentic_workflows__compilegh aw compile
  • agentic_workflows__updategh aw update
  • agentic_workflows__addgh aw add
  • agentic_workflows__mcp_inspectgh aw mcp inspect

The note appears in the "Key Commands Available" section and throughout the debug flows where CLI commands are referenced.


Or if `gh aw` is not authenticated, use the MCP tool:
```
agentic_workflows__audit with run_id: 20135841934
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@copilot use agentic engine agnostic tool (MCP name mangling is specific)

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
@pelikhan
Copy link
Contributor

@copilot continue work

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Copy link
Contributor Author

Copilot AI commented Dec 11, 2025

@copilot continue work

Updated in commit 14be8c7. Changed all MCP-specific references (agentic_workflows__audit, agentic_workflows__logs) to engine-agnostic tool names:

  • Now uses: "Use the audit tool with run_id: ..."
  • Now uses: "Use the logs tool with workflow_name: ..."
  • References generic agentic-workflows tool instead of MCP name mangling

Both .github/agents/debug-agentic-workflow.agent.md and pkg/cli/templates/debug-agentic-workflow.agent.md have been updated.

@pelikhan pelikhan marked this pull request as ready for review December 11, 2025 16:17
@pelikhan
Copy link
Contributor

@copilot merge main

Copy link
Contributor Author

Copilot AI commented Dec 11, 2025

@copilot merge main

Merged main in commit 40ebdbb. Resolved conflict with .github/workflows/ai-triage-campaign.lock.yml (deleted file). Branch is now up to date with main.

@pelikhan pelikhan merged commit 1ae5744 into main Dec 11, 2025
5 checks passed
@pelikhan pelikhan deleted the copilot/investigate-missing-tool-call branch December 11, 2025 16:25
Copilot AI restored the copilot/investigate-missing-tool-call branch December 11, 2025 16:25
@pelikhan pelikhan deleted the copilot/investigate-missing-tool-call branch December 15, 2025 04:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants