Fix artifacts-summary workflow GitHub MCP toolset configuration

[Copilot]

The artifacts-summary workflow was failing because it specified non-existent GitHub MCP tools in its allowed list (list_workflows, list_workflow_runs, list_workflow_run_artifacts). The GitHub MCP server organizes capabilities into toolsets, not individual tool names.

Changes

• Replace allowed list with toolset: [actions, repos] configuration
• Aligns with pattern used in dev-hawk.md and smoke-detector.md workflows

Before:

tools:
  github:
    allowed: 
      - list_workflows
      - list_workflow_runs
      - list_workflow_run_artifacts

After:

tools:
  github:
    toolset: [actions, repos]

The actions toolset provides access to workflows, runs, and artifacts APIs. The repos toolset provides repository-level access for the analysis.

Fixes #2490

Original prompt

---

This section details on the original issue you should resolve

<issue_title>[q] Fix artifacts-summary workflow GitHub toolset configuration</issue_title>
<issue_description># Q Workflow Optimization Report

Issues Found (from live data)

artifacts-summary (.github/workflows/artifacts-summary.md)

• Log Analysis: Workflow run githubnext/gh-aw#18810355435 (and 3 other recent runs) failed due to missing GitHub API access
• Run IDs Analyzed:
  • 18810355435 (success with errors)
  • 18809742093 (failure)
  • 18808703701 (failure)
  • 18807941061 (failure)
• Issues Identified:
  • Missing tools: The workflow attempted to use non-existent GitHub MCP tools:
    • list_workflows ❌ (does not exist)
    • list_workflow_runs ❌ (does not exist)
    • list_workflow_run_artifacts ❌ (does not exist)
  • Error from logs: "Need to query GitHub API to list workflows, workflow runs, and artifacts data for generating the artifacts usage report"
  • Root cause: The workflow was using an allowed list with tool names that don't exist in the GitHub MCP server

Changes Made

artifacts-summary.md

Before:

tools:
  github:
    allowed: 
      - list_workflows
      - list_workflow_runs
      - list_workflow_run_artifacts

After:

tools:
  github:
    toolset: [actions, repos]

Why this fixes the issue:

1. The GitHub MCP server doesn't expose individual tools named list_workflows, list_workflow_runs, or list_workflow_run_artifacts
2. Instead, workflow and artifact management capabilities are provided through the actions toolset
3. The repos toolset provides repository-level access needed for the analysis
4. This pattern matches other workflows that successfully access workflow data (dev-hawk, smoke-detector)

Expected Improvements

• ✅ Eliminates "missing tool" errors by using valid GitHub MCP toolsets
• ✅ Provides full access to workflow and artifact APIs through the actions toolset
• ✅ Enables the agent to successfully query GitHub Actions workflows and artifacts data
• ✅ Aligns with best practices used in other workflows (dev-hawk, smoke-detector)

Validation

✅ Workflow compiled successfully using the compile tool from gh-aw MCP server
✅ MCP inspection confirms all 46 GitHub tools are now accessible
✅ No compilation errors or warnings

Note: .lock.yml file will be generated automatically after merge.

References

• Log analysis: /tmp/gh-aw/aw-mcp/logs/
• Audit report: Run githubnext/gh-aw#18810355435
• Missing tool report: "GitHub API read access for workflows and artifacts"
• Similar workflows: dev-hawk.md, smoke-detector.md (both use toolset: [actions, ...])

Related Issue

Fixes githubnext/gh-aw#2490 - User requested update to GitHub toolsets for artifacts workflow after observing missing tool errors in run githubnext/gh-aw#18810355435

AI generated by Q

---

[!NOTE]
This was originally intended as a pull request, but the git push operation failed.

Workflow Run: View run details and download patch artifact

The patch file is available as an artifact (aw.patch) in the workflow run linked above.
To apply the patch locally:

# Download the artifact from the workflow run https://github.com/githubnext/gh-aw/actions/runs/18812378040
# (Use GitHub MCP tools if gh CLI is not available)
gh run download 18812378040 -n aw.patch
# Apply the patch
git am aw.patch

Show patch (49 lines)

From b2a02b68cd6369ae8401480a5c2ac83c138b7252 Mon Sep 17 00:00:00 2001
From: Q <github-actions[bot]@users.noreply.github.com>
Date: Sun, 26 Oct 2025 03:35:42 +0000
Subject: [PATCH] Fix artifacts-summary workflow: use GitHub toolsets instead
 of non-existent allowed tools

The workflow was trying to use individual allowed tools that don't exist
in the GitHub MCP server:
- list_workflows (non-existent)
- list_workflow_runs (non-existent)
- list_workflow_run_artifacts (non-existent)

This caused the agent to report missing tools and fail to access workflow
and artifact data.

Solution: Use toolsets instead of allowed list
- Changed to: toolset: [actions, repos]
- This provides access to all workflow and artifact management tools
- Matches the pattern used in dev-hawk and smoke-detector workflows

Based on live data analysis from run githubnext/gh-aw#18810355435 which reported:
'Need to query GitHub API to list workflows, workflow runs, and artifacts
data for generating the artifacts usage report'

Fixes githubnext/gh-aw#2490
---
 .github/workflows/artifacts-summary.md | 5 +----
 1 file changed, 1 insertion(+), 4 deletions(-)

diff --git a/.github/workflows/artifacts-summary.md b/.github/workflows/artifacts-summary.md
index 2e7f3bf..97ba31d 100644
--- a/.github/workflows/artifacts-summary.md
+++ b/.github/workflows/artifacts-summar...

</details>

- Fixes githubnext/gh-aw#2492

<!-- START COPILOT CODING AGENT TIPS -->
---

💬 We'd love your input! Share your thoughts on Copilot coding agent in our [2 minute survey](https://gh.io/copilot-coding-agent-survey).

[Copilot]

Pull Request Overview

This PR fixes a configuration error in the artifacts-summary workflow that was causing it to fail. The workflow was attempting to use non-existent GitHub MCP tools (list_workflows, list_workflow_runs, list_workflow_run_artifacts) in its allowed list. The fix replaces this with the correct toolset configuration that provides access to the necessary GitHub Actions APIs.

Key Changes:

• Replaced invalid allowed tool list with toolset: [actions, repos] configuration
• Updated the compiled .lock.yml file to reflect the new toolset configuration

Reviewed Changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated no comments.

File	Description
.github/workflows/artifacts-summary.md	Updated GitHub tools configuration from invalid allowed list to valid toolset array
.github/workflows/artifacts-summary.lock.yml	Regenerated lock file with correct GitHub MCP toolset configuration and CLI arguments

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

[github-actions]

Agentic Changeset Generator triggered by this pull request.

[github-actions]

Smoke Test Results

Last 2 merged PRs:

• Fix empty awmg_version in aw_info.json for workflows with MCP servers #15787: Fix empty awmg_version in aw_info.json for workflows with MCP servers
• Move if-body setting to submit-pull-request-review #15793: Move if-body setting to submit-pull-request-review

Test Results:

• ✅ GitHub MCP, Safe Inputs GH CLI, File Writing, Bash, Discussion, Build, PR Review
• ❌ Serena MCP, Playwright (tools unavailable)

Status: PARTIAL PASS

@pelikhan

AI generated by Smoke Copilot