Skip to content

Comments

Remove sub-issue creation from CLI consistency checker#16368

Merged
pelikhan merged 3 commits intomainfrom
copilot/remove-sub-issues-from-cli-checker
Feb 17, 2026
Merged

Remove sub-issue creation from CLI consistency checker#16368
pelikhan merged 3 commits intomainfrom
copilot/remove-sub-issues-from-cli-checker

Conversation

Copy link
Contributor

Copilot AI commented Feb 17, 2026

The CLI consistency checker workflow was creating a parent issue plus up to 5 sub-issues for findings. Changed to create a single consolidated issue with all findings in one body.

Changes

Safe outputs configuration (.github/workflows/cli-consistency-checker.md):

  • max: 6max: 1
  • Removed group: true (disables parent-child linking)

Workflow prompt:

  • Removed temporary_id and parent field references
  • Updated Step 4 to create comprehensive issue format with:
    • Severity breakdown and categorization
    • Detailed findings sections with exact CLI output
    • All information consolidated in single issue body

Lock file (.github/workflows/cli-consistency-checker.lock.yml):

  • Safe outputs handler config updated to reflect max: 1 and removal of grouping

Issue Format

The workflow now creates issues structured as:

## Summary
Automated CLI consistency inspection found **X inconsistencies**...

### Breakdown by Severity
- **High**: X (Breaks functionality)
- **Medium**: X (Inconsistent terminology)

### Detailed Findings
#### 1. [Issue Title]
**Commands Affected**: `command1`, `command2`
**Priority**: Medium
**Current Output**: [exact CLI quotes]
**Suggested Fix**: [solution]

Single notification per inspection run instead of 6 separate issues.

Warning

Firewall rules blocked me from connecting to one or more addresses (expand for details)

I tried to connect to the following addresses, but was blocked by firewall rules:

  • https://api.github.com/graphql
    • Triggering command: /usr/bin/gh gh run download 22101033815 -n agent-artifacts -D /tmp/downloaded-artifacts (http block)
  • https://api.github.com/user
    • Triggering command: /usr/bin/gh gh api user --jq .login (http block)

If you need me to access, download, or install something from one of these locations, you can either:

Original prompt

This section details on the original issue you should resolve

<issue_title>[q] Remove sub-issue creation from CLI consistency checker</issue_title>
<issue_description># Q Workflow Optimization Report

Context

This optimization was requested in issue #16352 by @pelikhan:

/q change this agentic workflow to not create sub issues

Changes Made

.github/workflows/cli-consistency-checker.md

Modified the CLI consistency checker workflow to create a single consolidated issue instead of a parent issue with sub-issues:

Safe Outputs Configuration

  • Changed max: 6max: 1 (single issue instead of 1 parent + 5 sub-issues)
  • Removed group: true setting (disables parent-child structure)

Workflow Prompt Updates

  • Removed all references to parent-child issue structure
  • Removed temporary_id requirements and parent field usage
  • Updated Step 4 to create a single comprehensive issue with:
    • High-level summary with severity breakdown
    • Categorized findings grouped by pattern
    • Detailed findings for each issue in the same body
    • Exact CLI output quotes for each finding
  • Updated Step 5 summary to reference consolidated issue instead of parent + sub-issues
  • Simplified issue creation workflow - no need to manage temporary IDs or parent references

Expected Improvements

  • Simplified issue management: Single issue per inspection run instead of 6 separate issues
  • Easier triage: All findings in one place for review
  • Reduced noise: No multiple issue notifications for the same inspection
  • Better overview: All findings visible at once with categorization
  • Maintains detail: All information from sub-issues now in detailed findings sections

Validation

✅ Workflow compiled successfully using ./gh-aw compile cli-consistency-checker:

✓ .github/workflows/cli-consistency-checker.md (53.6 KB)
✓ Compiled 1 workflow(s): 0 error(s), 0 warning(s)

Note: Lock file changes will be handled automatically after merge.

Issue Format Example

The workflow now creates issues in this format:

## Summary

Automated CLI consistency inspection found **5 inconsistencies** in command help text.

### Breakdown by Severity
- **Medium**: 5 (Inconsistent terminology)

### Issue Categories
1. **Workflow ID Terminology** (5 commands)
   - Some commands use "workflow ID" instead of standard "workflow-id"
   - Affects: `mcp add`, `mcp inspect`, `mcp list`, `mcp list-tools`, `run`

### Detailed Findings

#### 1. Inconsistent workflow ID terminology in mcp commands

**Commands Affected**: `mcp add`, `mcp inspect`, `mcp list`, `mcp list-tools`
**Priority**: Medium
**Type**: Inconsistent terminology

[...detailed findings with exact CLI output...]

References

AI generated by Q

  • expires on Feb 19, 2026, 1:56 PM UTC

[!NOTE]
This was originally intended as a pull request, but the git push operation failed.

Workflow Run: View run details and download patch artifact

The patch file is available in the agent-artifacts artifact in the workflow run linked above.

To apply the patch locally:

# Download the artifact from the workflow run https://github.com/github/gh-aw/actions/runs/22101033815
# (Use GitHub MCP tools if gh CLI is not available)
gh run download 22101033815 -n agent-artifacts

# The patch file will be at agent-artifacts/tmp/gh-aw/aw.patch after download
# Apply the patch
git am agent-artifacts/tmp/gh-aw/aw.patch
Show patch preview (176 of 176 lines)
From 1b23606ea7a4665cdb9de1f976f23f720ad880bc Mon Sep 17 00:00:00 2001
From: GitHub Copilot <copilot@github.com>
Date: Tue, 17 Feb 2026 13:54:02 +0000
Subject: [PATCH] Remove sub-issue creation from CLI consistency checker

- Change safe-outputs max from 6 to 1 (single consolidated issue)
- Remove group: true setting (disables parent-child structure)
- Update workflow prompt to create one comprehensive issue instead
- All findings now consolidated in a single issue with detailed sections

Fixes github/gh-aw#16352

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
---
 .github/workflows/cli-consistency-checker.md | 118 +++++++++++--------
 1 file changed, 71 insertions(+), 47 deletions(-)

diff --git a/.github/workflows/cli-consistency-checker.md b/.github/workflows/cli-consistency-checker.md
index b0c9936..0a3b704 100644
--- a/.github/workflows/cli-consistency-checker.md
+++ b/.github/workflows/cli-consistency-checker.md
@@ -23,8 +2...

</details>



<!-- START COPILOT CODING AGENT SUFFIX -->

- Fixes github/gh-aw#16367

<!-- START COPILOT CODING AGENT TIPS -->
---

💬 We'd love your input! Share your thoughts on Copilot coding agent in our [2 minute survey](https://gh.io/copilot-coding-agent-survey).

GitHub Copilot and others added 2 commits February 17, 2026 14:01
- Change safe-outputs max from 6 to 1 (single consolidated issue)
- Remove group: true setting (disables parent-child structure)
- Update workflow prompt to create one comprehensive issue instead
- All findings now consolidated in a single issue with detailed sections

Fixes #16352

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Copilot AI changed the title [WIP] Remove sub-issue creation from CLI consistency checker Remove sub-issue creation from CLI consistency checker Feb 17, 2026
Copilot AI requested a review from pelikhan February 17, 2026 14:04
@pelikhan pelikhan marked this pull request as ready for review February 17, 2026 14:08
Copilot AI review requested due to automatic review settings February 17, 2026 14:08
@pelikhan pelikhan merged commit b9c5e8e into main Feb 17, 2026
@pelikhan pelikhan deleted the copilot/remove-sub-issues-from-cli-checker branch February 17, 2026 14:08
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Updates the CLI consistency checker workflow to stop creating a parent issue plus sub-issues, and instead emit a single consolidated tracking issue containing all findings in one body.

Changes:

  • Reduced safe-outputs.create-issue.max from 6 to 1 and removed group: true to disable parent/child issue creation.
  • Updated the workflow prompt to describe a single consolidated issue format (summary, severity breakdown, categories, detailed findings).
  • Regenerated the compiled lock workflow to reflect the updated safe-outputs configuration.

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 1 comment.

File Description
.github/workflows/cli-consistency-checker.md Changes workflow instructions and safe-outputs config to create one consolidated issue instead of multiple issues.
.github/workflows/cli-consistency-checker.lock.yml Updates generated safe-outputs config/metadata to match the new max: 1 and no grouping.
Comments suppressed due to low confidence (1)

.github/workflows/cli-consistency-checker.md:174

  • In the severity breakdown, Medium is described specifically as “Inconsistent terminology”, but earlier in the workflow you ask the agent to look for many other issue types (typos, technical inaccuracies, missing examples, etc.). Consider broadening these severity descriptions so they don’t imply only terminology issues qualify as medium severity.
- **High**: X (Breaks functionality)
- **Medium**: X (Inconsistent terminology)
- **Low**: X (Minor inconsistencies)

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

#### 1. [Issue Title]

**Commands Affected**: `command1`, `command2`
**Priority**: Medium
Copy link

Copilot AI Feb 17, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The prompt defines priority values as lowercase (high/medium/low) earlier, but this example uses title case (**Priority**: Medium). This inconsistency can lead to mixed formatting in generated issues; please standardize the casing and use it consistently throughout the prompt.

This issue also appears on line 172 of the same file.

Suggested change
**Priority**: Medium
**Priority**: medium

Copilot uses AI. Check for mistakes.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[cli-consistency] CLI Consistency Issues - February 17, 2026

2 participants