Skip to content

Conversation

Copy link
Contributor

Copilot AI commented Oct 18, 2025

Problem

The CLI version checker workflow could fetch and analyze version updates from changelogs, but it couldn't directly discover what CLI interface changes occurred between versions. This limited its ability to identify new commands, flags, or deprecated features that might not be clearly documented in changelogs.

Solution

Updated the .github/workflows/cli-version-checker.md workflow to enable tool installation and CLI help discovery:

1. Added Bash Tool Permissions

The workflow now has permission to:

  • Install CLI packages globally via npm install *
  • Invoke help commands: claude-code --help, copilot --help, codex --help

2. Added Tool Installation & Discovery Process

New instructions guide the agent to:

  1. Install the new version globally using npm for each tool:

    npm install -g @anthropic-ai/claude-code@<version>
    npm install -g @github/copilot@<version>
    npm install -g @openai/codex@<version>
  2. Invoke help to discover commands and flags:

    claude-code --help
    copilot --help
    codex --help
  3. Compare help output between versions to identify:

    • New commands or subcommands
    • New command-line flags or options
    • Deprecated or removed features
    • Changed default behaviors

3. Updated PR Template

Added "CLI Discovery" field to document findings from help output comparison, ensuring discovered changes are included in version update PRs.

Benefits

  • Direct CLI testing: The workflow can now install and test actual CLI tools, not just read documentation
  • Accurate change detection: Discovers interface changes that may be missing from changelogs
  • Breaking change identification: Detects deprecated or removed commands/flags that impact gh-aw
  • Better impact assessment: Provides concrete evidence of what changed in the CLI interface

Verification

  • ✅ Workflow compiles successfully (192.4 KB)
  • ✅ All unit tests pass
  • ✅ Bash tools properly configured in compiled workflow
  • ✅ No errors or warnings during compilation

The workflow will now provide more comprehensive version update analysis by combining changelog research with direct CLI interface discovery.

Original prompt

Update cli version checker agentic workflow to allow to install the update tools and invoke the command line help to discover new commands and new flags.


✨ Let Copilot coding agent set things up for you — coding agent works faster and does higher quality work when set up for your repo.

Copilot AI self-assigned this Oct 18, 2025
Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Copilot AI changed the title [WIP] Update CLI version checker workflow to include installation tools Update CLI version checker workflow to install tools and discover new commands via --help Oct 18, 2025
Copilot AI requested a review from pelikhan October 18, 2025 04:03
- "git *"
- "make *"
- "npm install *"
- "npx *"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@copilot do not allow npx

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Removed npx from bash tools. The workflow now only uses direct command invocation via globally installed packages. Changes in commit 825da4e.

Co-authored-by: pelikhan <4175913+pelikhan@users.noreply.github.com>
Copilot AI requested a review from pelikhan October 18, 2025 04:12
@pelikhan pelikhan marked this pull request as ready for review October 18, 2025 04:12
@pelikhan pelikhan merged commit 0b47de9 into main Oct 18, 2025
5 checks passed
@pelikhan pelikhan deleted the copilot/update-cli-version-checker branch October 18, 2025 04:13
@github-actions
Copy link
Contributor

Agentic Changeset Generator triggered by this pull request.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants