Skip to content

Conversation

kendallgassner
Copy link
Contributor

Changed

Updated two MCP tool descriptions to see if Copilot usage improves. Metrics indicate that the Primer MCP tools are not often used. Copilot seems to be struggling with understanding the tools purpose:

I cannot directly access https://primer.style/ or fetch live documentation from the internet. I rely on my training data and the code/documentation available in the repository. The Primer MCP tools would have been valuable for accessing up-to-date Primer documentation, especially for experimental components like Dialog. For future work, I should use those tools to ensure I'm following current best practices and using the latest API patterns.

Rollout strategy

  • Patch release
  • Minor release
  • Major release; if selected, include a written rollout or migration plan
  • None; if selected, include a brief description as to why

Testing & Reviewing

Merge checklist

Copy link

changeset-bot bot commented Oct 8, 2025

🦋 Changeset detected

Latest commit: cf6afc5

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 1 package
Name Type
@primer/mcp Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@kendallgassner kendallgassner marked this pull request as ready for review October 8, 2025 23:03
@kendallgassner kendallgassner requested a review from a team as a code owner October 8, 2025 23:03
Copy link
Contributor

@Copilot Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

Updates MCP tool descriptions to improve Copilot's understanding and usage of Primer React component documentation tools. The changes aim to address low usage metrics by making the tool purposes clearer and more discoverable.

  • Expanded descriptions for get_component and get_component_accessibility_guidelines tools with detailed explanations
  • Fixed error message references to use correct tool name list_components

kendallgassner and others added 2 commits October 8, 2025 23:04
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
@github-actions github-actions bot requested a deployment to storybook-preview-6969 October 8, 2025 23:06 Abandoned
@github-actions github-actions bot temporarily deployed to storybook-preview-6969 October 8, 2025 23:15 Inactive
@kendallgassner
Copy link
Contributor Author

VRT failure seems unrelated.

Copy link
Member

@siddharthkp siddharthkp left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't understand this enough but I trust you with it

@siddharthkp
Copy link
Member

VRT failure seems unrelated.

yeah, looks like a flaky test (0.01% change). Retrying the job

@kendallgassner kendallgassner added this pull request to the merge queue Oct 9, 2025
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Oct 9, 2025
@kendallgassner kendallgassner added this pull request to the merge queue Oct 9, 2025
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Oct 9, 2025
@kendallgassner kendallgassner added this pull request to the merge queue Oct 9, 2025
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to failed status checks Oct 9, 2025
@kendallgassner kendallgassner added this pull request to the merge queue Oct 9, 2025
@kendallgassner
Copy link
Contributor Author

The VRT tests are so flaky I keep getting bumped from the merge queue 😢 .

Merged via the queue into main with commit 553c1a0 Oct 9, 2025
42 of 44 checks passed
@kendallgassner kendallgassner deleted the kendallg/improve-mcp-usage branch October 9, 2025 19:22
@primer primer bot mentioned this pull request Oct 9, 2025
@JoseInTheArena
Copy link

@kendallgassner did usage improve?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants