Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
58 changes: 33 additions & 25 deletions .github/workflows/nightly-mcp-stress-test.lock.yml

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

35 changes: 19 additions & 16 deletions .github/workflows/nightly-mcp-stress-test.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
---
name: Nightly MCP Server Stress Test
description: Comprehensive stress test that loads 20 well-known MCP servers, tests their tools, and reports results with automated issue creation for failures
description: Load 20 MCP servers, discover and summarize the tools exported by each server, test tool invocations, and post a comprehensive report as a GitHub issue
Copy link

Copilot AI Feb 4, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The description states "Load 20 MCP servers" but the configuration actually includes 21 servers (github, sqlite, brave-search, fetch, filesystem, memory, slack, puppeteer, gdrive, google-maps, everart, sequential-thinking, sentry, git, time, playwright, gitlab, notion, youtube-transcript, atlassian, kubernetes). The description should be updated to reflect the actual count of 21 servers.

Copilot uses AI. Check for mistakes.
on:
schedule: daily
workflow_dispatch:
Expand Down Expand Up @@ -41,9 +41,6 @@ mcp-servers:
sqlite:
type: stdio
container: "mcp/sqlite"
postgres:
type: stdio
container: "mcp/postgres"
brave-search:
type: stdio
container: "mcp/brave-search"
Expand All @@ -67,28 +64,34 @@ mcp-servers:
container: "mcp/everart"
sequential-thinking:
type: stdio
container: "mcp/sequential-thinking"
aws-kb-retrieval:
type: stdio
container: "mcp/aws-kb-retrieval"
linear:
type: stdio
container: "mcp/linear"
container: "mcp/sequentialthinking"
sentry:
type: stdio
container: "mcp/sentry"
raygun:
type: stdio
container: "mcp/raygun"
git:
type: stdio
container: "mcp/git"
time:
type: stdio
container: "mcp/time"
axiom:
playwright:
type: stdio
container: "mcp/playwright"
Copy link

Copilot AI Feb 4, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The container reference in the .md file is "mcp/playwright" but in the .lock.yml file it's "mcr.microsoft.com/playwright/mcp" with additional configuration (args, entrypointArgs, mounts). This inconsistency between the source file and the compiled lock file suggests that either the .md file should specify the full Microsoft container reference or the .lock.yml file should use the simpler "mcp/playwright" reference. The discrepancy will cause confusion and may indicate the files are out of sync.

Suggested change
container: "mcp/playwright"
container: "mcr.microsoft.com/playwright/mcp"

Copilot uses AI. Check for mistakes.
gitlab:
type: stdio
container: "mcp/wikipedia-mcp"
Copy link

Copilot AI Feb 4, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The server name "gitlab" is mapped to container "mcp/wikipedia-mcp". This appears to be a mismatch - the server name suggests GitLab functionality but the container is for Wikipedia. Either the server name should be changed to "wikipedia" or the container should be changed to "mcp/gitlab".

Suggested change
container: "mcp/wikipedia-mcp"
container: "mcp/gitlab"

Copilot uses AI. Check for mistakes.
notion:
type: stdio
container: "mcp/duckduckgo"
Copy link

Copilot AI Feb 4, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The server name "notion" is mapped to container "mcp/duckduckgo". This appears to be a mismatch - the server name suggests Notion functionality but the container is for DuckDuckGo. Either the server name should be changed to "duckduckgo" or the container should be changed to "mcp/notion".

Suggested change
container: "mcp/duckduckgo"
container: "mcp/notion"

Copilot uses AI. Check for mistakes.
youtube-transcript:
type: stdio
container: "mcp/youtube-transcript"
atlassian:
type: stdio
container: "mcp/hackernews-mcp"
Copy link

Copilot AI Feb 4, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The server name "atlassian" is mapped to container "mcp/hackernews-mcp". This appears to be a mismatch - the server name suggests Atlassian functionality but the container is for Hacker News. Either the server name should be changed to "hackernews" or the container should be changed to "mcp/atlassian".

Suggested change
container: "mcp/hackernews-mcp"
container: "mcp/atlassian"

Copilot uses AI. Check for mistakes.
kubernetes:
type: stdio
container: "mcp/axiom"
container: "mcp/kubernetes"

sandbox:
mcp:
Expand Down