Skip to content

Fix Serena MCP testing prompt in smoke tests #401

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
lpcox merged 2 commits into from
Jan 21, 2026
Merged

Fix Serena MCP testing prompt in smoke tests #401

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
a9ceddc
Initial plan
Copilot Jan 21, 2026
f5271a0
Update Serena MCP testing prompts in smoke tests
Copilot Jan 21, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/smoke-codex.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -58,7 +58,7 @@ timeout-minutes: 10
## Test Requirements

1. **GitHub MCP Testing**: Review the last 2 merged pull requests in ${{ github.repository }}
2. **Serena Go Testing**: Use the serena-go tool to run a basic go command like "go version" to verify the tool is available
2. **Serena MCP Testing**: Use the Serena MCP server tool `activate_project` to initialize the workspace and verify it succeeds (do NOT use bash to run go commands - use Serena's MCP tools)
3. **Playwright Testing**: Use playwright to navigate to https://github.com and verify the page title contains "GitHub"
4. **Tavily Web Search Testing**: Use the Tavily MCP server to perform a web search for "GitHub Agentic Workflows" and verify that results are returned with at least one item
5. **File Writing Testing**: Create a test file `/tmp/gh-aw/agent/smoke-test-codex-${{ github.run_id }}.txt` with content "Smoke test passed for Codex at $(date)" (create the directory if it doesn't exist)
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/smoke-copilot.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -60,7 +60,7 @@ strict: true
## Test Requirements

1. **GitHub MCP Testing**: Review the last 2 merged pull requests in ${{ github.repository }}
2. **Serena Go Testing**: Use the serena-go tool to run a basic go command like "go version" to verify the tool is available
2. **Serena MCP Testing**: Use the Serena MCP server tool `activate_project` to initialize the workspace and verify it succeeds (do NOT use bash to run go commands - use Serena's MCP tools)
3. **Playwright Testing**: Use playwright to navigate to <https://github.com> and verify the page title contains "GitHub"
4. **File Writing Testing**: Create a test file `/tmp/gh-aw/agent/smoke-test-copilot-${{ github.run_id }}.txt` with content "Smoke test passed for Copilot at $(date)" (create the directory if it doesn't exist)
5. **Bash Tool Testing**: Execute bash commands to verify file creation was successful (use `cat` to read the file back)
Expand Down