Skip to content

🧹 Reenable unit testing in CI & various test fixes #12365

Merged
dsyme merged 29 commits intomainfrom
tu3
Jan 29, 2026
Merged

🧹 Reenable unit testing in CI & various test fixes #12365
dsyme merged 29 commits intomainfrom
tu3

Conversation

@dsyme
Copy link
Contributor

@dsyme dsyme commented Jan 28, 2026

Summary

  • Cleaned up and removed extensive commented-out sections in the security-alert-burndown workflow configuration
  • Removed large blocks of explanatory text and workflow documentation from the lock file

Changes

  • Simplified the .github/workflows/security-alert-burndown.lock.yml file
  • Removed verbose comments and workflow execution details
  • Reduced file size and complexity of the workflow configuration

dsyme added 6 commits January 28, 2026 22:44
- Update docker/login-action@v3 SHA to match current v3 tag
- Update anchore/sbom-action@v0 SHA to match current v0 tag
- Delete outdated TestGenerateMaintenanceWorkflow_ActionModeJobs (expects separate close-expired-* jobs, now merged into close-expired-entities)
- Delete mcp_auto_container_integration_test.go (expects old docker command format, replaced by MCP gateway architecture)
- Delete TestMCPServersCompilation (expects old command/docker format, now uses container field with MCP gateway)
- Update TestRenderSharedMCPConfig_CopilotFields to expect new container/entrypoint format instead of command/docker
- Delete all Playwright MCP tests that expect old docker command format:
  - TestRenderPlaywrightMCP_JSON_Copilot
  - TestRenderPlaywrightMCP_JSON_Claude
  - TestRenderPlaywrightMCP_TOML
  - TestRenderPlaywrightMCPConfigShared
  - TestRenderPlaywrightMCPConfigWithOptions
  - TestRenderPlaywrightMCPConfigTOML

These tests are outdated after MCP gateway architecture replaced the old docker command approach with container/entrypoint/entrypointArgs fields.
- Update TestRenderSafeOutputsMCP_JSON_Copilot to expect HTTP transport instead of stdio/container
- Update TestRenderSafeOutputsMCP_JSON_Claude to expect HTTP transport
- Update TestRenderSafeOutputsMCP_TOML to expect HTTP transport
- Update TestRenderGitHubMCP_JSON_Copilot_Local to expect container field instead of docker command
- Update TestRenderGitHubMCP_JSON_Claude_Local to expect container field without type

Safe Outputs MCP server changed from stdio/container-based to HTTP transport architecture.
- Update TestGitHubMCPConfiguration to expect 'container' field instead of 'command: docker'
- Update TestGenerateGitHubMCPConfig to expect 'container' field with GitHub MCP image
- Update TestParseReactionValue to accept float64 values (1.0 -> +1, -1.0 -> -1)
  - Implementation now accepts float64(1.0) and float64(-1.0) since YAML may parse unquoted +1/-1 as floats
  - Added test cases for valid float conversions and invalid float values

These changes reflect the MCP gateway architecture using container field instead of docker command.
@dsyme dsyme changed the title 🧹 Test fixes in workflow configuration 🧹 Reenable unit testing in CI & various test fixes Jan 28, 2026
dsyme added 10 commits January 28, 2026 23:02
…entation

- Fix TestPatchArtifactDownloadWithPushToPullRequestBranch to use valid target 'triggering' instead of invalid 'head'
- Fix TestGenerateSafeOutputsPromptStep_IncludesWhenEnabled to expect 'safeoutputs MCP server' instead of 'create_issue' (prompt format changed)
- Fix TestInvalidBranchPrefixRejectsConfig by removing 'too short' test case ('short' is 5 chars, minimum is 4)
…tion

- Delete TestCompileWorkflowWithGoRuntimeWithGoModFile - outdated since Serena containerized mode doesn't generate runtime setup steps (only local mode does)
- Delete TestUVDetectionAddsPython - outdated since only Serena local mode detects UV runtime
- Update TestValidateSafeOutputsAllowedDomains to expect new clearer error message: 'wildcard must be at the start followed by a dot'
- Update TestValidateDomainPattern error message to expect 'wildcard must be at the start followed by a dot' instead of 'invalid position'
- Add missing tools to TestGetSafeOutputsToolsJSON: remove_labels and autofix_code_scanning_alert
- Update TestSandboxAgentMandatory to look for 'sudo -E awf' instead of 'gh-aw-firewall'
- Update TestSandboxAgentEnablesDefaultTools to look for 'sudo -E awf' instead of 'gh-aw-firewall'
- Firewall implementation changed to use awf command directly rather than gh-aw-firewall step name
- Fix TestCustomAWFConfiguration to check for install_awf_binary.sh script instead of curl command (paths moved from /tmp/gh-aw to /opt/gh-aw)
- Fix TestSandboxRuntimeFeatureFlagRequired to match new error message wording ('feature flag to be enabled' instead of "'sandbox-runtime' feature flag")
- Fix mount validation tests to match new ValidationError format messages
- Add MCP servers to TestValidateSandboxConfig test case (now required for sandbox agent)
- Clear fails file (all tests now passing or deleted)
- Reduce TestTeamMemberCheckForCommandWorkflows from 5 to 2 cases (saves ~40s)
- Reduce TestToolsTimeoutValidation from 11 to 3 cases (saves ~20s)
- Reduce TestTriggerShorthandIntegration from 17 to 4 cases (saves ~15s)
- Reduce TestTrackerIDIntegration from 5 to 2 cases (saves ~12s)
- Reduce TestWorkflowDispatchInputTypes from 27 to 3 cases (saves ~10s)
- Mark remaining long-running compilation tests to skip in short mode
  (TestTrialModeCompilation, TestThreatDetectionIsolation, etc.)

These changes reduce total test time while maintaining essential coverage
of core functionality. Removed redundant test cases that verify the same
validation logic with minor variations.
@github-actions
Copy link
Contributor

Overall: PASS
ci-coach: Add test integrity safeguards and canary job integration
Update CLI versions: Claude Code 2.1.22, Copilot CLI 0.0.397
Expand Java ecosystem allowlist for firewall-enabled workflows
Allow Deno firewall access to JSR registry
Tests: GitHub MCP ✅; SafeInputs GH ✅; Serena ✅; Playwright ✅; Tavily ✅; File write ✅; Bash cat ✅; Discussion comment ✅; Build ✅

AI generated by Smoke Codex

@dsyme dsyme merged commit 433a8ea into main Jan 29, 2026
53 checks passed
@dsyme dsyme deleted the tu3 branch January 29, 2026 01:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant