Skip to content

Conversation

@NoNickeD
Copy link

Fixes #1095

This PR adds a --group flag to the conftest test command that allows overriding the group name for stdin input.

Problem: When using conftest with kustomize in loops, output shows generic 'FAIL - - main - message' making it hard to identify which component failed.

Solution: Add --group flag to specify custom group name for better traceability.

Usage:

kustomize build my/component | conftest test - -p policy --group my/component

Output:

  • Before: FAIL - - main - message
  • After: FAIL - my/component - main - message

Changes:

  • Add --group CLI flag to test command
  • Override FileName from '-' to custom group name when --group provided
  • Add unit tests for functionality

Enables better CI/CD traceability and GitHub annotations.

- Add --group CLI flag to test command for custom group naming
- Override FileName from '-' to custom group name when --group is provided
- Enables better identification of policy violations in CI/CD workflows
- Add unit tests for group flag functionality

Fixes open-policy-agent#1095

Signed-off-by: nikos.nikolakakis <nonickedgr@gmail.com>
Copy link
Member

@jalseth jalseth left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi, thanks for taking on this FR.

Thinking about this more, I think calling the flag "group" is a little too vague. What do you think about "file-name-override" instead?

cc @taraspos

  - Renamed flag from 'group' to 'file-name-override' for clarity
  - Rewrote tests to use TestRunner.Run() method with proper test fixtures
  - Added comprehensive acceptance tests for the new flag
  - Fixed Rego v1 syntax in test policies
  - Added proper error handling and edge case testing

  Addresses review feedback from PR open-policy-agent#1163

Signed-off-by: nikos.nikolakakis <nonickedgr@gmail.com>
Copy link
Member

@jalseth jalseth left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Just a couple of minor changes. Thanks for the PR and sorry for the slow review cycle.

defer func() { os.Stdin = oldStdin }()

// Run the test
ctx := context.Background()
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Prefer t.Context() in tests.

}
}`
go func() {
defer w.Close()
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: This defer isn't needed, you can w.Close() after the line below.

Failures: []output.Result{{Message: "test failure"}},
},
// Run with a regular file (not stdin)
ctx := context.Background()
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Prefer t.Context() in tests.

@jalseth
Copy link
Member

jalseth commented Nov 22, 2025

@NoNickeD friendly ping.

- Use t.Context() instead of context.Background()
- Remove unnecessary defer in goroutine, call w.Close() directly

Signed-off-by: nikos.nikolakakis <nonickedgr@gmail.com>
@jalseth
Copy link
Member

jalseth commented Nov 27, 2025

@NoNickeD It looks like the tests are failing. You may need to rebase against the latest changes.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Allow specifying custom group name when validating files from stdin

2 participants