Add Pre-commit check for airflowctl tests

[steveahnahn]

Followup

New CLI commands can be added to airflowctl/api/operations.py without corresponding integration test coverage that can lead to a drift in untested commands.

Solution

Add a pre-commit hook that statically analyzes all test-able CLI commands to be included in test coverage. The hook fails if any command is missing coverage and not explicitly listed in the excluded commands list
Stats:

• 55 total CLI commands
• 38 tested in integration tests
• 29 excluded with documented reasons (assets require state, backfill requires IDs, destructive operations, etc.)

Related Issues

• Closes: Add a pre-commit hook to check that airflowctl commands exist in integration tests #58105
• Parent: Add All Commands to airflowctl integration tests #58103
• Related: Add all commands to airflowctl integration tests #58106

[bugraoz93]

Looks good! Thanks, Steve! One comment related to assets, what is the blocker for those?

[steveahnahn]

Thanks, just added the fix and went through the logs of the commands again, assets materialize fails with id=1 I believe due to collision with asset id 1. I've ended up adding and removing more commands that were either silently failing or passed when tested. An improvement to the integration tests will give us better accuracy in the future imo.

[potiuk]

Still some issues :)

[github-actions]

Backport failed to create: v3-1-test. View the failure log Run details

Status	Branch	Result
❌	v3-1-test

You can attempt to backport this manually by running:

cherry_picker 80ca9f5 v3-1-test

This should apply the commit to the v3-1-test branch and leave the commit in conflict state marking
the files that need manual conflict resolution.

After you have resolved the conflicts, you can continue the backport process by running:

cherry_picker --continue

[bugraoz93]

Amazing, thanks Steve!