Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[bug] generator_container_slsa3.yml and generator_generic_slsa3.yml should not use continue-on-error #3588

Open
jaqx0r opened this issue Apr 25, 2024 · 2 comments
Labels
area:container Issue with the generic container generator area:generic Issue with the generic generator type:bug Something isn't working

Comments

@jaqx0r
Copy link

jaqx0r commented Apr 25, 2024

Describe the bug

Debugging workflow errors is made more difficult by hiding the location where failures occur.

https://github.com/google/mtail/actions/runs/8816120887/job/24199661807 for example actually fails in the previous job https://github.com/google/mtail/actions/runs/8816120887/job/24199649953 but this is hidden from view. It takes time to read and understand the workflow to figure out where the failure is occurring.

I assume there's a good reason for laundering the exit code into the "final" job but it's not evident why that is.

To Reproduce

In this case I'm passing incorrect value to the DIGEST parameter of the generator_container_slsa3.yml workflow.

Understanding why I was not passing a correct DIGEST is out of scope of this bug, but it was effectively because my goreleaser config emits multple architecture images, the example from goreleaser that I copied did not cope with that, and so the workflow was being passed a digest that was not actually a digest.

Learning all this was made more difficult because the worfklow was not failing at the point of failure.

Expected behavior
I would like the workflow to fail where the error occurs, so it is easier to understand why the workflow is failing when it does.

@jaqx0r jaqx0r added status:triage Issue that has not been triaged type:bug Something isn't working labels Apr 25, 2024
@ianlewis
Copy link
Member

We have to use continue-on-error to support our own continue-on-error logic (see the workflow inputs. We can perhaps update the error messaging to make it clearer where to look for the errors when they occur.

@ianlewis
Copy link
Member

We could also try to fail earlier but it would require us to put in and maintain continue-on-error checks for every job step. That would probably make it easier to grok errors but I'm not sure it's the right thing to do from a maintainability perspective because we're already light on resources at the moment.

@ianlewis ianlewis added area:generic Issue with the generic generator area:container Issue with the generic container generator and removed status:triage Issue that has not been triaged labels May 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:container Issue with the generic container generator area:generic Issue with the generic generator type:bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants