Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

GHA: Publish test reports #9035

Closed
Tracked by #9127
lenaschoenburg opened this issue Mar 31, 2022 · 2 comments · Fixed by #9441
Closed
Tracked by #9127

GHA: Publish test reports #9035

lenaschoenburg opened this issue Mar 31, 2022 · 2 comments · Fixed by #9441
Assignees
@korthout
Labels
area/build Marks an issue as related to our build pipeline (e.g. Maven settings, CI, etc.) kind/toil Categorizes an issue or PR as general maintenance, i.e. cleanup, refactoring, etc. version:8.1.0-alpha2 version:8.1.0 Marks an issue as being completely or in parts released in 8.1.0

Comments

@lenaschoenburg
Copy link
Member

Description

It'd be nice to collect and publish the test results of running integration and unit tests from our GHA workflow so that developers can see exactly which tests are failing.

There are multiple actions that implement this:

  1. https://github.com/marketplace/actions/publish-unit-test-results
  2. https://github.com/marketplace/actions/surefire-report
  3. https://github.com/marketplace/actions/junit-report-action

I've tried all three of them already. The first one is probably our best bet since it is the most feature complete. Two and three run into OOM for some of our tests.

follow-up of #8968
@lenaschoenburg lenaschoenburg added the kind/toil Categorizes an issue or PR as general maintenance, i.e. cleanup, refactoring, etc. label Mar 31, 2022
@lenaschoenburg lenaschoenburg mentioned this issue Apr 13, 2022
Closed
19 tasks
@lenaschoenburg lenaschoenburg changed the title Publish test reports from GHA workflows GHA: Publish test reports Apr 13, 2022
@lenaschoenburg lenaschoenburg mentioned this issue Apr 13, 2022
Closed
@npepinpe npepinpe added the area/build Marks an issue as related to our build pipeline (e.g. Maven settings, CI, etc.) label Apr 20, 2022
@korthout korthout self-assigned this May 4, 2022
@lenaschoenburg
Copy link
Member Author

There's also this new feature to generate markdown job summaries: https://github.blog/changelog/2022-05-09-github-actions-enhance-your-actions-with-job-summaries/

@korthout
Copy link
Member

@oleschoenburg that would be great to have. I propose to not spend time to build that ourselves, but instead let the GHA implement that part. Seems our test reporter of choice is also already aware of the new functionality. EnricoMi/publish-unit-test-result-action#264

@korthout korthout mentioned this issue May 24, 2022
Merged
10 tasks
ghost pushed a commit that referenced this issue May 25, 2022
@korthout
merge: #9441
dd4faeb 
9441: Publish GHA test results as report r=korthout a=korthout

## Description

<!-- Please explain the changes you made here. -->
Publish GHA test results as report using https://github.com/EnricoMi/publish-unit-test-result-action.

This workflow is copied from [Zeebe Process Test](https://github.com/camunda/zeebe-process-test) where [this workflow](https://github.com/camunda/zeebe-process-test/blob/main/.github/workflows/publish-test-results.yml) has already been in use for some time. Some minor changes have been made to fit it to the zeebe repository.

## Related issues

<!-- Which issues are closed by this PR or are related -->

closes #9035



Co-authored-by: Nico Korthout <nico.korthout@camunda.com>
ghost pushed a commit that referenced this issue May 25, 2022
@korthout
merge: #9441
73a6d14 
9441: Publish GHA test results as report r=korthout a=korthout

## Description

<!-- Please explain the changes you made here. -->
Publish GHA test results as report using https://github.com/EnricoMi/publish-unit-test-result-action.

This workflow is copied from [Zeebe Process Test](https://github.com/camunda/zeebe-process-test) where [this workflow](https://github.com/camunda/zeebe-process-test/blob/main/.github/workflows/publish-test-results.yml) has already been in use for some time. Some minor changes have been made to fit it to the zeebe repository.

## Related issues

<!-- Which issues are closed by this PR or are related -->

closes #9035



Co-authored-by: Nico Korthout <nico.korthout@camunda.com>
@ghost ghost closed this as completed in 5cff4f7 May 25, 2022
@ChrisKujawa ChrisKujawa added the version:8.1.0 Marks an issue as being completely or in parts released in 8.1.0 label Oct 4, 2022
This issue was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@korthout korthout

Labels
area/build Marks an issue as related to our build pipeline (e.g. Maven settings, CI, etc.) kind/toil Categorizes an issue or PR as general maintenance, i.e. cleanup, refactoring, etc. version:8.1.0-alpha2 version:8.1.0 Marks an issue as being completely or in parts released in 8.1.0
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Publish GHA test results as report camunda/camunda
5 participants
@npepinpe @lenaschoenburg @ChrisKujawa @korthout @remcowesterhoud