build: migrate build to GitHub Actions #1124

emanuelaepure10 · 2024-03-04T21:38:00Z

Add pull request file, master and release branches files to be used by the GitHub actions to check the PRs.

ING-4164

emanuelaepure10 · 2024-03-06T09:32:26Z

Could you @stempler please help me understand why it's failing the test https://github.com/halestudio/hale/actions/runs/8162870481/job/22314828710
Thank you

stempler · 2024-03-06T10:07:08Z

Could you @stempler please help me understand why it's failing the test https://github.com/halestudio/hale/actions/runs/8162870481/job/22314828710
Thank you

Looking at the logs the error seems to be

2024-03-05T21:02:34.6707526Z Failed to execute goal org.eclipse.tycho:tycho-compiler-plugin:3.0.1:validate-classpath (default-validate-classpath) on project eu.esdihumboldt.hale.common.test: Execution default-validate-classpath of goal org.eclipse.tycho:tycho-compiler-plugin:3.0.1:validate-classpath failed: bundleLocation not found: /home/runner/.m2/repository/p2/osgi/bundle/org.eclipse.core.expressions/3.6.700.v20200212-1751/org.eclipse.core.expressions-3.6.700.v20200212-1751.jar -> [Help 1]
2024-03-05T21:02:34.6716254Z org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.eclipse.tycho:tycho-compiler-plugin:3.0.1:validate-classpath (default-validate-classpath) on project eu.esdihumboldt.hale.common.test: Execution default-validate-classpath of goal org.eclipse.tycho:tycho-compiler-plugin:3.0.1:validate-classpath failed: bundleLocation not found: /home/runner/.m2/repository/p2/osgi/bundle/org.eclipse.core.expressions/3.6.700.v20200212-1751/org.eclipse.core.expressions-3.6.700.v20200212-1751.jar

The respective bundle is mentioned before in the log:

2024-03-05T20:59:05.4679397Z > Task :buildProduct
2024-03-05T20:59:05.4681168Z Request to http://build-artifacts.wetransform.to/p2/mirror/2020-03-releases/plugins/org.eclipse.core.expressions_3.6.700.v20200212-1751.jar failed, trying cache instead...
2024-03-05T20:59:05.7678427Z Some attempts to read artifact osgi.bundle,org.eclipse.core.expressions,3.6.700.v20200212-1751 failed:
2024-03-05T20:59:05.7681886Z    An error occurred while transferring artifact canonical: osgi.bundle,org.eclipse.core.expressions,3.6.700.v20200212-1751 from repository http://build-artifacts.wetransform.to/p2/mirror/2020-03-releases:
2024-03-05T20:59:05.7684202Z       download from http://build-artifacts.wetransform.to/p2/mirror/2020-03-releases/plugins/org.eclipse.core.expressions_3.6.700.v20200212-1751.jar failed
2024-03-05T20:59:05.7687904Z Artifact eclipse-plugin:org.eclipse.core.expressions:3.6.700.v20200212-1751: /home/runner/.m2/repository/p2/osgi/bundle/org.eclipse.core.expressions/3.6.700.v20200212-1751/org.eclipse.core.expressions-3.6.700.v20200212-1751.jar located at /home/runner/.m2/repository/p2/osgi/bundle/org.eclipse.core.expressions/3.6.700.v20200212-1751/org.eclipse.core.expressions-3.6.700.v20200212-1751.jar seems corrupted! Will attempt to redownload it ...

It looks like it failed to download or it for some reason deemed as corrupted and possibly deleted. The redownload that is mentioned does not seem to have been successful.

Does this happen every time this is run? Or just from time to time?
It could be an issue with the access to the update site or an actual problem with that specific bundle in the update site.

emanuelaepure10 · 2024-03-06T11:14:57Z

The push to the master branch has failed in the last 3 builds
https://github.com/halestudio/hale/actions/workflows/publish.yml

What I have noticed that in the last build also 11 tests are failing, which didn't happened previously.
https://github.com/halestudio/hale/actions/runs/8162870481/job/22315439207

stempler · 2024-03-06T12:57:05Z

The push to the master branch has failed in the last 3 builds

And what are the results of your analysis?
Is it always the same error?
Did the same error already occur before for the PR build as well?
Does it have any impact if you change from integrationStage to commitStage?

What I have noticed that in the last build also 11 tests are failing, which didn't happened previously.

That's the integration tests using Docker. hale studio uses its own mechanism to run Docker images required for tests.
There would need to be a configuration file created that configures the Docker Host. Likely in the GitHub Actions environment the configuration value for that needs to be set to unix:///var/run/docker.sock.

See also

hale/common/plugins/eu.esdihumboldt.hale.common.test.docker/src/eu/esdihumboldt/hale/common/test/docker/config/DockerConfig.java

Line 51 in 2493822

* <li>HOMEDIR/.hale/hale-docker.conf</li>

stempler · 2024-03-08T16:30:38Z

hale-docker.conf

@@ -0,0 +1,3 @@
+global {


The file should be created in the GitHub Actions runner as part of the workflow.

Here is an example from another workflow that creates a text file:

https://github.com/wetransform/gha-workflows/blob/d110e2ff0307f9718d2e122075de9320018bb831/.github/workflows/sbt-library.yml#L52-L57

.github/workflows/check.yml

stempler · 2024-03-08T16:51:10Z

Current build failure is because of outdated offline resources.
This should fix it: #1125

stempler · 2024-03-14T13:51:30Z

@emanuelaepure10 You could try to see if the current problem is also caused by what we ran into in the service publisher.
There it seems to be work (most of the time) with the System property we added for Maven: -Dmaven.wagon.httpconnectionManager.ttlSeconds=60

Related ticket
In the service publisher workflow

emanuelaepure10 · 2024-03-15T10:50:29Z

If one of the bellow lines is added
run: mvn -Dmaven.test.failure.ignore=true -Dmaven.wagon.httpconnectionManager.ttlSeconds=60
run: clean install -Dhttp.keepAlive=false -Dmaven.wagon.http.pool=false -Dmaven.wagon.httpconnectionManager.ttlSeconds=60
one error is given:
The goal you specified requires a project to execute but there is no POM in this directory (/home/runner/work/hale/hale). Please verify you invoked Maven from the correct directory. -> [Help 1]

If the pom.xml is added
run: mvn -f pom.xml clean verify -DskipTests -Dhttp.keepAlive=false -Dmaven.wagon.http.pool=false -Dmaven.wagon.httpconnectionManager.ttlSeconds=60
an error as

Error: ] Some problems were encountered while processing the POMs:
[FATAL] Non-readable POM /home/runner/work/hale/hale/pom.xml: /home/runner/work/hale/hale/pom.xml (No such file or directory)

is shown.
Using clean verify or clean install makes no difference in the error received.

As the pom.xml is created from
I have also moved the maven setting after the clean up of the project, but doesn't help because the om/xml is created right after with calling the next script.

@stempler Would you have any suggestion how to proceed?
Thank you

stempler · 2024-03-15T12:50:31Z

Would you have any suggestion how to proceed?

The problem occurs when executing ./build.sh integrationStage, so you would need to look into how Maven is called internally in that case and how to properly pass on or set the system property, to test if that solves the issue.

stempler · 2024-03-20T16:19:45Z

The problem occurs when executing ./build.sh integrationStage, so you would need to look into how Maven is called internally in that case and how to properly pass on or set the system property, to test if that solves the issue.

Maven seems to be invoked here and also here.

emanuelaepure10 · 2024-04-15T09:09:32Z

Jenkins has complete with success, but there is still an error with the actions.
This exact error doesn't appear on Jenkins

but there are warnings related to org.eclipse.tycho:tycho-p2-plugin
Do you have any suggestion on what else could be missing?
Thank you

Add pull request file, master and release branches files to be used by the GitHub actions to check the PRs. ING-4164 build: migrate build to GitHub Actions Add pull request file, master and release branches files to be used by the GitHub actions to check the PRs. ING-4164

emanuelaepure10 · 2024-04-18T08:33:58Z

Before the merge, the file publish.yml should be updated with the master branch instead of the test branch.

 push:
    branches:
      - master

- unique job name for workflow checking PRs - use pinned action dependencies - remove checkout task (since included in setup-maven task)

we-release · 2024-06-19T15:35:45Z

🎉 This PR is included in version 5.2.0 🎉

The release is available on:

v5.2.0
GitHub release

Your semantic-release bot 📦🚀

emanuelaepure10 force-pushed the build/ING-4164 branch 6 times, most recently from bfad1a1 to 05d5b14 Compare March 5, 2024 20:55

emanuelaepure10 force-pushed the build/ING-4164 branch from 05d5b14 to 700b413 Compare March 6, 2024 10:51

emanuelaepure10 force-pushed the build/ING-4164 branch 9 times, most recently from 0eadc77 to dc58968 Compare March 8, 2024 15:40

stempler reviewed Mar 8, 2024

View reviewed changes

emanuelaepure10 force-pushed the build/ING-4164 branch 2 times, most recently from dc58968 to feb95f6 Compare March 14, 2024 10:13

emanuelaepure10 marked this pull request as ready for review March 14, 2024 10:13

emanuelaepure10 force-pushed the build/ING-4164 branch 2 times, most recently from b2e0da9 to ccd9126 Compare March 14, 2024 13:42

emanuelaepure10 force-pushed the build/ING-4164 branch 2 times, most recently from 67c0cca to b34b5ab Compare March 14, 2024 15:02

stempler marked this pull request as draft March 15, 2024 09:20

emanuelaepure10 marked this pull request as ready for review March 15, 2024 10:34

emanuelaepure10 force-pushed the build/ING-4164 branch 10 times, most recently from a2e8ec8 to 94a33ed Compare April 12, 2024 08:42

stempler mentioned this pull request Apr 12, 2024

build: migrate build to GitHub Actions #1122

Closed

emanuelaepure10 force-pushed the build/ING-4164 branch from 94a33ed to b28b2df Compare April 12, 2024 12:56

stempler force-pushed the build/ING-4164 branch from b8959cb to 27c22aa Compare April 16, 2024 12:50

emanuelaepure10 force-pushed the build/ING-4164 branch 2 times, most recently from e895d6b to eba0c64 Compare April 17, 2024 20:23

emanuelaepure10 force-pushed the build/ING-4164 branch from eba0c64 to 8a6ca3c Compare April 18, 2024 08:28

ci: minor changes to GitHub Actions workflows

f3b5743

- unique job name for workflow checking PRs - use pinned action dependencies - remove checkout task (since included in setup-maven task)

stempler approved these changes Apr 22, 2024

View reviewed changes

stempler merged commit 6f0c047 into master Apr 22, 2024
2 of 3 checks passed

stempler deleted the build/ING-4164 branch April 22, 2024 11:45

we-release bot added the released label Jun 19, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

build: migrate build to GitHub Actions #1124

build: migrate build to GitHub Actions #1124

emanuelaepure10 commented Mar 4, 2024

emanuelaepure10 commented Mar 6, 2024

stempler commented Mar 6, 2024

emanuelaepure10 commented Mar 6, 2024

stempler commented Mar 6, 2024

stempler Mar 8, 2024

stempler commented Mar 8, 2024

stempler commented Mar 14, 2024

emanuelaepure10 commented Mar 15, 2024

stempler commented Mar 15, 2024

stempler commented Mar 20, 2024

emanuelaepure10 commented Apr 15, 2024

emanuelaepure10 commented Apr 18, 2024

we-release bot commented Jun 19, 2024

build: migrate build to GitHub Actions #1124

build: migrate build to GitHub Actions #1124

Conversation

emanuelaepure10 commented Mar 4, 2024

emanuelaepure10 commented Mar 6, 2024

stempler commented Mar 6, 2024

emanuelaepure10 commented Mar 6, 2024

stempler commented Mar 6, 2024

stempler Mar 8, 2024

Choose a reason for hiding this comment

stempler commented Mar 8, 2024

stempler commented Mar 14, 2024

emanuelaepure10 commented Mar 15, 2024

stempler commented Mar 15, 2024

stempler commented Mar 20, 2024

emanuelaepure10 commented Apr 15, 2024

emanuelaepure10 commented Apr 18, 2024

we-release bot commented Jun 19, 2024