[zuul] Add job to deploy from nightly bundles #494

elfiesmelfie · 2023-09-28T16:36:46Z

This job doesn't build STF, but deploys from the pre-built and published bundles.
This is useful to be able to do periodically to make sure our latest bundles are deploying, and no dependencies are out-of-date, for example

Depends-On: #496
Depends-On: #497

This job doesn't build STF, but deploys from teh pre-built and published bundles. This is useful to be able to do periodically to make sure our latest bundles are deploying, and no dependencies are out-of-date, for example

softwarefactory-project-zuul · 2023-09-28T16:48:46Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://review.rdoproject.org/zuul/buildset/73888c03c938441ca2a17d8fcf29594e

❌ stf-crc-latest-nightly_bundles RETRY_LIMIT in 10m 36s

leifmadsen · 2023-09-28T16:59:45Z

ci/vars-nightly_bundles.yml

+
+__local_build_enabled: false
+__deploy_from_bundles_enabled: true
+__service_telemetry_storage_ephemeral_enabled: true


Does CRC provide pre-configured PVs? I'd actually prefer if we could stop using ephemeral storage in our testing scenarios if possible. It's probably not a huge deal, but since our documentation uses persistent storage, it'd be ideal to test that part of the code path.

Note that ephemeral storage was only used historically because there is no PV in quicklab, where our tests were originally running. We should be trying to use persistent storage whenever possible.

Agree, if CRC will provide PVs, that would be ideal.

That's something to try later, I think. This set of jobs (local_build, local_build-index_deploy, nightly-bundles) need to get merged first so we have testing on PRs

I've added a spike to the next sprint to try answer these questions, and scope adding PVs. It might be trivial, not possible or require changes in rdo-jobs

leifmadsen · 2023-09-28T17:00:59Z

ci/vars-nightly_bundles.yml

@@ -0,0 +1,7 @@
+---
+# from: https://github.com/infrawatch/service-telemetry-operator/pull/437
+# ansible-playbook -e __service_telemetry_storage_ephemeral_enabled=true -e __local_build_enabled=false -e __deploy_from_bundles_enabled=true -e __service_telemetry_bundle_image_path=quay.io/infrawatch-operators/service-telemetry-operator-bundle:nightly-head -e __smart_gateway_bundle_image_path=quay.io/infrawatch-operators/smart-gateway-operator-bundle:nightly-head --skip-tags bundle_registry_tls_ca --skip-tags bundle_registry_auth build/run-ci.yaml


We might have to start considering tests that span stable-1.5 and master since the nightly builds are results from different branches and thus different code bases. As we move towards STF 2.0 (and even STF 1.5.4) we'll have different code bases that could really both use separate test paths.

(not for now, I'm happy to just see this start landing against master for now, but this code will eventually make its way into a stable-1.5 branch at some point, and we'll need to make some adjustments when that happens in a week or two)

This nightly check might well just run periodically, once a week or so.
To get tests spanning multiple branches, we need to add the job to that branch.

I think we also need a few more updates to get it working, but I'm focussing on getting the jobs on master first

Yep makes sense. Just noting that once we merge this to stable-1.5 as part of STF 1.5.3 then these will technically be the wrong tags.

csibbitt · 2023-09-28T20:00:52Z

ci/vars-nightly_bundles.yml

+
+__local_build_enabled: false
+__deploy_from_bundles_enabled: true
+__service_telemetry_storage_ephemeral_enabled: true


Agree, if CRC will provide PVs, that would be ideal.

elfiesmelfie · 2023-09-29T11:26:36Z

Updated the branch to catch the changes that merged from #496

softwarefactory-project-zuul · 2023-09-29T11:35:40Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://review.rdoproject.org/zuul/buildset/874047479c7e46b7933ad772b27f2438

❌ stf-crc-latest-nightly_bundles RETRY_LIMIT in 8m 26s

The format was incorrect, and cannot include '#' or capital letters.

softwarefactory-project-zuul · 2023-09-29T12:27:31Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://review.rdoproject.org/zuul/buildset/fa350b8a5bd8402a8d9d934c25a1a92a

❌ stf-crc-latest-nightly_bundles FAILURE in 23m 53s

…dles

softwarefactory-project-zuul · 2023-09-29T16:45:54Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://review.rdoproject.org/zuul/buildset/b6d91bd4bf224a2facd835fcb7348440

❌ stf-crc-latest-nightly_bundles FAILURE in 23m 06s

softwarefactory-project-zuul · 2023-10-03T15:54:09Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://review.rdoproject.org/zuul/buildset/b19bcdf0c84c411a8439548e2ed42e0c

❌ stf-crc-latest-nightly_bundles FAILURE in 25m 52s

elfiesmelfie · 2023-10-03T16:18:58Z

recheck

softwarefactory-project-zuul · 2023-10-03T16:46:27Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://review.rdoproject.org/zuul/buildset/63d28c316165423ba6d484ae7ac8bef7

❌ stf-crc-latest-nightly_bundles FAILURE in 26m 22s

softwarefactory-project-zuul · 2023-10-04T12:08:36Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://review.rdoproject.org/zuul/buildset/6be43232faa84c5a9707add2fd92d643

❌ stf-crc-latest-nightly_bundles FAILURE in 36m 14s
✔️ stf-crc-latest-local_build SUCCESS in 30m 41s

elfiesmelfie · 2023-10-04T18:24:39Z

recheck

softwarefactory-project-zuul · 2023-10-04T19:02:27Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://review.rdoproject.org/zuul/buildset/f2a7fa4d7dff4a938d94d03ed3e0a439

❌ stf-crc-latest-nightly_bundles FAILURE in 36m 23s
✔️ stf-crc-latest-local_build SUCCESS in 31m 07s

softwarefactory-project-zuul · 2023-10-09T11:27:47Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://review.rdoproject.org/zuul/buildset/17c52c84331942dc98396336afb0688c

❌ stf-crc-latest-nightly_bundles FAILURE in 36m 05s
✔️ stf-crc-latest-local_build SUCCESS in 29m 41s

softwarefactory-project-zuul · 2023-10-09T16:39:29Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://review.rdoproject.org/zuul/buildset/1897c65d5ddc4097afcda12a61e3e95d

❌ stf-crc-latest-nightly_bundles FAILURE in 37m 03s
✔️ stf-crc-latest-local_build SUCCESS in 37m 56s

elfiesmelfie · 2023-10-09T18:22:02Z

recheck

I changed the base of the PR

softwarefactory-project-zuul · 2023-10-09T19:01:15Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://review.rdoproject.org/zuul/buildset/078a29f485d5407a8255afe5479d5abd

❌ stf-crc-latest-nightly_bundles FAILURE in 37m 06s
✔️ stf-crc-latest-local_build SUCCESS in 31m 00s

…nightly-bundles

softwarefactory-project-zuul · 2023-10-10T15:55:55Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://review.rdoproject.org/zuul/buildset/f57e4c8592774b5995659fd636f5d69b

❌ stf-crc-latest-nightly_bundles RETRY_LIMIT in 15m 20s
✔️ stf-crc-latest-local_build SUCCESS in 31m 02s

elfiesmelfie · 2023-10-10T17:12:36Z

recheck

softwarefactory-project-zuul · 2023-10-10T17:51:30Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://review.rdoproject.org/zuul/buildset/c42a34980eed43da8ee6c94d482c5068

❌ stf-crc-latest-nightly_bundles FAILURE in 37m 40s
✔️ stf-crc-latest-local_build SUCCESS in 35m 11s

leifmadsen

I think this can merge now right? Nice work!

[zuul] Add job to deploy from nightly bundles

eb676b1

This job doesn't build STF, but deploys from teh pre-built and published bundles. This is useful to be able to do periodically to make sure our latest bundles are deploying, and no dependencies are out-of-date, for example

leifmadsen reviewed Sep 28, 2023

View reviewed changes

elfiesmelfie changed the base branch from master to zuul-update-prepare September 28, 2023 18:29

csibbitt approved these changes Sep 28, 2023

View reviewed changes

Base automatically changed from zuul-update-prepare to master September 29, 2023 10:44

Merge branch 'master' into efoley-zuul-nightly-bundles

bff0a8c

elfiesmelfie added 2 commits September 29, 2023 12:54

[zuul] use 'service-telemetry' as namespace

15301b9

The format was incorrect, and cannot include '#' or capital letters.

[zuul] use 'service-telemetry' as namespace

881ccdc

The format was incorrect, and cannot include '#' or capital letters.

elfiesmelfie changed the base branch from master to efoley-zuul-fix-namespace September 29, 2023 11:57

Merge branch 'master' into efoley-zuul-fix-namespace

7475a79

Merge branch 'efoley-zuul-fix-namespace' into efoley-zuul-nightly-bun…

32df3b3

…dles

Base automatically changed from efoley-zuul-fix-namespace to master September 29, 2023 16:31

Merge branch 'master' into efoley-zuul-nightly-bundles

b1425f1

Merge branch 'master' into efoley-zuul-nightly-bundles

bc0153e

Merge branch 'master' into efoley-zuul-nightly-bundles

551e2d7

Merge branch 'master' into efoley-zuul-nightly-bundles

b387b94

[stf-run-ci] Generate extra logs if preflight checks fail

d228db2

elfiesmelfie changed the base branch from master to efoley-preflight-add_logs_on_failure October 9, 2023 18:07

elfiesmelfie and others added 2 commits October 10, 2023 13:36

Update preflight checks

0c0a413

Merge branch 'efoley-preflight-add_logs_on_failure' into efoley-zuul-…

4864e8b

…nightly-bundles

Base automatically changed from efoley-preflight-add_logs_on_failure to master October 11, 2023 14:50

elfiesmelfie and others added 2 commits October 11, 2023 20:26

[better_logging] Add pod and build details to logs

0768659

Merge branch 'master' into efoley-zuul-nightly-bundles

f5619ad

leifmadsen approved these changes Oct 16, 2023

View reviewed changes

elfiesmelfie merged commit 542ac47 into master Oct 17, 2023
12 checks passed

elfiesmelfie deleted the efoley-zuul-nightly-bundles branch October 17, 2023 14:44

leifmadsen mentioned this pull request Oct 26, 2023

Import master to stable-1.5 #509

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[zuul] Add job to deploy from nightly bundles #494

[zuul] Add job to deploy from nightly bundles #494

elfiesmelfie commented Sep 28, 2023 •

edited

Loading

softwarefactory-project-zuul bot commented Sep 28, 2023

leifmadsen Sep 28, 2023

leifmadsen Sep 28, 2023

csibbitt Sep 28, 2023

elfiesmelfie Sep 29, 2023

elfiesmelfie Sep 29, 2023

leifmadsen Sep 28, 2023

leifmadsen Sep 28, 2023

elfiesmelfie Sep 28, 2023

leifmadsen Sep 28, 2023

csibbitt Sep 28, 2023

elfiesmelfie commented Sep 29, 2023

softwarefactory-project-zuul bot commented Sep 29, 2023

softwarefactory-project-zuul bot commented Sep 29, 2023

softwarefactory-project-zuul bot commented Sep 29, 2023

softwarefactory-project-zuul bot commented Oct 3, 2023

elfiesmelfie commented Oct 3, 2023

softwarefactory-project-zuul bot commented Oct 3, 2023

softwarefactory-project-zuul bot commented Oct 4, 2023

elfiesmelfie commented Oct 4, 2023

softwarefactory-project-zuul bot commented Oct 4, 2023

softwarefactory-project-zuul bot commented Oct 9, 2023

softwarefactory-project-zuul bot commented Oct 9, 2023

elfiesmelfie commented Oct 9, 2023

softwarefactory-project-zuul bot commented Oct 9, 2023

softwarefactory-project-zuul bot commented Oct 10, 2023

elfiesmelfie commented Oct 10, 2023

softwarefactory-project-zuul bot commented Oct 10, 2023

leifmadsen left a comment

[zuul] Add job to deploy from nightly bundles #494

[zuul] Add job to deploy from nightly bundles #494

Conversation

elfiesmelfie commented Sep 28, 2023 • edited Loading

softwarefactory-project-zuul bot commented Sep 28, 2023

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

elfiesmelfie commented Sep 29, 2023

softwarefactory-project-zuul bot commented Sep 29, 2023

softwarefactory-project-zuul bot commented Sep 29, 2023

softwarefactory-project-zuul bot commented Sep 29, 2023

softwarefactory-project-zuul bot commented Oct 3, 2023

elfiesmelfie commented Oct 3, 2023

softwarefactory-project-zuul bot commented Oct 3, 2023

softwarefactory-project-zuul bot commented Oct 4, 2023

elfiesmelfie commented Oct 4, 2023

softwarefactory-project-zuul bot commented Oct 4, 2023

softwarefactory-project-zuul bot commented Oct 9, 2023

softwarefactory-project-zuul bot commented Oct 9, 2023

elfiesmelfie commented Oct 9, 2023

softwarefactory-project-zuul bot commented Oct 9, 2023

softwarefactory-project-zuul bot commented Oct 10, 2023

elfiesmelfie commented Oct 10, 2023

softwarefactory-project-zuul bot commented Oct 10, 2023

leifmadsen left a comment

Choose a reason for hiding this comment

elfiesmelfie commented Sep 28, 2023 •

edited

Loading