Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DNM: [zuul] Test changes with zuul #429

Closed
wants to merge 12 commits into from
Closed

Conversation

elfiesmelfie
Copy link
Collaborator

@elfiesmelfie elfiesmelfie commented Jun 2, 2023

This is a draft/experimenting branch. It will likely not be merged, but will work as a scratchpad for other changes.

Depends-On: infrawatch/smart-gateway-operator#143
For index-deploy scenario:
Depends-On: #470
For local build scenario:
Depends-On: #478

@SeanMooney
Copy link

check-rdo

@softwarefactory-project-zuul
Copy link

Zuul encountered a syntax error while parsing its configuration in the
repo infrawatch/service-telemetry-operator on branch master. The
error was:

Configuration item has more than one key. Each zuul.yaml
configuration file must be a list of dictionaries with a
single key, for example:

  • job:
    name: foo

  • project:
    name: bar

Ensure that every item in the list is a dictionary with only
one key (in this example, 'job' and 'project'). This error
may be caused by insufficient indentation of the keys under
the configuration item ('name' in this example).

The incorrect values are around:

project: null
name: infrawatch/service-telemetry-operator
github-check:
jobs:
...

@softwarefactory-project-zuul
Copy link

Zuul encountered a syntax error while parsing its configuration in the
repo infrawatch/service-telemetry-operator on branch master. The
error was:

The nodeset "centos-9-stream-crc-xxl" was not found.

The error appears in the following job stanza:

job:
name: stf-base
# defined in: https://review.rdoproject.org/cgit/config/tree/zuul.d/_jobs-crc.yaml
parent: base-simple-crc
# need to set cluster-monitoring
abstract: true
description: |
Create a CRC instance that's configured for STF
# irrelevant-files
roles: # adds in dependent roles i.e. put it in the role path
- zuul: github.com/openstack-k8s-operators/ci-framework
# These are the additional repos that zuul will clone
required-projects:
- openstack-k8s-operators/ci-framework
# requires: # defines a resource that needs to be available e.g. a content-provide job will provide a resource
# dependencies: # list a job that needs to run successfully for this one
#
nodeset: centos-9-stream-crc-xxl
vars:
# vars for base-simple-crc
crc_config_cluster_monitoring: true
# crc_parameters: # Pass vars to crc cli https://review.rdoproject.org/cgit/config/tree/playbooks/crc/simple-start.yaml#n30

    # need a base job here, for now to request the specific versions of OCP

    # content provider job that provides stf-15.
    # MIGHT need OCP

    # all jobs would depend on a combo of the stf and ocp content providers

# this is the one to use

in "infrawatch/service-telemetry-operator/.zuul.yaml@master", line 2, column 3

@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). For information on how to proceed, see
http://docs.openstack.org/infra/manual/developers.html#automated-testing

https://review.rdoproject.org/zuul/buildset/cf196059462a434680064eb4398b0592

stf-crc-latest ERROR Project github.com/openstack-k8s-operators/ci-framework does not have the default branch master in 4s

.zuul.yaml Outdated
- zuul: github.com/openstack-k8s-operators/ci-framework
# These are the additional repos that zuul will clone
required-projects:
- openstack-k8s-operators/ci-framework

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

so you need to do a branch overide here since this uses main

https://github.com/rdo-infra/review.rdoproject.org-config/blob/7a8d010cf5fdedb1c74572722cd6d4552de4e44f/zuul.d/openstack-ci-base.yaml#L52-L54

required-projects:
  - name: github.com/openstack-k8s-operators/ci-framework
    override-checkout: main

@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). For information on how to proceed, see
http://docs.openstack.org/infra/manual/developers.html#automated-testing

https://review.rdoproject.org/zuul/buildset/45e68798954040d9a1ac936718035f53

stf-crc-latest RETRY_LIMIT in 1m 44s

@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). For information on how to proceed, see
http://docs.openstack.org/infra/manual/developers.html#automated-testing

https://review.rdoproject.org/zuul/buildset/8746d0848bee4d4c8ba731a9ed50f8c8

stf-crc-latest ERROR Unable to find playbook /var/lib/zuul/builds/8af33d05d8494bc89747b31ce0460d35/untrusted/project_0/github.com/infrawatch/service-telemetry-operator/ci/post-collectd_logs.yml in 8s

@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). For information on how to proceed, see
http://docs.openstack.org/infra/manual/developers.html#automated-testing

https://review.rdoproject.org/zuul/buildset/43a53a0cbbc844439090636cabbd00a5

stf-crc-latest RETRY_LIMIT in 2m 41s

@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). For information on how to proceed, see
http://docs.openstack.org/infra/manual/developers.html#automated-testing

https://review.rdoproject.org/zuul/buildset/0b9c9bb095224a94a19aabc6f409369b

stf-crc-latest FAILURE in 10m 21s

@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). For information on how to proceed, see
http://docs.openstack.org/infra/manual/developers.html#automated-testing

https://review.rdoproject.org/zuul/buildset/3b850ea52bef42fb8cc13f1c5ed2aea5

stf-crc-latest FAILURE in 8m 18s

@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). For information on how to proceed, see
http://docs.openstack.org/infra/manual/developers.html#automated-testing

https://review.rdoproject.org/zuul/buildset/39c9ed754aaa4a039758dc6c4d355915

stf-crc-latest RETRY_LIMIT in 8m 58s

@elfiesmelfie
Copy link
Collaborator Author

check-rdo

Rechecking to see if failure is intermittent

@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). For information on how to proceed, see
http://docs.openstack.org/infra/manual/developers.html#automated-testing

https://review.rdoproject.org/zuul/buildset/5c7f5acb33444917987430d92a54328c

stf-crc-latest FAILURE in 7m 28s

@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). For information on how to proceed, see
http://docs.openstack.org/infra/manual/developers.html#automated-testing

https://review.rdoproject.org/zuul/buildset/966a1bd1b1b349638b1e95133ac81192

stf-crc-latest FAILURE in 9m 32s

@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). For information on how to proceed, see
http://docs.openstack.org/infra/manual/developers.html#automated-testing

https://review.rdoproject.org/zuul/buildset/6ba19130028245dcb371d9b94898ade3

stf-crc-latest FAILURE in 9m 07s

@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). For information on how to proceed, see
http://docs.openstack.org/infra/manual/developers.html#automated-testing

https://review.rdoproject.org/zuul/buildset/e87771148cc3446c8979e49a3da4c882

stf-crc-latest FAILURE in 9m 43s

@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). For information on how to proceed, see
http://docs.openstack.org/infra/manual/developers.html#automated-testing

https://review.rdoproject.org/zuul/buildset/9ae4a78d9b964d00b82c344f0accd14e

stf-crc-latest FAILURE in 9m 24s

@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). For information on how to proceed, see
http://docs.openstack.org/infra/manual/developers.html#automated-testing

https://review.rdoproject.org/zuul/buildset/00c908e6d28044468e21238ba6dc2ee8

stf-crc-latest FAILURE in 8m 16s

@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). For information on how to proceed, see
http://docs.openstack.org/infra/manual/developers.html#automated-testing

https://review.rdoproject.org/zuul/buildset/61f6f0f2040b4b9b85e642202879bdfc

stf-crc-latest FAILURE in 9m 07s

@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). For information on how to proceed, see
http://docs.openstack.org/infra/manual/developers.html#automated-testing

https://review.rdoproject.org/zuul/buildset/4861854867484cc7963f00aea2e1390c

stf-crc-latest FAILURE in 9m 20s

@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). For information on how to proceed, see
http://docs.openstack.org/infra/manual/developers.html#automated-testing

https://review.rdoproject.org/zuul/buildset/fdd5b914f68049778c4fc2db342e15a1

stf-crc-latest RETRY_LIMIT in 8m 59s

ci/prepare.yml Outdated Show resolved Hide resolved
@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). For information on how to proceed, see
http://docs.openstack.org/infra/manual/developers.html#automated-testing

https://review.rdoproject.org/zuul/buildset/29b2c9d731eb432c97f3960f610414f6

stf-crc-latest MERGE_CONFLICT in 2s

@softwarefactory-project-zuul
Copy link

Zuul encountered a syntax error while parsing its configuration in the
repo infrawatch/service-telemetry-operator on branch master. The
error was:

Job stf-crc-latest not defined

The error appears in the following job stanza:

job:
name: stf-crc-latest-local_build
parent: stf-crc-latest
description: |
Build from local images and deploy STF
vars:
scenario: "local_build"

#stf-1.5-ocp-4.10

parent: stf-base

dependencies: [make-ocp-4.10]

requires:

- "ocp-4.10"

#stf-1.5-ocp-4.12

parent: stf-base

#stf-1.5-ocp-pre-release

parent: stf-base

in "infrawatch/service-telemetry-operator/.zuul.yaml@master", line 58, column 3

@elfiesmelfie
Copy link
Collaborator Author

recheck

@softwarefactory-project-zuul
Copy link

Zuul encountered a syntax error while parsing its configuration in the
repo infrawatch/service-telemetry-operator on branch master. The
error was:

Job stf-crc-latest not defined

The error appears in the following job stanza:

job:
name: stf-crc-latest-local_build
parent: stf-crc-latest
description: |
Build from local images and deploy STF
vars:
scenario: "local_build"

#stf-1.5-ocp-4.10

parent: stf-base

dependencies: [make-ocp-4.10]

requires:

- "ocp-4.10"

#stf-1.5-ocp-4.12

parent: stf-base

#stf-1.5-ocp-pre-release

parent: stf-base

in "infrawatch/service-telemetry-operator/.zuul.yaml@master", line 58, column 3

.zuul.yaml Outdated Show resolved Hide resolved
@softwarefactory-project-zuul
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://review.rdoproject.org/zuul/buildset/2cb2af4bfdab4eba859c19d22b8adf15

stf-crc-latest-nightly-bundles RETRY_LIMIT in 8m 40s
stf-crc-latest-local_build-index_deploy RETRY_LIMIT in 9m 02s
stf-crc-latest-local_build RETRY_LIMIT in 7m 53s

.zuul.yaml Outdated
Comment on lines 6 to 7
# need to set cluster-monitoring
abstract: true
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No longer true due to latest changes landed on master.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes. This PR is going to be wittled down to basically nothing as the other related changes get merged. This one is sticking around to test multiple changes together, so I'm not force pushing to other branches and making it difficult to review

ci/build_stf.yml Outdated
Comment on lines 44 to 46
# TODO: These should be documented at some point
setup_bundle_registry_auth: false
setup_bundle_registry_tls_ca: false
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If these get added during this PR, then prior to merge the README.md should be updated.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

They got added in one of the changes @vkmc made. README was updated then too.

…es relative to base_dir

This will allow configuration of the repo clone destination, so we can
use pre-cloned dirs instead of explicitly cloning the dirs each time.

This is essential for CI systems like zuul, that set-up the repos with
particular versions/branches prior to running the test scripts.
@softwarefactory-project-zuul
Copy link

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/infrawatch/service-telemetry-operator for 429,2998ac0d8bf640a5cf014e1c8b4fd7aa8f0e71ee

Using query looks up the kubeconfig on localhost, rather than the host
that ansible is executing against. This behaviour is different from
either using the shell/command modules or using k8s modules.
For consistent behaviour, the queries are replaced with an alternative
way to get the same information that will have consistent behahaviour
whether executing against localhost or a remote host.
@softwarefactory-project-zuul
Copy link

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/infrawatch/service-telemetry-operator for 429,a9edd84f7888a207a103878e9c8d5b78da43365d

@softwarefactory-project-zuul
Copy link

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/infrawatch/service-telemetry-operator for 429,d6f2b25cd56a170aa87598e6757a866d1c822746

Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://review.rdoproject.org/zuul/buildset/2ac6c46184a34a6f9ff8876ab38d6cfc

✔️ stf-crc-latest-nightly_bundles SUCCESS in 21m 47s
✔️ stf-crc-latest-local_build SUCCESS in 33m 35s
stf-crc-latest-local_build-index_deploy FAILURE in 28m 35s

This is to avoid wasting resources in the CI; this PR is being kept open
to track that the changes made here initially have been merged into
master. Once there is no change between this and master, the PR can be
closed without merging.
Copy link

Zuul encountered a syntax error while parsing its configuration in the
repo infrawatch/service-telemetry-operator on branch master. The
error was:

expected a list for dictionary value @ data['github-check']['jobs']

The error appears in the following project stanza:

project:
name: infrawatch/service-telemetry-operator
github-check:
jobs:
# - stf-crc-latest-nightly_bundles
# - stf-crc-latest-local_build
# - stf-crc-latest-local_build-index_deploy

in "infrawatch/service-telemetry-operator/.zuul.yaml@master", line 80, column 3

Copy link

Zuul encountered a syntax error while parsing its configuration in the
repo infrawatch/service-telemetry-operator on branch master. The
error was:

expected a list for dictionary value @ data['github-check']['jobs']

The error appears in the following project stanza:

project:
name: infrawatch/service-telemetry-operator
github-check:
jobs:
# - stf-crc-latest-nightly_bundles
# - stf-crc-latest-local_build
# - stf-crc-latest-local_build-index_deploy

in "infrawatch/service-telemetry-operator/.zuul.yaml@master", line 71, column 3

@elfiesmelfie
Copy link
Collaborator Author

I'm closing this, since most things I added have been merged. The local_build-index_deploy scenario is the last remaining piece, and that is under review at: #495

@elfiesmelfie elfiesmelfie deleted the efoley-add_zuul branch November 17, 2023 15:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

5 participants