Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

re-adding promotion-validator to ci-tools #114

Closed
wants to merge 3 commits into from

Conversation

shiywang
Copy link

@shiywang shiywang commented Sep 4, 2019

The first commit is the bump from openshift/ci-operator-prowgen#121

The second commit is having a feature to detect golang builder differences between u/s && d/s jira

@openshift-ci-robot openshift-ci-robot added do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. size/L Denotes a PR that changes 100-499 lines, ignoring generated files. labels Sep 4, 2019
@shiywang shiywang changed the title [WIP] re-adding promotion-validator to ci-tools re-adding promotion-validator to ci-tools Sep 4, 2019
@openshift-ci-robot openshift-ci-robot removed the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Sep 4, 2019
@shiywang shiywang force-pushed the promotion-validator branch from 7dc8239 to ff1e974 Compare September 4, 2019 09:57
@shiywang
Copy link
Author

shiywang commented Sep 4, 2019

also cc @sosiouxme

@openshift-ci-robot openshift-ci-robot added the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Sep 4, 2019
@shiywang shiywang force-pushed the promotion-validator branch from 50f0487 to 51ab15a Compare September 4, 2019 10:25
@openshift-ci-robot openshift-ci-robot removed the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Sep 4, 2019
@sosiouxme
Copy link
Member

@stevekuznetsov did you pass off responsibility for following up on this tool to anyone or should we still talk with you?

@shiywang i lack the brain capacity at the moment to check this, just want to ask leading questions:

  1. does this dereference stream: golang to the actual tag used in the branch?
  2. does it work with multiple builders like https://gitlab.cee.redhat.com/openshift-art/ocp-build-data/blob/09cefdd311ad43ba485a86a2e4b53b82def4b62e/images/openshift-enterprise-console.yml#L21
  3. does it validate that non-golang builders match? (I don't think it's possible, shouldn't try)

@shiywang shiywang force-pushed the promotion-validator branch from 51ab15a to c1b5da5 Compare September 9, 2019 07:00
@openshift-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: shiywang
To complete the pull request process, please assign bbguimaraes
You can assign the PR to them by writing /assign @bbguimaraes in a comment when ready.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@shiywang
Copy link
Author

shiywang commented Sep 9, 2019

Hi, @sosiouxme Here is what the tool does:
1.1 iterate all the images on openshift/release find images contians substring golang no matter is golang or golang-1.1 or so on... then compare the d/s image by:

1.2 adding ose prefix to the image, then find in ocp-build-data (this is the old logic I don't what to break it)
1.3 if one of the multiple builders in ocp-build-data has exact golang (or golang-1.1..) string as in openshift/release then match, if not doesn't match

1.4 print out all the images doesn't match also should fulfill condition 1.1

I think it addresses your question 2&&3, for 1 I am not sure what exactly you mean here?

Here is the output I filtered out only left golang builder logs

ERRO[0000] Image openshift/ose-baremetal-operator BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.10).  branch=master image=baremetal-operator org=openshift repo=baremetal-operator source-file=openshift-baremetal-operator-master.yaml
ERRO[0000] Image openshift/ose-docker-builder BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.10).  branch=master image=docker-builder org=openshift repo=builder source-file=openshift-builder-master.yaml
ERRO[0000] Image openshift/ose-cloud-credential-operator BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.10).  branch=master image=cloud-credential-operator org=openshift repo=cloud-credential-operator source-file=openshift-cloud-credential-operator-master.yaml
ERRO[0000] Image openshift/ose-manila-provisioner BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.11).  branch=master image=manila-provisioner org=openshift repo=cloud-provider-openstack source-file=openshift-cloud-provider-openstack-master.yaml
ERRO[0000] Image openshift/ose-aws-machine-controllers BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.12).  branch=master image=aws-machine-controllers org=openshift repo=cluster-api-provider-aws source-file=openshift-cluster-api-provider-aws-master.yaml
ERRO[0000] Image openshift/ose-azure-machine-controllers BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.12).  branch=master image=azure-machine-controllers org=openshift repo=cluster-api-provider-azure source-file=openshift-cluster-api-provider-azure-master.yaml
ERRO[0000] Image openshift/ose-baremetal-machine-controllers BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.10).  branch=master image=baremetal-machine-controllers org=openshift repo=cluster-api-provider-baremetal source-file=openshift-cluster-api-provider-baremetal-master.yaml
ERRO[0000] Image openshift/ose-libvirt-machine-controllers BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.10).  branch=master image=libvirt-machine-controllers org=openshift repo=cluster-api-provider-libvirt source-file=openshift-cluster-api-provider-libvirt-master.yaml
ERRO[0000] Image openshift/ose-openstack-machine-controllers BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.10).  branch=master image=openstack-machine-controllers org=openshift repo=cluster-api-provider-openstack source-file=openshift-cluster-api-provider-openstack-master.yaml
ERRO[0000] Image openshift/ose-cluster-authentication-operator BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.12).  branch=master image=cluster-authentication-operator org=openshift repo=cluster-authentication-operator source-file=openshift-cluster-authentication-operator-master.yaml
ERRO[0000] Image openshift/ose-cluster-autoscaler-operator BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.10).  branch=master image=cluster-autoscaler-operator org=openshift repo=cluster-autoscaler-operator source-file=openshift-cluster-autoscaler-operator-master.yaml
ERRO[0000] Image openshift/ose-cluster-bootstrap BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.12).  branch=master image=cluster-bootstrap org=openshift repo=cluster-bootstrap source-file=openshift-cluster-bootstrap-master.yaml
ERRO[0000] Image openshift/ose-cluster-capacity BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.10).  branch=master image=cluster-capacity org=openshift repo=cluster-capacity source-file=openshift-cluster-capacity-master.yaml
ERRO[0000] Image openshift/ose-cluster-config-operator BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.12).  branch=master image=cluster-config-operator org=openshift repo=cluster-config-operator source-file=openshift-cluster-config-operator-master.yaml
ERRO[0000] Image openshift/ose-cluster-dns-operator BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.12).  branch=master image=cluster-dns-operator org=openshift repo=cluster-dns-operator source-file=openshift-cluster-dns-operator-master.yaml
ERRO[0000] Image openshift/ose-cluster-image-registry-operator BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.12).  branch=master image=cluster-image-registry-operator org=openshift repo=cluster-image-registry-operator source-file=openshift-cluster-image-registry-operator-master.yaml
ERRO[0000] Image openshift/ose-cluster-ingress-operator BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.12).  branch=master image=cluster-ingress-operator org=openshift repo=cluster-ingress-operator source-file=openshift-cluster-ingress-operator-master.yaml
ERRO[0000] Image openshift/ose-cluster-kube-apiserver-operator BuildRoot builder does not match: (ocp-build-data  [{golang-1.11}] vs release golang-1.12).  branch=master image=cluster-kube-apiserver-operator org=openshift repo=cluster-kube-apiserver-operator source-file=openshift-cluster-kube-apiserver-operator-master.yaml
ERRO[0000] Image openshift/ose-cluster-kube-controller-manager-operator BuildRoot builder does not match: (ocp-build-data  [{golang-1.11}] vs release golang-1.12).  branch=master image=cluster-kube-controller-manager-operator org=openshift repo=cluster-kube-controller-manager-operator source-file=openshift-cluster-kube-controller-manager-operator-master.yaml
ERRO[0000] Image openshift/ose-cluster-kube-scheduler-operator BuildRoot builder does not match: (ocp-build-data  [{golang-1.11}] vs release golang-1.12).  branch=master image=cluster-kube-scheduler-operator org=openshift repo=cluster-kube-scheduler-operator source-file=openshift-cluster-kube-scheduler-operator-master.yaml
ERRO[0000] Image openshift/ose-cluster-logging-operator BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.10).  branch=master image=cluster-logging-operator org=openshift repo=cluster-logging-operator source-file=openshift-cluster-logging-operator-master.yaml
ERRO[0000] Image openshift/ose-cluster-machine-approver BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.12).  branch=master image=cluster-machine-approver org=openshift repo=cluster-machine-approver source-file=openshift-cluster-machine-approver-master.yaml
ERRO[0000] Image openshift/ose-cluster-monitoring-operator BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.12).  branch=master image=cluster-monitoring-operator org=openshift repo=cluster-monitoring-operator source-file=openshift-cluster-monitoring-operator-master.yaml
ERRO[0000] Image openshift/ose-cluster-network-operator BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.12).  branch=master image=cluster-network-operator org=openshift repo=cluster-network-operator source-file=openshift-cluster-network-operator-master.yaml
ERRO[0000] Image openshift/ose-cluster-nfd-operator BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.10).  branch=master image=cluster-nfd-operator org=openshift repo=cluster-nfd-operator source-file=openshift-cluster-nfd-operator-master.yaml
ERRO[0000] Image openshift/ose-cluster-node-tuning-operator BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.10).  branch=master image=cluster-node-tuning-operator org=openshift repo=cluster-node-tuning-operator source-file=openshift-cluster-node-tuning-operator-master.yaml
ERRO[0000] Image openshift/ose-cluster-openshift-apiserver-operator BuildRoot builder does not match: (ocp-build-data  [{golang-1.11}] vs release golang-1.12).  branch=master image=cluster-openshift-apiserver-operator org=openshift repo=cluster-openshift-apiserver-operator source-file=openshift-cluster-openshift-apiserver-operator-master.yaml
ERRO[0000] Image openshift/ose-cluster-openshift-controller-manager-operator BuildRoot builder does not match: (ocp-build-data  [{golang-1.11}] vs release golang-1.12).  branch=master image=cluster-openshift-controller-manager-operator org=openshift repo=cluster-openshift-controller-manager-operator source-file=openshift-cluster-openshift-controller-manager-operator-master.yaml
ERRO[0000] Image openshift/ose-cluster-samples-operator BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.12).  branch=master image=cluster-samples-operator org=openshift repo=cluster-samples-operator source-file=openshift-cluster-samples-operator-master.yaml
ERRO[0000] Image openshift/ose-cluster-storage-operator BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.10).  branch=master image=cluster-storage-operator org=openshift repo=cluster-storage-operator source-file=openshift-cluster-storage-operator-master.yaml
ERRO[0000] Image openshift/ose-cluster-svcat-apiserver-operator BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.12).  branch=master image=cluster-svcat-apiserver-operator org=openshift repo=cluster-svcat-apiserver-operator source-file=openshift-cluster-svcat-apiserver-operator-master.yaml
ERRO[0000] Image openshift/ose-cluster-svcat-controller-manager-operator BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.12).  branch=master image=cluster-svcat-controller-manager-operator org=openshift repo=cluster-svcat-controller-manager-operator source-file=openshift-cluster-svcat-controller-manager-operator-master.yaml
ERRO[0000] Image openshift/ose-cluster-version-operator BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.10).  branch=master image=cluster-version-operator org=openshift repo=cluster-version-operator source-file=openshift-cluster-version-operator-master.yaml
ERRO[0000] Image openshift/ose-configmap-reloader BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.12).  branch=master image=configmap-reloader org=openshift repo=configmap-reload source-file=openshift-configmap-reload-master.yaml
ERRO[0000] Image openshift/ose-console-operator BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.12).  branch=master image=console-operator org=openshift repo=console-operator source-file=openshift-console-operator-master.yaml
ERRO[0000] Image openshift/ose-coredns BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.12).  branch=master image=coredns org=openshift repo=coredns source-file=openshift-coredns-master.yaml
ERRO[0000] Image openshift/ose-csi-external-attacher BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.11).  branch=master image=csi-external-attacher org=openshift repo=csi-external-attacher source-file=openshift-csi-external-attacher-master.yaml
ERRO[0000] Image openshift/ose-csi-livenessprobe BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.11).  branch=master image=csi-livenessprobe org=openshift repo=csi-livenessprobe source-file=openshift-csi-livenessprobe-master.yaml
ERRO[0000] Image openshift/ose-descheduler BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.10).  branch=master image=descheduler org=openshift repo=descheduler source-file=openshift-descheduler-master.yaml
ERRO[0000] Image openshift/ose-descheduler-operator BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.10).  branch=master image=descheduler-operator org=openshift repo=descheduler-operator source-file=openshift-descheduler-operator-master.yaml
ERRO[0000] Image openshift/ose-elasticsearch-operator BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.10).  branch=master image=elasticsearch-operator org=openshift repo=elasticsearch-operator source-file=openshift-elasticsearch-operator-master.yaml
ERRO[0000] Image openshift/ose-etcd BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.11).  branch=openshift-4.2 image=etcd org=openshift repo=etcd source-file=openshift-etcd-openshift-4.2.yaml
ERRO[0000] Image openshift/ose-snapshot-controller BuildRoot builder does not match: (ocp-build-data  [] vs release golang-1.11).  branch=master image=snapshot-controller org=openshift repo=external-storage source-file=openshift-external-storage-master.yaml
ERRO[0000] Image openshift/ose-snapshot-provisioner BuildRoot builder does not match: (ocp-build-data  [] vs release golang-1.11).  branch=master image=snapshot-provisioner ocp-build-data-path=images/snapshot-controller.yml org=openshift repo=external-storage source-file=openshift-external-storage-master.yaml
ERRO[0000] Image openshift/ose-federation-controller BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.10).  branch=master image=federation-controller org=openshift repo=federation-v2-operator source-file=openshift-federation-v2-operator-master.yaml
ERRO[0000] Image openshift/ose-grafana BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.12).  branch=master image=grafana org=openshift repo=grafana source-file=openshift-grafana-master.yaml
ERRO[0000] Image openshift/ose-docker-registry BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.12).  branch=master image=docker-registry org=openshift repo=image-registry source-file=openshift-image-registry-master.yaml
ERRO[0000] Image openshift/ose-base BuildRoot builder does not match: (ocp-build-data  [] vs release golang-1.10).  branch=master image=base org=openshift repo=images source-file=openshift-images-master.yaml
ERRO[0000] Image openshift/ose-pod BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.10).  branch=master image=pod ocp-build-data-path=images/openshift-enterprise-base.yml org=openshift repo=images source-file=openshift-images-master.yaml
ERRO[0000] Image openshift/ose-egress-router BuildRoot builder does not match: (ocp-build-data  [] vs release golang-1.10).  branch=master image=egress-router ocp-build-data-path=images/openshift-enterprise-pod.yml org=openshift repo=images source-file=openshift-images-master.yaml
ERRO[0000] Image openshift/ose-egress-http-proxy BuildRoot builder does not match: (ocp-build-data  [] vs release golang-1.10).  branch=master image=egress-http-proxy ocp-build-data-path=images/openshift-enterprise-egress-router.yml org=openshift repo=images source-file=openshift-images-master.yaml
ERRO[0000] Image openshift/ose-egress-dns-proxy BuildRoot builder does not match: (ocp-build-data  [] vs release golang-1.10).  branch=master image=egress-dns-proxy ocp-build-data-path=images/ose-egress-http-proxy.yml org=openshift repo=images source-file=openshift-images-master.yaml
ERRO[0000] Image openshift/ose-keepalived-ipfailover BuildRoot builder does not match: (ocp-build-data  [] vs release golang-1.10).  branch=master image=keepalived-ipfailover ocp-build-data-path=images/openshift-enterprise-egress-dns-proxy.yml org=openshift repo=images source-file=openshift-images-master.yaml
ERRO[0000] Image openshift/ose-installer BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.10).  branch=master image=installer org=openshift repo=installer source-file=openshift-installer-master.yaml
ERRO[0000] Image openshift/ose-installer-artifacts BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.10).  branch=master image=installer-artifacts ocp-build-data-path=images/ose-installer.yml org=openshift repo=installer source-file=openshift-installer-master.yaml
ERRO[0000] Image openshift/ose-jenkins BuildRoot builder does not match: (ocp-build-data  [] vs release golang-1.10).  branch=master image=jenkins org=openshift repo=jenkins source-file=openshift-jenkins-master.yaml
ERRO[0000] Image openshift/ose-jenkins-agent-base BuildRoot builder does not match: (ocp-build-data  [] vs release golang-1.10).  branch=master image=jenkins-agent-base ocp-build-data-path=images/openshift-jenkins-2.yml org=openshift repo=jenkins source-file=openshift-jenkins-master.yaml
ERRO[0000] Image openshift/ose-jenkins-agent-maven BuildRoot builder does not match: (ocp-build-data  [] vs release golang-1.10).  branch=master image=jenkins-agent-maven ocp-build-data-path=images/jenkins-slave-base-rhel7.yml org=openshift repo=jenkins source-file=openshift-jenkins-master.yaml
ERRO[0000] Image openshift/ose-jenkins-agent-nodejs BuildRoot builder does not match: (ocp-build-data  [] vs release golang-1.10).  branch=master image=jenkins-agent-nodejs ocp-build-data-path=images/jenkins-agent-maven-35-rhel7.yml org=openshift repo=jenkins source-file=openshift-jenkins-master.yaml
ERRO[0000] Image openshift/ose-k8s-prometheus-adapter BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.12).  branch=master image=k8s-prometheus-adapter org=openshift repo=k8s-prometheus-adapter source-file=openshift-k8s-prometheus-adapter-master.yaml
ERRO[0000] Image openshift/ose-kube-rbac-proxy BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.12).  branch=master image=kube-rbac-proxy org=openshift repo=kube-rbac-proxy source-file=openshift-kube-rbac-proxy-master.yaml
ERRO[0000] Image openshift/ose-kube-state-metrics BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.12).  branch=master image=kube-state-metrics org=openshift repo=kube-state-metrics source-file=openshift-kube-state-metrics-master.yaml
ERRO[0000] Image openshift/ose-kube-client-agent BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.10).  branch=openshift-4.2 image=kube-client-agent org=openshift repo=kubecsr source-file=openshift-kubecsr-openshift-4.2.yaml
ERRO[0000] Image openshift/ose-kube-etcd-signer-server BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.10).  branch=openshift-4.2 image=kube-etcd-signer-server ocp-build-data-path=images/ose-kube-client-agent.yml org=openshift repo=kubecsr source-file=openshift-kubecsr-openshift-4.2.yaml
ERRO[0000] Image openshift/ose-cluster-autoscaler BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.10).  branch=master image=cluster-autoscaler org=openshift repo=kubernetes-autoscaler source-file=openshift-kubernetes-autoscaler-master.yaml
ERRO[0000] Image openshift/ose-kuryr-cni BuildRoot builder does not match: (ocp-build-data  [] vs release golang-1.10).  branch=master image=kuryr-cni org=openshift repo=kuryr-kubernetes source-file=openshift-kuryr-kubernetes-master.yaml
ERRO[0000] Image openshift/ose-kuryr-controller BuildRoot builder does not match: (ocp-build-data  [] vs release golang-1.10).  branch=master image=kuryr-controller ocp-build-data-path=images/kuryr-cni.yml org=openshift repo=kuryr-kubernetes source-file=openshift-kuryr-kubernetes-master.yaml
ERRO[0000] Image openshift/ose-leader-elector BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.10).  branch=master image=leader-elector org=openshift repo=leader-elector source-file=openshift-leader-elector-master.yaml
ERRO[0000] Image openshift/ose-machine-api-operator BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.10).  branch=master image=machine-api-operator org=openshift repo=machine-api-operator source-file=openshift-machine-api-operator-master.yaml
ERRO[0000] Image openshift/ose-machine-config-operator BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.12).  branch=master image=machine-config-operator org=openshift repo=machine-config-operator source-file=openshift-machine-config-operator-master.yaml
ERRO[0000] Image openshift/ose-multus-admission-controller BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.10).  branch=master image=multus-admission-controller org=openshift repo=multus-admission-controller source-file=openshift-multus-admission-controller-master.yaml
ERRO[0000] Image openshift/ose-multus-cni BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.10).  branch=master image=multus-cni org=openshift repo=multus-cni source-file=openshift-multus-cni-master.yaml
ERRO[0000] Image openshift/ose-must-gather BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.12).  branch=master image=must-gather org=openshift repo=must-gather source-file=openshift-must-gather-master.yaml
ERRO[0000] Image openshift/ose-node-feature-discovery BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.10).  branch=master image=node-feature-discovery org=openshift repo=node-feature-discovery source-file=openshift-node-feature-discovery-master.yaml
ERRO[0000] Image openshift/ose-node-problem-detector BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.10).  branch=master image=node-problem-detector org=openshift repo=node-problem-detector source-file=openshift-node-problem-detector-master.yaml
ERRO[0000] Image openshift/ose-node-problem-detector-operator BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.10).  branch=master image=node-problem-detector-operator org=openshift repo=node-problem-detector-operator source-file=openshift-node-problem-detector-operator-master.yaml
ERRO[0000] Image openshift/ose-prometheus-node-exporter BuildRoot builder does not match: (ocp-build-data  [{golang-1.11}] vs release golang-1.12).  branch=master image=prometheus-node-exporter org=openshift repo=node_exporter source-file=openshift-node_exporter-master.yaml
ERRO[0000] Image openshift/ose-oauth-proxy BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.12).  branch=master image=oauth-proxy org=openshift repo=oauth-proxy source-file=openshift-oauth-proxy-master.yaml
ERRO[0000] Image openshift/ose-cli BuildRoot builder does not match: (ocp-build-data  [{golang-1.11}] vs release golang-1.12).  branch=master image=cli org=openshift repo=oc source-file=openshift-oc-master.yaml
ERRO[0000] Image openshift/ose-tests BuildRoot builder does not match: (ocp-build-data  [{golang-1.11}] vs release golang-1.12).  branch=master image=tests ocp-build-data-path=images/openshift-enterprise-cli.yml org=openshift repo=oc source-file=openshift-oc-master.yaml
ERRO[0000] Image openshift/ose-deployer BuildRoot builder does not match: (ocp-build-data  [] vs release golang-1.12).  branch=master image=deployer ocp-build-data-path=images/openshift-enterprise-tests.yml org=openshift repo=oc source-file=openshift-oc-master.yaml
ERRO[0000] Image openshift/ose-cli-artifacts BuildRoot builder does not match: (ocp-build-data  [{golang-1.11}] vs release golang-1.12).  branch=master image=cli-artifacts ocp-build-data-path=images/openshift-enterprise-deployer.yml org=openshift repo=oc source-file=openshift-oc-master.yaml
ERRO[0000] Image openshift/ose-recycler BuildRoot builder does not match: (ocp-build-data  [] vs release golang-1.12).  branch=master image=recycler ocp-build-data-path=images/ose-cli-artifacts.yml org=openshift repo=oc source-file=openshift-oc-master.yaml
ERRO[0000] Image openshift/ose-ansible-operator BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.12).  branch=master image=ansible-operator org=openshift repo=ocp-release-operator-sdk source-file=openshift-ocp-release-operator-sdk-master.yaml
ERRO[0000] Image openshift/ose-openshift-state-metrics BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.11).  branch=master image=openshift-state-metrics org=openshift repo=openshift-state-metrics source-file=openshift-openshift-state-metrics-master.yaml
ERRO[0000] Image openshift/ose-cluster-node-tuned BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.10).  branch=master image=cluster-node-tuned org=openshift repo=openshift-tuned source-file=openshift-openshift-tuned-master.yaml
ERRO[0000] Image openshift/ose-logging-fluentd BuildRoot builder does not match: (ocp-build-data  [{ruby-25}] vs release golang-1.10).  branch=master image=logging-fluentd org=openshift repo=origin-aggregated-logging source-file=openshift-origin-aggregated-logging-master.yaml
ERRO[0000] Image openshift/ose-logging-elasticsearch5 BuildRoot builder does not match: (ocp-build-data  [] vs release golang-1.10).  branch=master image=logging-elasticsearch5 ocp-build-data-path=images/logging-fluentd.yml org=openshift repo=origin-aggregated-logging source-file=openshift-origin-aggregated-logging-master.yaml
ERRO[0000] Image openshift/ose-logging-kibana5 BuildRoot builder does not match: (ocp-build-data  [] vs release golang-1.10).  branch=master image=logging-kibana5 ocp-build-data-path=images/logging-elasticsearch5.yml org=openshift repo=origin-aggregated-logging source-file=openshift-origin-aggregated-logging-master.yaml
ERRO[0000] Image openshift/ose-logging-curator5 BuildRoot builder does not match: (ocp-build-data  [] vs release golang-1.10).  branch=master image=logging-curator5 ocp-build-data-path=images/logging-kibana5.yml org=openshift repo=origin-aggregated-logging source-file=openshift-origin-aggregated-logging-master.yaml
ERRO[0000] Image openshift/ose-logging-eventrouter BuildRoot builder does not match: (ocp-build-data  [] vs release golang-1.10).  branch=master image=logging-eventrouter ocp-build-data-path=images/logging-curator5.yml org=openshift repo=origin-aggregated-logging source-file=openshift-origin-aggregated-logging-master.yaml
ERRO[0000] Image openshift/ose-logging-rsyslog BuildRoot builder does not match: (ocp-build-data  [] vs release golang-1.10).  branch=master image=logging-rsyslog ocp-build-data-path=images/logging-eventrouter.yml org=openshift repo=origin-aggregated-logging source-file=openshift-origin-aggregated-logging-master.yaml
ERRO[0000] Image openshift/ose-ovn-kubernetes BuildRoot builder does not match: (ocp-build-data  [{golang} {}] vs release golang-1.10).  branch=master image=ovn-kubernetes org=openshift repo=ovn-kubernetes source-file=openshift-ovn-kubernetes-master.yaml
ERRO[0000] Image openshift/ose-prom-label-proxy BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.12).  branch=master image=prom-label-proxy org=openshift repo=prom-label-proxy source-file=openshift-prom-label-proxy-master.yaml
ERRO[0000] Image openshift/ose-prometheus BuildRoot builder does not match: (ocp-build-data  [{golang-1.11}] vs release golang-1.12).  branch=master image=prometheus org=openshift repo=prometheus source-file=openshift-prometheus-master.yaml
ERRO[0000] Image openshift/ose-prometheus-alertmanager BuildRoot builder does not match: (ocp-build-data  [{golang-1.11}] vs release golang-1.12).  branch=master image=prometheus-alertmanager org=openshift repo=prometheus-alertmanager source-file=openshift-prometheus-alertmanager-master.yaml
ERRO[0000] Image openshift/ose-prometheus-operator BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.12).  branch=master image=prometheus-operator org=openshift repo=prometheus-operator source-file=openshift-prometheus-operator-master.yaml
ERRO[0000] Image openshift/ose-prometheus-config-reloader BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.12).  branch=master image=prometheus-config-reloader ocp-build-data-path=images/prometheus-operator.yml org=openshift repo=prometheus-operator source-file=openshift-prometheus-operator-master.yaml
ERRO[0000] Image openshift/ose-haproxy-router BuildRoot builder does not match: (ocp-build-data  [] vs release golang-1.10).  branch=master image=haproxy-router org=openshift repo=router source-file=openshift-router-master.yaml
ERRO[0000] Image openshift/ose-node BuildRoot builder does not match: (ocp-build-data  [{golang-1.11}] vs release golang-1.12).  branch=master image=node org=openshift repo=sdn source-file=openshift-sdn-master.yaml
ERRO[0000] Image openshift/ose-kube-proxy BuildRoot builder does not match: (ocp-build-data  [] vs release golang-1.12).  branch=master image=kube-proxy ocp-build-data-path=images/openshift-enterprise-node.yml org=openshift repo=sdn source-file=openshift-sdn-master.yaml
ERRO[0000] Image openshift/ose-service-ca-operator BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.12).  branch=master image=service-ca-operator org=openshift repo=service-ca-operator source-file=openshift-service-ca-operator-master.yaml
ERRO[0000] Image openshift/ose-service-catalog BuildRoot builder does not match: (ocp-build-data  [] vs release golang-1.10).  branch=master image=service-catalog org=openshift repo=service-catalog source-file=openshift-service-catalog-master.yaml
ERRO[0000] Image openshift/ose-sriov-cni BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.10).  branch=master image=sriov-cni org=openshift repo=sriov-cni source-file=openshift-sriov-cni-master.yaml
ERRO[0000] Image openshift/ose-sriov-dp-admission-controller BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.10).  branch=master image=sriov-dp-admission-controller org=openshift repo=sriov-dp-admission-controller source-file=openshift-sriov-dp-admission-controller-master.yaml
ERRO[0000] Image openshift/ose-sriov-network-device-plugin BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.10).  branch=master image=sriov-network-device-plugin org=openshift repo=sriov-network-device-plugin source-file=openshift-sriov-network-device-plugin-master.yaml
ERRO[0000] Image openshift/ose-telemeter BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.12).  branch=master image=telemeter org=openshift repo=telemeter source-file=openshift-telemeter-master.yaml
ERRO[0000] Image openshift/ose-template-service-broker BuildRoot builder does not match: (ocp-build-data  [{golang-1.11}] vs release golang-1.12).  branch=master image=template-service-broker org=openshift repo=template-service-broker source-file=openshift-template-service-broker-master.yaml
ERRO[0000] Image openshift/ose-metering-hadoop BuildRoot builder does not match: (ocp-build-data  [{rhel}] vs release golang-1.10).  branch=master image=metering-hadoop org=operator-framework repo=hadoop source-file=operator-framework-hadoop-master.yaml
ERRO[0000] Image openshift/ose-metering-helm BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.10).  branch=master image=metering-helm org=operator-framework repo=helm source-file=operator-framework-helm-master.yaml
ERRO[0000] Image openshift/ose-metering-hive BuildRoot builder does not match: (ocp-build-data  [{rhel}] vs release golang-1.10).  branch=master image=metering-hive org=operator-framework repo=hive source-file=operator-framework-hive-master.yaml
ERRO[0000] Image openshift/ose-operator-lifecycle-manager BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.12).  branch=master image=operator-lifecycle-manager org=operator-framework repo=operator-lifecycle-manager source-file=operator-framework-operator-lifecycle-manager-master.yaml
ERRO[0000] Image openshift/ose-operator-marketplace BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.10).  branch=master image=operator-marketplace org=operator-framework repo=operator-marketplace source-file=operator-framework-operator-marketplace-master.yaml
ERRO[0000] Image openshift/ose-operator-registry BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.10).  branch=master image=operator-registry org=operator-framework repo=operator-registry source-file=operator-framework-operator-registry-master.yaml
ERRO[0000] Image openshift/ose-ansible-operator BuildRoot builder does not match: (ocp-build-data  [{golang}] vs release golang-1.12).  branch=master image=ansible-operator org=operator-framework repo=operator-sdk source-file=operator-framework-operator-sdk-master.yaml
ERRO[0000] Image openshift/ose-metering-presto BuildRoot builder does not match: (ocp-build-data  [{rhel}] vs release golang-1.10).  branch=master image=metering-presto org=operator-framework repo=presto source-file=operator-framework-presto-master.yaml

Copy link
Contributor

@stevekuznetsov stevekuznetsov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@sosiouxme happy to commit to working with this

I would suggest we:

  1. create a list of necessary validations
  2. (optionally) factor this tool to run a set of validations as enabled by flags
  3. create a whitelist of current errors
  4. check in the tool to prevent future regressions
  5. work on fixing issues
    5a. often this tool as written is pretty permissive for no great reason (like, the git URL can take any of 10 forms) -- I suggest making it restrictive and programatically changing the ocp-build-data to match

cmd/promotion-validator/main.go Outdated Show resolved Hide resolved
@shiywang shiywang force-pushed the promotion-validator branch 2 times, most recently from 3882baa to 7a59126 Compare October 30, 2019 09:52
@shiywang
Copy link
Author

@tbielawa @sosiouxme
usage:

 ./promotion-validator  --release-repo-dir /Users/shiywang/ART/release --ocp-build-data-repo-dir  /Users/shiywang/ART/ocp-build-data --current-release 4.3

since a lot of those errors are because of golang version not being explicit, are we still want to do this
https://gitlab.cee.redhat.com/openshift-art/ocp-build-data/merge_requests/254
https://gitlab.cee.redhat.com/openshift-art/ocp-build-data/merge_requests/253
https://gitlab.cee.redhat.com/openshift-art/ocp-build-data/merge_requests/252
?

@shiywang
Copy link
Author

shiywang commented Oct 30, 2019

@stevekuznetsov @sosiouxme @tbielawa I rebase and re-run this command again

./promotion-validator --release-repo-dir /Users/shiywang/ART/release --ocp-build-data-repo-dir /Users/shiywang/ART/ocp-build-data --current-release 4.3

there're three major problems I described on Jira, I think 80-90% percent of those issues can be fixed by

  1. make golang version in stream.yml in our ocp-build-data explicit.
  2. having a while list like Steve mentioned

But for 2, the question is where do we put this white list, I don't like hardcoded into the ci-tools, we need to pick a place to put and make it configurable

^^^^^ questions above are solved

Shiyang Wang and others added 3 commits October 31, 2019 14:04
…to d/s

usage:
 ./promotion-validator  --release-repo-dir /Users/shiywang/ART/release --ocp-build-data-repo-dir  /Users/shiywang/ART/ocp-build-data --current-release 4.3
@shiywang shiywang force-pushed the promotion-validator branch from 7a59126 to 223044e Compare October 31, 2019 08:01
@shiywang
Copy link
Author

/retest

@openshift-ci-robot
Copy link
Contributor

@shiywang: The following tests failed, say /retest to rerun all failed tests:

Test name Commit Details Rerun command
ci/prow/lint 223044e link /test lint
ci/prow/e2e 223044e link /test e2e

Full PR test history. Your PR dashboard. Please help us cut down on flakes by linking to an open issue when you hit one in your PR.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@petr-muller
Copy link
Member

/close

This is likely obsolete. Please open a new PR if still somehow relevant.

@openshift-ci-robot
Copy link
Contributor

@petr-muller: Closed this PR.

In response to this:

/close

This is likely obsolete. Please open a new PR if still somehow relevant.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
size/L Denotes a PR that changes 100-499 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants