Fix CI failures

[gaocegege]

Signed-off-by: Ce Gao gaoce@caicloud.io

[gaocegege]

It seems that we have no item in GCS

https://storage.googleapis.com/kubernetes-jenkins/pr-logs/pull/kubeflow_hp-tuning/27/kubeflow-hp-tuning-presubmit

[gaocegege]

@jlewi

I meet with one problem when I am trying to fix CI failures. I'd appreciate it if you could have a look.

https://console.cloud.google.com/kubernetes/pod/us-east1-d/kubeflow-testing/kubeflow-test-infra/kubeflow-hp-tuning-presubmit-e2e-27-4e8c7ed-19-af0f-2710394068?project=kubeflow-ci&tab=logs&duration=PT1H&container_summary_list_tablesize=10&log_entry_list_tablesize=50

I think it may be caused by some features I don't know in GKE. I tried to hack it aacd31e but failed.

Log:

Error from server (Forbidden): error when creating "manifests/dlk/rbac.yaml": clusterroles.rbac.authorization.k8s.io "dlk-manager" is forbidden: attempt to grant extra privileges: [PolicyRule{Resources:["pods"], APIGroups:[""], Verbs:["*"]} PolicyRule{Resources:["nodes"], APIGroups:[""], Verbs:["*"]} PolicyRule{Resources:["nodes/*"], APIGroups:[""], Verbs:["*"]} PolicyRule{Resources:["pods/log"], APIGroups:[""], Verbs:["*"]} PolicyRule{Resources:["pods/status"], APIGroups:[""], Verbs:["*"]} PolicyRule{Resources:["services"], APIGroups:[""], Verbs:["*"]} PolicyRule{Resources:["persistentvolumes"], APIGroups:[""], Verbs:["*"]} PolicyRule{Resources:["persistentvolumes/status"], APIGroups:[""], Verbs:["*"]} PolicyRule{Resources:["persistentvolumeclaims"], APIGroups:[""], Verbs:["*"]} PolicyRule{Resources:["persistentvolumeclaims/status"], APIGroups:[""], Verbs:["*"]} PolicyRule{Resources:["jobs"], APIGroups:["batch"], Verbs:["*"]} PolicyRule{Resources:["jobs/status"], APIGroups:["batch"], Verbs:["*"]}] user=&{kubeflow-testing@kubeflow-ci.iam.gserviceaccount.com [system:authenticated] map[authenticator:[GKE]]} ownerrules=[PolicyRule{Resources:["selfsubjectaccessreviews" "selfsubjectrulesreviews"], APIGroups:["authorization.k8s.io"], Verbs:["create"]} PolicyRule{NonResourceURLs:["/api" "/api/*" "/apis" "/apis/*" "/healthz" "/swagger-2.0.0.pb-v1" "/swagger.json" "/swaggerapi" "/swaggerapi/*" "/version"], Verbs:["get"]}] ruleResolutionErrors=[]

[gaocegege]

/assign @YujiOshima

Thanks to jose5918@ , we solved the issue in GKE and CI should work now.

[YujiOshima]

🎉🎉🎉🎉🎉🎉🎉🎉
Thank you @gaocegege @jose5918 !!!
/lgtm

[k8s-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: YujiOshima

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [YujiOshima]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment