Skip to content
This repository has been archived by the owner on Jan 8, 2024. It is now read-only.

Backport of Not using the ODR image for the k8s static runner into release/0.10.x #3897

Conversation

hc-github-team-waypoint
Copy link
Collaborator

Backport

This PR is auto-generated from #3890 to be assessed for backporting due to the inclusion of the label backport/0.10.x.

The below text is copied from the body of the original PR.


What does this fix?

Currently, if you run waypoint runner install -platform=kubernetes ... but you don't specify a specific -k8s-runner-image, you get the ODR image for the static runner, which appears to be incapable of launching ODRs.

Reverts this change: https://github.com/hashicorp/waypoint/pull/3800/files#diff-33ed847d2fd425bf13e47f27760372eccaa88ed101ae6f05d13780095f486ab1L263

Only the on-demand runner needs its own image, because it needs kaniko for builds. If you use the ODR image for the static runner, you get this error when attempting to launch tasks (in the static runner logs)

2022-09-15T22:23:54.331Z [INFO]  waypoint.runner.agent.runner: launching plugin: job_id=01GD1M0P0N0PP6K9Q4FSFZ58PC job_op=*gen.Job_StartTask type=TaskLauncher path=/kaniko/waypoint args=["/kaniko/waypoint", "plugin", "kubernetes"]
2022-09-15T22:23:54.413Z [ERROR] waypoint.runner.agent.runner.waypoint: plugin init error: job_id=01GD1M0P0N0PP6K9Q4FSFZ58PC job_op=*gen.Job_StartTask @module=plugin error="open /kaniko/tmp/plugin1917675357: permission denied" timestamp=2022-09-15T22:23:54.413Z
2022-09-15T22:23:54.418Z [ERROR] waypoint.runner.agent.runner: error creating plugin client: job_id=01GD1M0P0N0PP6K9Q4FSFZ58PC job_op=*gen.Job_StartTask
  err=
  | Unrecognized remote plugin message: 
  | 
  | This usually means that the plugin is either invalid or simply
  | needs to be recompiled to support the latest protocol.

This is what it looks like on the client side during a waypoint build:

$ waypoint build

» Building backend...
! Unrecognized remote plugin message: 
  
  This usually means that the plugin is either invalid or simply
  needs to be recompiled to support the latest protocol.

I haven't dug into why the kaniko image can't launch tasks - it seems like it should be able to - but going back to using the server image for the static runner fixes the problem.

Workaround

You can work around this by specifying a non-odr runner image during waypoint runner install. I.e.:

waypoint runner install -platform=kubernetes -server-addr=api.hashicorp.cloud:443 -k8s-runner-image=hashicorp/waypoint:latest

@hc-github-team-waypoint hc-github-team-waypoint force-pushed the backport/fix-k8s-static-runner-image/incredibly-magnetic-pig branch from c8d33ad to 0952c3e Compare September 16, 2022 15:36
@hc-github-team-waypoint hc-github-team-waypoint merged commit 34f4a25 into release/0.10.x Sep 16, 2022
@hc-github-team-waypoint hc-github-team-waypoint deleted the backport/fix-k8s-static-runner-image/incredibly-magnetic-pig branch September 16, 2022 15:36
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants