14 UNAVAILABLE: No connection established

[stephenavocado]

Bug description

14 UNAVAILABLE: No connection established

Steps to reproduce

Opened workspace

For 30 minutes prior, workspace did open, but was producing errors related to ruby version and server connection

Workspace affected

https://gitpod.io/start/#teal-armadillo-3asc7h4s

Expected behavior

Workspace opens, server runs with "bin/server" command

Example repository

No response

Anything else?

No response

[stephenavocado]

Also will not allow me to create new workspaces from my repo

[ghuntley]

Also will not allow me to create new workspaces from my repo

Howdy @stephenavocado; I've been unable to replicate this but there has been one other report recently. Can you please reconfirm If you are still experiencing issues?

[1] https://twitter.com/GeoffreyHuntley/status/1466571997807136768?s=20

[stephenavocado]

Hello - yes still experiencing the issue. I believe the source of the issue is being discussed here:

https://community.gitpod.io/t/unable-to-open-workspaces-that-use-custom-docker-image/5707/3

[ghuntley]

Hmm unable to replicate and logs don't show anything that sticks out.

• Launched base-rails via https://gitpod.io#https://github.com/appdev-projects/base-rails and routed to US cluster

• launched https://ghuntley.com/new and routed to us cluster

Going to test on EU cluster as well.

@stephenavocado do you have a repository I can try?

[ghuntley]

@stephenavocado can you please confirm if you are using vscode or vscode insiders? (switch to vscode please)

[stephenavocado]

This is the affected repo: https://github.com/stephenavocado/PainNavigator

I am using VS Code

[stephenavocado]

Workspace: https://gitpod.io/start/#teal-armadillo-3asc7h4s

[ghuntley]

update: I've identified elevated events in telemetry related to prebuilds circa 2h-3h hours ago but service is now within acceptable ranges. Moving on to looking into workspace logs - thanks for supplying the identifier.

[stephenavocado]

Appreciate your assistance!

[ghuntley]

Appreciate your assistance!

Got it. Starting incident response. Apologies for the inconvenience and bringing in some additional minds to look at this. The key to reproducing is the that repository needs to be private (need to reconfirm) and trigger a rebuild of a docker container (confirmed).

Can you please share a screenshot of your browser console?

edit: https://www.gitpodstatus.com/incidents/r30dh4kly01v

[jankeromnes]

I think we're talking about several different, probably unrelated problems here:

• The error UNAVAILABLE: No connection established. seems to indicate a connection problem / incident in our cluster. Might have been temporary, would be good to investigate.

• Pulling an image with a SHA pulls a slightly different image: https://community.gitpod.io/t/unable-to-open-workspaces-that-use-custom-docker-image/5707/10 (related to this recent fix: [image-builder] Accept "familiar" base image refs #7045 -- maybe it needs an additional fix). Unrelated.

• Supervisor responded with a status of 502: I think this is normal in the creation phase of a workspace, and means that the IDE isn't ready yet (but should be after a brief waiting time). Seems unrelated to the other two problems.

[wilj]

I'm experiencing the same problem starting workspaces in the US cluster:

Request createWorkspace failed with message: 14 UNAVAILABLE: No connection established

Unknown Error: { "code": -32603 }

Mine is also a private project with custom Dockerfile, but the Dockerfile does not reference the image by the SHA hash.

I also tried a public repository that I was able to use yesterday, which does not have a custom Dockerfile, and got the same error:

https://github.com/aaronksaunders/ionic-sidemenu-tabs-auth-starter

[stephenavocado]

Appreciate your assistance!

Got it. Starting incident response. Apologies for the inconvenience and bringing in some additional minds to look at this. The key to reproducing is the that repository needs to be private (need to reconfirm) and trigger a rebuild of a docker container (confirmed).

Can you please share a screenshot of your browser console?

edit: https://www.gitpodstatus.com/incidents/r30dh4kly01v

Sorry I missed the question at the end - here is my browser console:

[kylos101]

Hi @stephenavocado , are you still experiencing trouble with this repo? If yes, may I ask you to reopen this issue?