Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The workspace agent has attempted to start, but it is unable to ping the Che server at http://che-host:8080/ide/api/ #684

Closed
kolotyluk opened this issue Mar 10, 2016 · 18 comments
Labels
kind/question Questions that haven't been identified as being feature requests or bugs.

Comments

@kolotyluk
Copy link

Description of problem:

Che version:

  • 4.0.0-RC13

Che install directory:

  • C:\Users\Eric\AppData\Local\Programs\Eclipse-Che\eclipse-che-4.0.0-RC13

Docker version:

  • Client:
  • Version: 1.9.1
  • API version: 1.21
  • Go version: go1.4.3
  • Git commit: a34a1d5
  • Built: Fri Nov 20 17:56:04 UTC 2015
  • OS/Arch: windows/amd64
  • An error occurred trying to connect: Get http://localhost:2375/v1.21/version: dial tcp 127.0.0.1:2375: ConnectEx tcp: No connection could be made because the target machine actively refused it.

Java version:

  • java version "1.8.0_73"
  • Java(TM) SE Runtime Environment (build 1.8.0_73-b02)
  • Java HotSpot(TM) 64-Bit Server VM (build 25.73-b02, mixed mode)

Environment details (AWS, VirtualBox, physical, etc.):

  • Windows 10

How reproducible:

  • Always

Steps to Reproduce:

  1. Create new work-space
  2. Run new work-space
  3. Inspect output from http://localhost:8080/dashboard/#/ide/MyFirstWorkspace

Actual Results:

[STDOUT] Listening for transport dt_socket at address: 4403
[STDOUT] 2016-03-10 23:35:00,806[main]             [INFO ] [o.a.c.s.VersionLoggerListener 89]    - Server version:        Apache Tomcat/8.0.29
[STDOUT] 2016-03-10 23:35:00,814[main]             [INFO ] [o.a.c.s.VersionLoggerListener 91]    - Server built:          Nov 20 2015 09:18:00 UTC
[STDOUT] 2016-03-10 23:35:00,820[main]             [INFO ] [o.a.c.s.VersionLoggerListener 93]    - Server number:         8.0.29.0
[STDOUT] 2016-03-10 23:35:00,834[main]             [INFO ] [o.a.c.s.VersionLoggerListener 95]    - OS Name:               Linux
[STDOUT] 2016-03-10 23:35:00,834[main]             [INFO ] [o.a.c.s.VersionLoggerListener 97]    - OS Version:            4.1.18-boot2docker
[STDOUT] 2016-03-10 23:35:00,835[main]             [INFO ] [o.a.c.s.VersionLoggerListener 99]    - Architecture:          amd64
[STDOUT] 2016-03-10 23:35:00,835[main]             [INFO ] [o.a.c.s.VersionLoggerListener 101]   - Java Home:             /opt/jdk1.8.0_45/jre
[STDOUT] 2016-03-10 23:35:00,835[main]             [INFO ] [o.a.c.s.VersionLoggerListener 103]   - JVM Version:           1.8.0_45-b14
[STDOUT] 2016-03-10 23:35:00,836[main]             [INFO ] [o.a.c.s.VersionLoggerListener 105]   - JVM Vendor:            Oracle Corporation
[STDOUT] 2016-03-10 23:35:00,837[main]             [INFO ] [o.a.c.s.VersionLoggerListener 107]   - CATALINA_BASE:         /home/user/che/ws-agent
[STDOUT] 2016-03-10 23:35:00,837[main]             [INFO ] [o.a.c.s.VersionLoggerListener 109]   - CATALINA_HOME:         /home/user/che/ws-agent
[STDOUT] 2016-03-10 23:35:00,838[main]             [INFO ] [o.a.c.s.VersionLoggerListener 115]   - Command line argument: -Djava.util.logging.config.file=/home/user/che/ws-agent/conf/logging.properties
[STDOUT] 2016-03-10 23:35:00,839[main]             [INFO ] [o.a.c.s.VersionLoggerListener 115]   - Command line argument: -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
[STDOUT] 2016-03-10 23:35:00,842[main]             [INFO ] [o.a.c.s.VersionLoggerListener 115]   - Command line argument: -Xms256m
[STDOUT] 2016-03-10 23:35:00,843[main]             [INFO ] [o.a.c.s.VersionLoggerListener 115]   - Command line argument: -Xmx1024m
[STDOUT] 2016-03-10 23:35:00,846[main]             [INFO ] [o.a.c.s.VersionLoggerListener 115]   - Command line argument: -Djava.security.egd=file:/dev/./urandom
[STDOUT] 2016-03-10 23:35:00,847[main]             [INFO ] [o.a.c.s.VersionLoggerListener 115]   - Command line argument: -Dche.logs.dir=/home/user/che/ws-agent/logs
[STDOUT] 2016-03-10 23:35:00,849[main]             [INFO ] [o.a.c.s.VersionLoggerListener 115]   - Command line argument: -Dcom.sun.management.jmxremote
[STDOUT] 2016-03-10 23:35:00,850[main]             [INFO ] [o.a.c.s.VersionLoggerListener 115]   - Command line argument: -Dcom.sun.management.jmxremote.ssl=false
[STDOUT] 2016-03-10 23:35:00,850[main]             [INFO ] [o.a.c.s.VersionLoggerListener 115]   - Command line argument: -Dcom.sun.management.jmxremote.authenticate=false
[STDOUT] 2016-03-10 23:35:00,851[main]             [INFO ] [o.a.c.s.VersionLoggerListener 115]   - Command line argument: -Dche.local.conf.dir=/mnt/che/conf
[STDOUT] 2016-03-10 23:35:00,862[main]             [INFO ] [o.a.c.s.VersionLoggerListener 115]   - Command line argument: -agentlib:jdwp=transport=dt_socket,address=4403,server=y,suspend=n
[STDOUT] 2016-03-10 23:35:00,863[main]             [INFO ] [o.a.c.s.VersionLoggerListener 115]   - Command line argument: -Djava.endorsed.dirs=/home/user/che/ws-agent/endorsed
[STDOUT] 2016-03-10 23:35:00,864[main]             [INFO ] [o.a.c.s.VersionLoggerListener 115]   - Command line argument: -Dcatalina.base=/home/user/che/ws-agent
[STDOUT] 2016-03-10 23:35:00,871[main]             [INFO ] [o.a.c.s.VersionLoggerListener 115]   - Command line argument: -Dcatalina.home=/home/user/che/ws-agent
[STDOUT] 2016-03-10 23:35:00,871[main]             [INFO ] [o.a.c.s.VersionLoggerListener 115]   - Command line argument: -Djava.io.tmpdir=/home/user/che/ws-agent/temp
[STDOUT] 2016-03-10 23:35:01,208[main]             [INFO ] [o.a.c.http11.Http11NioProtocol 425]  - Initializing ProtocolHandler ["http-nio-4401"]
[STDOUT] 2016-03-10 23:35:01,237[main]             [INFO ] [o.a.t.util.net.NioSelectorPool 72]   - Using a shared selector for servlet write/read
[STDOUT] 2016-03-10 23:35:01,248[main]             [INFO ] [o.a.catalina.startup.Catalina 587]   - Initialization processed in 1172 ms
[STDOUT] 2016-03-10 23:35:01,304[main]             [INFO ] [c.m.JmxRemoteLifecycleListener 332]  - The JMX Remote Listener has configured the registry on port 32002 and the server on port 32102 for the Platform server
[STDOUT] 2016-03-10 23:35:01,305[main]             [INFO ] [o.a.c.core.StandardService 433]      - Starting service Catalina
[STDOUT] 2016-03-10 23:35:01,310[main]             [INFO ] [o.a.c.core.StandardEngine 259]       - Starting Servlet Engine: Apache Tomcat/8.0.29
[STDOUT] 2016-03-10 23:35:01,447[ost-startStop-1]  [INFO ] [o.a.c.startup.HostConfig 916]        - Deploying web application archive /home/user/che/ws-agent/webapps/ide.war
[STDOUT] Thu Mar 10 23:35:13 UTC 2016 - [localhost-startStop-1] Product-specified preferences called before plugin is started
[STDOUT] 2016-03-10 23:35:15,482[ost-startStop-1]  [ERROR] [piEndpointAccessibilityChecker 62]   - connect timed out
[STDOUT] java.net.SocketTimeoutException: connect timed out
[STDOUT]    at java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:1.8.0_45]
[STDOUT]    at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:345) ~[na:1.8.0_45]
[STDOUT]    at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) ~[na:1.8.0_45]
[STDOUT]    at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) ~[na:1.8.0_45]
[STDOUT]    at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[na:1.8.0_45]
[STDOUT]    at java.net.Socket.connect(Socket.java:589) ~[na:1.8.0_45]
[STDOUT]    at sun.net.NetworkClient.doConnect(NetworkClient.java:175) ~[na:1.8.0_45]
[STDOUT]    at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) ~[na:1.8.0_45]
[STDOUT]    at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) ~[na:1.8.0_45]
[STDOUT]    at sun.net.www.http.HttpClient.<init>(HttpClient.java:211) ~[na:1.8.0_45]
[STDOUT]    at sun.net.www.http.HttpClient.New(HttpClient.java:308) ~[na:1.8.0_45]
[STDOUT]    at sun.net.www.http.HttpClient.New(HttpClient.java:326) ~[na:1.8.0_45]
[STDOUT]    at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1168) ~[na:1.8.0_45]
[STDOUT]    at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1104) ~[na:1.8.0_45]
[STDOUT]    at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:998) ~[na:1.8.0_45]
[STDOUT]    at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:932) ~[na:1.8.0_45]
[STDOUT]    at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1512) ~[na:1.8.0_45]
[STDOUT]    at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1440) ~[na:1.8.0_45]
[STDOUT]    at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) ~[na:1.8.0_45]
[STDOUT]    at org.eclipse.che.api.core.rest.DefaultHttpJsonRequest.doRequest(DefaultHttpJsonRequest.java:239) ~[che-core-api-core-4.0.0-RC13.jar:4.0.0-RC13]
[STDOUT]    at org.eclipse.che.api.core.rest.DefaultHttpJsonRequest.request(DefaultHttpJsonRequest.java:145) ~[che-core-api-core-4.0.0-RC13.jar:4.0.0-RC13]
[STDOUT]    at org.eclipse.che.wsagent.server.ApiEndpointAccessibilityChecker.start(ApiEndpointAccessibilityChecker.java:57) ~[classes/:4.0.0-RC13]
[STDOUT]    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_45]
[STDOUT]    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_45]
[STDOUT]    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_45]
[STDOUT]    at java.lang.reflect.Method.invoke(Method.java:497) ~[na:1.8.0_45]
[STDOUT]    at org.eclipse.che.inject.lifecycle.InitModule$1$1.afterInjection(InitModule.java:44) [che-core-commons-inject-4.0.0-RC13.jar:4.0.0-RC13]
[STDOUT]    at com.google.inject.internal.MembersInjectorImpl.notifyListeners(MembersInjectorImpl.java:119) [guice-4.0.jar:na]
[STDOUT]    at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:115) [guice-4.0.jar:na]
[STDOUT]    at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:85) [guice-4.0.jar:na]
[STDOUT]    at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:267) [guice-4.0.jar:na]
[STDOUT]    at com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46) [guice-4.0.jar:na]
[STDOUT]    at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1103) [guice-4.0.jar:na]
[STDOUT]    at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40) [guice-4.0.jar:na]
[STDOUT]    at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:145) [guice-4.0.jar:na]
[STDOUT]    at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:41) [guice-4.0.jar:na]
[STDOUT]    at com.google.inject.internal.InternalInjectorCreator$1.call(InternalInjectorCreator.java:205) [guice-4.0.jar:na]
[STDOUT]    at com.google.inject.internal.InternalInjectorCreator$1.call(InternalInjectorCreator.java:199) [guice-4.0.jar:na]
[STDOUT]    at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1092) [guice-4.0.jar:na]
[STDOUT]    at com.google.inject.internal.InternalInjectorCreator.loadEagerSingletons(InternalInjectorCreator.java:199) [guice-4.0.jar:na]
[STDOUT]    at com.google.inject.internal.InternalInjectorCreator.injectDynamically(InternalInjectorCreator.java:180) [guice-4.0.jar:na]
[STDOUT]    at com.google.inject.internal.InternalInjectorCreator.build(InternalInjectorCreator.java:110) [guice-4.0.jar:na]
[STDOUT]    at com.google.inject.Guice.createInjector(Guice.java:96) [guice-4.0.jar:na]
[STDOUT]    at org.everrest.guice.servlet.EverrestGuiceContextListener.getInjector(EverrestGuiceContextListener.java:137) [everrest-integration-guice-1.12.1.jar:na]
[STDOUT]    at com.google.inject.servlet.GuiceServletContextListener.contextInitialized(GuiceServletContextListener.java:47) [guice-servlet-4.0.jar:na]
[STDOUT]    at org.everrest.guice.servlet.EverrestGuiceContextListener.contextInitialized(EverrestGuiceContextListener.java:84) [everrest-integration-guice-1.12.1.jar:na]
[STDOUT]    at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4793) [catalina.jar:8.0.29]
[STDOUT]    at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5236) [catalina.jar:8.0.29]
[STDOUT]    at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150) [catalina.jar:8.0.29]
[STDOUT]    at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:725) [catalina.jar:8.0.29]
[STDOUT]    at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:701) [catalina.jar:8.0.29]
[STDOUT]    at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:717) [catalina.jar:8.0.29]
[STDOUT]    at org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:945) [catalina.jar:8.0.29]
[STDOUT]    at org.apache.catalina.startup.HostConfig$DeployWar.run(HostConfig.java:1795) [catalina.jar:8.0.29]
[STDOUT]    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_45]
[STDOUT]    at java.util.concurrent.FutureTask.run(FutureTask.java:266) [na:1.8.0_45]
[STDOUT]    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_45]
[STDOUT]    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_45]
[STDOUT]    at java.lang.Thread.run(Thread.java:745) [na:1.8.0_45]
[STDOUT] 2016-03-10 23:35:15,494[ost-startStop-1]  [ERROR] [piEndpointAccessibilityChecker 65]   - The workspace agent has attempted to start, but it is unable to ping the Che server at http://che-host:8080/ide/api/
[STDOUT] 2016-03-10 23:35:15,496[ost-startStop-1]  [ERROR] [piEndpointAccessibilityChecker 66]   - The workspace agent has been forcefully stopped. This error happens when the agent cannot resolve the location of the Che server. This error can usually be fixed with additional configuration settings in /conf/che.properties. The Che server will stop this workspace after a short timeout. You can get help by posting your config, stacktrace and workspace /etc/hosts below as a GitHub issue.
[STDOUT] 2016-03-10 23:35:15,497[ost-startStop-1]  [INFO ] [piEndpointAccessibilityChecker 74]   - Workspace /etc/hosts: 127.0.0.1  localhost
[STDOUT] ::1    localhost ip6-localhost ip6-loopback
[STDOUT] fe00::0    ip6-localnet
[STDOUT] ff00::0    ip6-mcastprefix
[STDOUT] ff02::1    ip6-allnodes
[STDOUT] ff02::2    ip6-allrouters
[STDOUT] 192.168.99.1   che-host
[STDOUT] 172.17.0.2 32c45483c75c
[STDOUT] 
[ERROR] Timeout reached. The Che server has been unable to verify that your workspace's agent has successfully booted. Either the workspace is unreachable, the agent had an error during startup, or your workspace is starting slowly. You can configure machine.ws_agent.max_start_time_ms in Che properties to increase the timeout.

Observations:

  • I can ping http://localhost:8080/ide/api/
  • {"rootResources":[{"path":"project-template","regex":"/project-template(/.)?","fqn":"org.eclipse.che.api.project.server.ProjectTemplateService"},{"path":"event-bus","regex":"/event-bus(/.)?","fqn":"org.eclipse.che.api.core.notification.WSocketEventBusServer"},{"path":"/workspace","regex":"/workspace(/.)?","fqn":"org.eclipse.che.api.workspace.server.WorkspaceService"},{"path":"/machine","regex":"/machine(/.)?","fqn":"org.eclipse.che.api.machine.server.MachineService"},{"path":"/profile","regex":"/profile(/.)?","fqn":"org.eclipse.che.api.user.server.UserProfileService"},{"path":"/async/{ws-id}","regex":"/async/([^/]+?)(/.)?","fqn":"org.everrest.core.impl.async.AsynchronousJobService"},{"path":"/recipe","regex":"/recipe(/.)?","fqn":"org.eclipse.che.api.machine.server.recipe.RecipeService"},{"path":"oauth","regex":"/oauth(/.)?","fqn":"org.eclipse.che.security.oauth.OAuthAuthenticationService"},{"path":"/stack","regex":"/stack(/.)?","fqn":"org.eclipse.che.api.workspace.server.stack.StackService"},{"path":"/auth","regex":"/auth(/.)?","fqn":"org.eclipse.che.api.auth.AuthenticationService"},{"path":"/docs","regex":"/docs(/.)?","fqn":"org.eclipse.che.swagger.rest.SwaggerSpecificationService"},{"path":"/user","regex":"/user(/.)?","fqn":"org.eclipse.che.api.user.server.UserService"},{"path":"/ssh","regex":"/ssh(/.)?","fqn":"org.eclipse.che.api.ssh.server.SshService"},{"path":"/","regex":"(/.)?","fqn":"org.eclipse.che.api.core.rest.ApiInfoService"}]}
  • Could it really be looking for che-host:8080?
  • I tried creating C:\Users\Eric\AppData\Local\Eclipse Che\vfs\MyFirstWorkspace\etc\hosts with che-host, but that does not seem to work
@TylerJewell
Copy link

Hi @kolotyluk. I believe this is a netowrking configuration issue that you are running into. Any chance that you are running Che on a server that has different networks and IP addresses? It looks like Che is having a hard time resolving certain addresses.

You can see more about certain non-standard configurations here.
https://eclipse-che.readme.io/docs/networking

You wrote a great issue by the way. Very clear and provides all the background information.

@ghost
Copy link

ghost commented Mar 11, 2016

An error occurred trying to connect: Get http://localhost:2375/v1.21/version: dial tcp 127.0.0.1:2375: ConnectEx tcp: No connection could be made because the target machine actively refused it.

This means there's no connection to Docker deamon running insude a VM. However, the workspace has attempted to start anyway.

I see 192.168.99.1 che-host in /etc/hosts of a workspace container. There should be a VM IP address there. Does your default VM have this IP? If 99.1 is used it means that bridged IP is unavailable. Normally, it is 192.168.99.100

There are several ways to debug/fix this:

  1. Remove the VM.
  2. In Virtual Box, go to Setting > Networking and remove all host only adapters.
  3. Re-run Che.

If this does not help, in /conf/che.properties edit the following property:

machine.docker.che_api.endpoint=https://yourVMIP:8080/ide/api

Re-run Che. This way, a workspace agent will use your endpoint to connect to Che server

@kolotyluk
Copy link
Author

@TylerJewell here is my network configuration. I have VMWare Workstation installed which uses various bridged addresses. Could that be a problem?

C:\Users\Eric>ipconfig

Windows IP Configuration

Ethernet adapter Local Area Connection:

Media State . . . . . . . . . . . : Media disconnected
Connection-specific DNS Suffix . :

Ethernet adapter Local Area Connection 2:

Connection-specific DNS Suffix . : vc.shawcable.net
Link-local IPv6 Address . . . . . : fe80::a03d:b647:3650:8c27%10
IPv4 Address. . . . . . . . . . . : 192.168.0.100
Subnet Mask . . . . . . . . . . . : 255.255.255.0
Default Gateway . . . . . . . . . : 192.168.0.1

Ethernet adapter VirtualBox Host-Only Network:

Connection-specific DNS Suffix . :
Link-local IPv6 Address . . . . . : fe80::e868:d663:104a:1bd3%18
IPv4 Address. . . . . . . . . . . : 192.168.56.1
Subnet Mask . . . . . . . . . . . : 255.255.255.0
Default Gateway . . . . . . . . . :

Ethernet adapter VirtualBox Host-Only Network #2:

Connection-specific DNS Suffix . :
Link-local IPv6 Address . . . . . : fe80::e46e:ea96:14ee:dc27%26
IPv4 Address. . . . . . . . . . . : 192.168.99.1
Subnet Mask . . . . . . . . . . . : 255.255.255.0
Default Gateway . . . . . . . . . :

Ethernet adapter Ethernet:

Connection-specific DNS Suffix . :
Link-local IPv6 Address . . . . . : fe80::a8c4:7bb6:63ea:5a6d%5
IPv4 Address. . . . . . . . . . . : 192.168.64.1
Subnet Mask . . . . . . . . . . . : 255.255.255.0
Default Gateway . . . . . . . . . :

Ethernet adapter Ethernet 2:

Connection-specific DNS Suffix . :
Link-local IPv6 Address . . . . . : fe80::c13:1ead:a3fe:f004%2
IPv4 Address. . . . . . . . . . . : 192.168.75.1
Subnet Mask . . . . . . . . . . . : 255.255.255.0
Default Gateway . . . . . . . . . :

Tunnel adapter isatap.{25A57C09-C1AE-4B14-B631-687D1F7857E6}:

Media State . . . . . . . . . . . : Media disconnected
Connection-specific DNS Suffix . :

Tunnel adapter isatap.{4F33A72D-98A9-42C1-8A6E-E82274609F8C}:

Media State . . . . . . . . . . . : Media disconnected
Connection-specific DNS Suffix . :

Tunnel adapter isatap.vc.shawcable.net:

Media State . . . . . . . . . . . : Media disconnected
Connection-specific DNS Suffix . : vc.shawcable.net

Tunnel adapter isatap.{746AA24B-336E-45D4-9C2B-78F9FFB6F95C}:

Media State . . . . . . . . . . . : Media disconnected
Connection-specific DNS Suffix . :

Tunnel adapter isatap.{05237794-0A36-4169-8ED7-ECC7F66EF0A0}:

Media State . . . . . . . . . . . : Media disconnected
Connection-specific DNS Suffix . :

C:\Users\Eric>

@kolotyluk
Copy link
Author

@eivantsov I don't really have any docker experience, nor much VirtualBox experience either, Mostly I use VMWare Workstation. I'll try to follow your advice and see how far I get.

If worse comes to worse, I can always fire up Ubuntu in VMWare, and run Che in there.

@kolotyluk
Copy link
Author

@eivantsov I tried the 3 steps, but that did not help. I have tried changing

machine.docker.che_api.endpoint=https://192.168.99.1:8080/ide/api

but that does not help either. From my browser, I can get both 99.1 and 56.1, and they display a "Create Workspace" dialog. Apparently Che does not support /ide/api/ping, or is there some other ping resource?

@ghost
Copy link

ghost commented Mar 12, 2016

Sorry, I have misled you with https. It should be http: machine.docker.che_api.endpoint=http://192.168.99.100:8080/ide/api

I am not sure about 192.168.99.100 - it should be your VM IP address.

Did you try removing the VM and host-only network interfaces in VBox?

@kolotyluk
Copy link
Author

@eivantsov Do you mean remove all the network interfaces in VBox?

This can only be done after the new VM is created, but then they get recreated when I restart the che server. On the console it says "Docker is configured to use docker-vbox machine default with IP 192.168.99.102" I tried that in the che.properties, but same problem.

Sadly, I cannot copy paste from the Windows console because che puts out formatting characters that disable the 'mark' function in the console. This is a serious defect that needs to be corrected, otherwise reporting and troubleshooting is significantly more difficult.

At this point, troubleshooting this is beyond my ability. I would suggest someone set up a time when we can use Skype or Google Hangouts to share the screen and poke around. It would be nice to get the MS Windows problems sorted out before 4.0.0-RC.

@TylerJewell
Copy link

@kolotyluk I am interested in fixing this. I will hangout on a google hangout for the next hour here.
https://plus.google.com/hangouts/_/codenvy.com/tjewell?authuser=0

If you can join, I'd like to investigate.

@kolotyluk
Copy link
Author

[STDOUT] Listening for transport dt_socket at address: 4403
[STDOUT] 2016-03-12 19:52:05,222[main] [INFO ] [o.a.c.s.VersionLoggerListener 89] - Server version: Apache Tomcat/8.0.29
[STDOUT] 2016-03-12 19:52:05,224[main] [INFO ] [o.a.c.s.VersionLoggerListener 91] - Server built: Nov 20 2015 09:18:00 UTC
[STDOUT] 2016-03-12 19:52:05,225[main] [INFO ] [o.a.c.s.VersionLoggerListener 93] - Server number: 8.0.29.0
[STDOUT] 2016-03-12 19:52:05,225[main] [INFO ] [o.a.c.s.VersionLoggerListener 95] - OS Name: Linux
[STDOUT] 2016-03-12 19:52:05,225[main] [INFO ] [o.a.c.s.VersionLoggerListener 97] - OS Version: 4.1.19-boot2docker
[STDOUT] 2016-03-12 19:52:05,225[main] [INFO ] [o.a.c.s.VersionLoggerListener 99] - Architecture: amd64
[STDOUT] 2016-03-12 19:52:05,230[main] [INFO ] [o.a.c.s.VersionLoggerListener 101] - Java Home: /opt/jdk1.8.0_45/jre
[STDOUT] 2016-03-12 19:52:05,239[main] [INFO ] [o.a.c.s.VersionLoggerListener 103] - JVM Version: 1.8.0_45-b14
[STDOUT] 2016-03-12 19:52:05,240[main] [INFO ] [o.a.c.s.VersionLoggerListener 105] - JVM Vendor: Oracle Corporation
[STDOUT] 2016-03-12 19:52:05,241[main] [INFO ] [o.a.c.s.VersionLoggerListener 107] - CATALINA_BASE: /home/user/che/ws-agent
[STDOUT] 2016-03-12 19:52:05,241[main] [INFO ] [o.a.c.s.VersionLoggerListener 109] - CATALINA_HOME: /home/user/che/ws-agent
[STDOUT] 2016-03-12 19:52:05,242[main] [INFO ] [o.a.c.s.VersionLoggerListener 115] - Command line argument: -Djava.util.logging.config.file=/home/user/che/ws-agent/conf/logging.properties
[STDOUT] 2016-03-12 19:52:05,243[main] [INFO ] [o.a.c.s.VersionLoggerListener 115] - Command line argument: -Djava.util.logging.manager=org.apache.juli.ClassLoaderLogManager
[STDOUT] 2016-03-12 19:52:05,245[main] [INFO ] [o.a.c.s.VersionLoggerListener 115] - Command line argument: -Xms256m
[STDOUT] 2016-03-12 19:52:05,245[main] [INFO ] [o.a.c.s.VersionLoggerListener 115] - Command line argument: -Xmx1024m
[STDOUT] 2016-03-12 19:52:05,245[main] [INFO ] [o.a.c.s.VersionLoggerListener 115] - Command line argument: -Djava.security.egd=file:/dev/./urandom
[STDOUT] 2016-03-12 19:52:05,248[main] [INFO ] [o.a.c.s.VersionLoggerListener 115] - Command line argument: -Dche.logs.dir=/home/user/che/ws-agent/logs
[STDOUT] 2016-03-12 19:52:05,248[main] [INFO ] [o.a.c.s.VersionLoggerListener 115] - Command line argument: -Dcom.sun.management.jmxremote
[STDOUT] 2016-03-12 19:52:05,249[main] [INFO ] [o.a.c.s.VersionLoggerListener 115] - Command line argument: -Dcom.sun.management.jmxremote.ssl=false
[STDOUT] 2016-03-12 19:52:05,250[main] [INFO ] [o.a.c.s.VersionLoggerListener 115] - Command line argument: -Dcom.sun.management.jmxremote.authenticate=false
[STDOUT] 2016-03-12 19:52:05,250[main] [INFO ] [o.a.c.s.VersionLoggerListener 115] - Command line argument: -Dche.local.conf.dir=/mnt/che/conf
[STDOUT] 2016-03-12 19:52:05,251[main] [INFO ] [o.a.c.s.VersionLoggerListener 115] - Command line argument: -agentlib:jdwp=transport=dt_socket,address=4403,server=y,suspend=n
[STDOUT] 2016-03-12 19:52:05,251[main] [INFO ] [o.a.c.s.VersionLoggerListener 115] - Command line argument: -Djava.endorsed.dirs=/home/user/che/ws-agent/endorsed
[STDOUT] 2016-03-12 19:52:05,251[main] [INFO ] [o.a.c.s.VersionLoggerListener 115] - Command line argument: -Dcatalina.base=/home/user/che/ws-agent
[STDOUT] 2016-03-12 19:52:05,251[main] [INFO ] [o.a.c.s.VersionLoggerListener 115] - Command line argument: -Dcatalina.home=/home/user/che/ws-agent
[STDOUT] 2016-03-12 19:52:05,252[main] [INFO ] [o.a.c.s.VersionLoggerListener 115] - Command line argument: -Djava.io.tmpdir=/home/user/che/ws-agent/temp
[STDOUT] 2016-03-12 19:52:05,582[main] [INFO ] [o.a.c.http11.Http11NioProtocol 425] - Initializing ProtocolHandler ["http-nio-4401"]
[STDOUT] 2016-03-12 19:52:05,634[main] [INFO ] [o.a.t.util.net.NioSelectorPool 72] - Using a shared selector for servlet write/read
[STDOUT] 2016-03-12 19:52:05,638[main] [INFO ] [o.a.catalina.startup.Catalina 587] - Initialization processed in 1116 ms
[STDOUT] 2016-03-12 19:52:05,683[main] [INFO ] [c.m.JmxRemoteLifecycleListener 332] - The JMX Remote Listener has configured the registry on port 32002 and the server on port 32102 for the Platform server
[STDOUT] 2016-03-12 19:52:05,683[main] [INFO ] [o.a.c.core.StandardService 433] - Starting service Catalina
[STDOUT] 2016-03-12 19:52:05,684[main] [INFO ] [o.a.c.core.StandardEngine 259] - Starting Servlet Engine: Apache Tomcat/8.0.29
[STDOUT] 2016-03-12 19:52:05,830[ost-startStop-1] [INFO ] [o.a.c.startup.HostConfig 916] - Deploying web application archive /home/user/che/ws-agent/webapps/ide.war
[STDOUT] 2016-03-12 19:52:20,529[ost-startStop-1] [ERROR] [piEndpointAccessibilityChecker 62] - connect timed out
[STDOUT] java.net.SocketTimeoutException: connect timed out
[STDOUT] at java.net.PlainSocketImpl.socketConnect(Native Method) ~[na:1.8.0_45]
[STDOUT] at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:345) ~[na:1.8.0_45]
[STDOUT] at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206) ~[na:1.8.0_45]
[STDOUT] at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188) ~[na:1.8.0_45]
[STDOUT] at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) ~[na:1.8.0_45]
[STDOUT] at java.net.Socket.connect(Socket.java:589) ~[na:1.8.0_45]
[STDOUT] at sun.net.NetworkClient.doConnect(NetworkClient.java:175) ~[na:1.8.0_45]
[STDOUT] at sun.net.www.http.HttpClient.openServer(HttpClient.java:432) ~[na:1.8.0_45]
[STDOUT] at sun.net.www.http.HttpClient.openServer(HttpClient.java:527) ~[na:1.8.0_45]
[STDOUT] at sun.net.www.http.HttpClient.(HttpClient.java:211) ~[na:1.8.0_45]
[STDOUT] at sun.net.www.http.HttpClient.New(HttpClient.java:308) ~[na:1.8.0_45]
[STDOUT] at sun.net.www.http.HttpClient.New(HttpClient.java:326) ~[na:1.8.0_45]
[STDOUT] at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1168) ~[na:1.8.0_45]
[STDOUT] at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1104) ~[na:1.8.0_45]
[STDOUT] at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:998) ~[na:1.8.0_45]
[STDOUT] at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:932) ~[na:1.8.0_45]
[STDOUT] at sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1512) ~[na:1.8.0_45]
[STDOUT] at sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1440) ~[na:1.8.0_45]
[STDOUT] at java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:480) ~[na:1.8.0_45]
[STDOUT] at org.eclipse.che.api.core.rest.DefaultHttpJsonRequest.doRequest(DefaultHttpJsonRequest.java:239) ~[che-core-api-core-4.0.0-RC13.jar:4.0.0-RC13]
[STDOUT] at org.eclipse.che.api.core.rest.DefaultHttpJsonRequest.request(DefaultHttpJsonRequest.java:145) ~[che-core-api-core-4.0.0-RC13.jar:4.0.0-RC13]
[STDOUT] at org.eclipse.che.wsagent.server.ApiEndpointAccessibilityChecker.start(ApiEndpointAccessibilityChecker.java:57) ~[classes/:4.0.0-RC13]
[STDOUT] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_45]
[STDOUT] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_45]
[STDOUT] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_45]
[STDOUT] at java.lang.reflect.Method.invoke(Method.java:497) ~[na:1.8.0_45]
[STDOUT] at org.eclipse.che.inject.lifecycle.InitModule$1$1.afterInjection(InitModule.java:44) [che-core-commons-inject-4.0.0-RC13.jar:4.0.0-RC13]
[STDOUT] at com.google.inject.internal.MembersInjectorImpl.notifyListeners(MembersInjectorImpl.java:119) [guice-4.0.jar:na]
[STDOUT] at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:115) [guice-4.0.jar:na]
[STDOUT] at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:85) [guice-4.0.jar:na]
[STDOUT] at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:267) [guice-4.0.jar:na]
[STDOUT] at com.google.inject.internal.ProviderToInternalFactoryAdapter$1.call(ProviderToInternalFactoryAdapter.java:46) [guice-4.0.jar:na]
[STDOUT] at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1103) [guice-4.0.jar:na]
[STDOUT] at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40) [guice-4.0.jar:na]
[STDOUT] at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:145) [guice-4.0.jar:na]
[STDOUT] at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:41) [guice-4.0.jar:na]
[STDOUT] at com.google.inject.internal.InternalInjectorCreator$1.call(InternalInjectorCreator.java:205) [guice-4.0.jar:na]
[STDOUT] at com.google.inject.internal.InternalInjectorCreator$1.call(InternalInjectorCreator.java:199) [guice-4.0.jar:na]
[STDOUT] at com.google.inject.internal.InjectorImpl.callInContext(InjectorImpl.java:1092) [guice-4.0.jar:na]
[STDOUT] at com.google.inject.internal.InternalInjectorCreator.loadEagerSingletons(InternalInjectorCreator.java:199) [guice-4.0.jar:na]
[STDOUT] at com.google.inject.internal.InternalInjectorCreator.injectDynamically(InternalInjectorCreator.java:180) [guice-4.0.jar:na]
[STDOUT] at com.google.inject.internal.InternalInjectorCreator.build(InternalInjectorCreator.java:110) [guice-4.0.jar:na]
[STDOUT] at com.google.inject.Guice.createInjector(Guice.java:96) [guice-4.0.jar:na]
[STDOUT] at org.everrest.guice.servlet.EverrestGuiceContextListener.getInjector(EverrestGuiceContextListener.java:137) [everrest-integration-guice-1.12.1.jar:na]
[STDOUT] at com.google.inject.servlet.GuiceServletContextListener.contextInitialized(GuiceServletContextListener.java:47) [guice-servlet-4.0.jar:na]
[STDOUT] at org.everrest.guice.servlet.EverrestGuiceContextListener.contextInitialized(EverrestGuiceContextListener.java:84) [everrest-integration-guice-1.12.1.jar:na]
[STDOUT] at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4793) [catalina.jar:8.0.29]
[STDOUT] at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5236) [catalina.jar:8.0.29]
[STDOUT] at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150) [catalina.jar:8.0.29]
[STDOUT] at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:725) [catalina.jar:8.0.29]
[STDOUT] at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:701) [catalina.jar:8.0.29]
[STDOUT] at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:717) [catalina.jar:8.0.29]
[STDOUT] at org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:945) [catalina.jar:8.0.29]
[STDOUT] at org.apache.catalina.startup.HostConfig$DeployWar.run(HostConfig.java:1795) [catalina.jar:8.0.29]
[STDOUT] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_45]
[STDOUT] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [na:1.8.0_45]
[STDOUT] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_45]
[STDOUT] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_45]
[STDOUT] at java.lang.Thread.run(Thread.java:745) [na:1.8.0_45]
[STDOUT] 2016-03-12 19:52:20,535[ost-startStop-1] [ERROR] [piEndpointAccessibilityChecker 65] - The workspace agent has attempted to start, but it is unable to ping the Che server at http://che-host:8080/ide/api/
[STDOUT] 2016-03-12 19:52:20,536[ost-startStop-1] [ERROR] [piEndpointAccessibilityChecker 66] - The workspace agent has been forcefully stopped. This error happens when the agent cannot resolve the location of the Che server. This error can usually be fixed with additional configuration settings in /conf/che.properties. The Che server will stop this workspace after a short timeout. You can get help by posting your config, stacktrace and workspace /etc/hosts below as a GitHub issue.
[STDOUT] 2016-03-12 19:52:20,538[ost-startStop-1] [INFO ] [piEndpointAccessibilityChecker 74] - Workspace /etc/hosts: 127.0.0.1 localhost
[STDOUT] ::1 localhost ip6-localhost ip6-loopback
[STDOUT] fe00::0 ip6-localnet
[STDOUT] ff00::0 ip6-mcastprefix
[STDOUT] ff02::1 ip6-allnodes
[STDOUT] ff02::2 ip6-allrouters
[STDOUT] 192.168.99.1 che-host
[STDOUT] 172.17.0.2 02d7c723e77a
[STDOUT]

@TylerJewell
Copy link

@garagatyi @eivantsov So in a debugging session we were able to get the system to work. However, the solution was not obvious and this could be an improvement we add to the system.

  1. The VP IP address was 192.168.99.100. The VM is alive and the environment can connect to it so you can run docker ps.
  2. However, this IP address does not seem to be reachable from the ws-agent back to the che server.
  3. When doing an ipconfig, the IP address of his adapter is 192.168.0.100. When we updated the che.properties to use this adapter IP address, then the connection was made.

Perhaps we should cycle through the IP addresses of all adapters?

@TylerJewell TylerJewell added kind/question Questions that haven't been identified as being feature requests or bugs. dev labels Mar 12, 2016
@ghost
Copy link

ghost commented Mar 13, 2016

The problem is that 192.168.99.1:8080 returns nothing. On my Win machine, I can either go to localhost:8080 or 192.168.99.1:8080 to access Che.

@pavan5000
Copy link

I am having same issue like @kolotyluk had. What was the configuration updates made in che.properties to work the system?

@ghost
Copy link

ghost commented Mar 15, 2016

machine.docker.che_api.endpoint=http://${eth0}:8080/ide/api

where ${eth0} is IP of your eth0 network interface
@pavan5000 can you share the entire stacktrace? Or is it identical to the one shared above?

@pavan5000
Copy link

@eivantsov i can share entire stacktrace if that helpful to you. But it is identical to the one shared above. I will give a try what you suggested.

@TylerJewell
Copy link

@pavan5000 If you are on windows, please do an ipconfig and get the list of all IP addresses for your adapters. The issue that @kolotyluk had was that the default IP address returned by virtualbox for the newly created VM is not the IP address that your system is using. So you want to update machine.docker.che_api.endpoint with the right value that comes from your ipconfig command.

@ghost
Copy link

ghost commented Mar 16, 2016

For some reason the default 192.168.99.1 does not work on some Win systems, especially with multiple network adapters.

@pavan5000
Copy link

Ethernet adapter VirtualBox Host-Only Network:

Connection-specific DNS Suffix . :
Description . . . . . . . . . . . : VirtualBox Host-Only Ethernet Adapter
Physical Address. . . . . . . . . : 0A-00-27-00-00-00
DHCP Enabled. . . . . . . . . . . : No
Autoconfiguration Enabled . . . . : Yes
Link-local IPv6 Address . . . . . : fe80::e56d:db:70fa:ad45%15(Preferred)
IPv4 Address. . . . . . . . . . . : 192.168.56.1(Preferred)
Subnet Mask . . . . . . . . . . . : 255.255.255.0
Default Gateway . . . . . . . . . :
DHCPv6 IAID . . . . . . . . . . . : 269090855
DHCPv6 Client DUID. . . . . . . . : 00-01-00-01-19-44-8E-F8-28-D2-44-12-EB-F7
DNS Servers . . . . . . . . . . . : fec0:0:0:ffff::1%1
fec0:0:0:ffff::2%1
fec0:0:0:ffff::3%1
NetBIOS over Tcpip. . . . . . . . : Enabled

Ethernet adapter VirtualBox Host-Only Network #2:

Connection-specific DNS Suffix . :
Description . . . . . . . . . . . : VirtualBox Host-Only Ethernet Adapter #2
Physical Address. . . . . . . . . : 0A-00-27-00-00-00
DHCP Enabled. . . . . . . . . . . : No
Autoconfiguration Enabled . . . . : Yes
Link-local IPv6 Address . . . . . : fe80::39d9:75b4:2116:1a98%11(Preferred)
IPv4 Address. . . . . . . . . . . : 192.168.99.1(Preferred)
Subnet Mask . . . . . . . . . . . : 255.255.255.0
Default Gateway . . . . . . . . . :
DHCPv6 IAID . . . . . . . . . . . : 487194663
DHCPv6 Client DUID. . . . . . . . : 00-01-00-01-19-44-8E-F8-28-D2-44-12-EB-F7
DNS Servers . . . . . . . . . . . : fec0:0:0:ffff::1%1
fec0:0:0:ffff::2%1
fec0:0:0:ffff::3%1
NetBIOS over Tcpip. . . . . . . . : Enabled

I had two virtual hosts in my PC. After switching Ip address to 192.168.56.1:8080 it started working fine. Thanks for the help.

@TylerJewell
Copy link

@pavan5000 Hey - I am really happy to see this working for you. I am going to close the issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/question Questions that haven't been identified as being feature requests or bugs.
Projects
None yet
Development

No branches or pull requests

3 participants