Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Query and all-in-one generates error message on SIGINT #1542

Closed
pavolloffay opened this issue May 16, 2019 · 3 comments · Fixed by #1598 or #1601
Closed

Query and all-in-one generates error message on SIGINT #1542

pavolloffay opened this issue May 16, 2019 · 3 comments · Fixed by #1598 or #1601
Labels
bug help wanted Features that maintainers are willing to accept but do not have cycles to implement

Comments

@pavolloffay
Copy link
Member

Jaeger 1.12.0 query/all-in-one generates 2 error messages on shutdown (SIGINT):

{"level":"error","ts":1557924794.5416982,"caller":"app/server.go:127","msg":"Could not start multiplexed server","error":"accept tcp [::]:16686: use of closed network connection","stacktrace":"github.com/jaegertracing/jaeger/cmd/query/app.(*Server).Start.func3\n\t/home/ploffay/projects/golang/src/github.com/jaegertracing/jaeger/cmd/query/app/server.go:127"}

{"level":"error","ts":1557924794.5418048,"caller":"app/server.go:109","msg":"Could not start HTTP server","error":"http: Server closed","stacktrace":"github.com/jaegertracing/jaeger/cmd/query/app.(*Server).Start.func1\n\t/home/ploffay/projects/golang/src/github.com/jaegertracing/jaeger/cmd/query/app/server.go:109"}

Those messages should not be there as it is a normal termination of the process.

Jaeger 1.11.0 output

{"level":"info","ts":1557923870.4618723,"caller":"healthcheck/handler.go:99","msg":"Health Check server started","http-port":14269,"status":"unavailable"}
{"level":"info","ts":1557923870.4620156,"caller":"memory/factory.go:55","msg":"Memory storage configuration","configuration":{"MaxTraces":0}}
{"level":"info","ts":1557923870.4621208,"caller":"static/strategy_store.go:79","msg":"No sampling strategies provided, using defaults"}
WARNING: 2019/05/15 14:37:50 grpc: addrConn.createTransport failed to connect to {127.0.0.1:14250 0  <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:14250: connect: connection refused". Reconnecting...
{"level":"info","ts":1557923870.4652264,"caller":"all-in-one/main.go:211","msg":"Starting agent"}
{"level":"info","ts":1557923870.465499,"caller":"app/agent.go:68","msg":"Starting jaeger-agent HTTP server","http-port":5778}
{"level":"info","ts":1557923870.465974,"caller":"all-in-one/main.go:253","msg":"Starting jaeger-collector TChannel server","port":14267}
{"level":"info","ts":1557923870.466026,"caller":"grpcserver/grpc_server.go:64","msg":"Starting jaeger-collector gRPC server","grpc-port":"14250"}
{"level":"info","ts":1557923870.4660544,"caller":"all-in-one/main.go:271","msg":"Starting jaeger-collector HTTP server","http-port":14268}
{"level":"info","ts":1557923870.4660826,"caller":"all-in-one/main.go:399","msg":"Archive storage not created","reason":"Archive storage not supported"}
{"level":"info","ts":1557923870.4677374,"caller":"all-in-one/main.go:360","msg":"Registering metrics handler with jaeger-query HTTP server","route":"/metrics"}
{"level":"info","ts":1557923870.4677625,"caller":"all-in-one/main.go:366","msg":"Starting jaeger-query HTTP server","port":16686}
{"level":"info","ts":1557923870.4677749,"caller":"healthcheck/handler.go:133","msg":"Health Check state change","status":"ready"}
^C{"level":"info","ts":1557923873.034265,"caller":"all-in-one/main.go:149","msg":"Shutting down"}
{"level":"info","ts":1557923873.0343597,"caller":"all-in-one/main.go:157","msg":"Shutdown complete"}

Jaeger 1.12.0 output

{"level":"info","ts":1557924790.7362473,"caller":"flags/service.go:113","msg":"Mounting metrics handler on admin server","route":"/metrics"}
{"level":"info","ts":1557924790.7364206,"caller":"flags/admin.go:108","msg":"Mounting health check on admin server","route":"/"}
{"level":"info","ts":1557924790.7364788,"caller":"flags/admin.go:114","msg":"Starting admin HTTP server","http-port":14269}
{"level":"info","ts":1557924790.736494,"caller":"flags/admin.go:100","msg":"Admin server started","http-port":14269,"health-status":"unavailable"}
{"level":"info","ts":1557924790.7381833,"caller":"memory/factory.go:55","msg":"Memory storage initialized","configuration":{"MaxTraces":0}}
{"level":"info","ts":1557924790.7383587,"caller":"static/strategy_store.go:79","msg":"No sampling strategies provided, using defaults"}
{"level":"info","ts":1557924790.7411678,"caller":"grpc/builder.go:75","msg":"Agent requested insecure grpc connection to collector(s)"}
WARNING: 2019/05/15 14:53:10 grpc: addrConn.createTransport failed to connect to {127.0.0.1:14250 0  <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:14250: connect: connection refused". Reconnecting...
{"level":"info","ts":1557924790.7417045,"caller":"all-in-one/main.go:195","msg":"Starting agent"}
{"level":"info","ts":1557924790.7418346,"caller":"app/agent.go:68","msg":"Starting jaeger-agent HTTP server","http-port":5778}
{"level":"info","ts":1557924790.742618,"caller":"all-in-one/main.go:238","msg":"Starting jaeger-collector TChannel server","port":14267}
{"level":"info","ts":1557924790.7426636,"caller":"grpcserver/grpc_server.go:64","msg":"Starting jaeger-collector gRPC server","grpc-port":"14250"}
{"level":"info","ts":1557924790.742699,"caller":"all-in-one/main.go:256","msg":"Starting jaeger-collector HTTP server","http-port":14268}
{"level":"info","ts":1557924790.7427151,"caller":"querysvc/query_service.go:130","msg":"Archive storage not created","reason":"archive storage not supported"}
{"level":"info","ts":1557924790.742728,"caller":"all-in-one/main.go:338","msg":"Archive storage not initialized"}
{"level":"info","ts":1557924790.7431312,"caller":"healthcheck/handler.go:129","msg":"Health Check state change","status":"ready"}
{"level":"info","ts":1557924790.743133,"caller":"app/server.go:107","msg":"Starting HTTP server","port":16686}
{"level":"info","ts":1557924790.7431507,"caller":"app/server.go:125","msg":"Starting CMUX server","port":16686}
{"level":"info","ts":1557924790.743178,"caller":"app/server.go:116","msg":"Starting GRPC server","port":16686}
^C{"level":"info","ts":1557924794.5406473,"caller":"flags/service.go:143","msg":"Shutting down"}
{"level":"info","ts":1557924794.5407808,"caller":"healthcheck/handler.go:129","msg":"Health Check state change","status":"unavailable"}
{"level":"error","ts":1557924794.5416982,"caller":"app/server.go:127","msg":"Could not start multiplexed server","error":"accept tcp [::]:16686: use of closed network connection","stacktrace":"github.com/jaegertracing/jaeger/cmd/query/app.(*Server).Start.func3\n\t/home/ploffay/projects/golang/src/github.com/jaegertracing/jaeger/cmd/query/app/server.go:127"}
{"level":"info","ts":1557924794.54186,"caller":"flags/service.go:151","msg":"Shutdown complete"}
{"level":"error","ts":1557924794.5418048,"caller":"app/server.go:109","msg":"Could not start HTTP server","error":"http: Server closed","stacktrace":"github.com/jaegertracing/jaeger/cmd/query/app.(*Server).Start.func1\n\t/home/ploffay/projects/golang/src/github.com/jaegertracing/jaeger/cmd/query/app/server.go:109"}
@tobeabme
Copy link

tobeabme commented Jun 4, 2019

I also encountered the same problem as you.

@yurishkuro yurishkuro added the help wanted Features that maintainers are willing to accept but do not have cycles to implement label Jun 4, 2019
@yurishkuro
Copy link
Member

The PR did not fix the issue.

@vprithvi
Copy link
Contributor

On an unrelated note, where does the non-json log line come from - WARNING: 2019/05/15 14:53:10 grpc: addrConn.createTransport failed to connect to {127.0.0.1:14250 0 <nil>}. Err :connection error: desc = "transport: Error while dialing dial tcp 127.0.0.1:14250: connect: connection refused". Reconnecting...

I created #1602 to discuss

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug help wanted Features that maintainers are willing to accept but do not have cycles to implement
Projects
None yet
4 participants