-
Notifications
You must be signed in to change notification settings - Fork 111
Mesh Node Dies #377
Comments
@pointtoken Mesh should be able to run indefinitely and we have some nodes with an uptime of over 2 weeks. Can you share more information so we can help debug any possible issues? Do you see any errors in the logs? |
We've been up 25 hours to date, so maybe it was a bug in an earlier build. Where would we find the log files? We are running detached with verbosity = 1 |
Mesh just outputs logs to stdout, so you can use
|
thanks. bug seems to be fixed in the latest version. |
I'm reopening this as our node died after about 4 days. @albrow how does one get at the logs from a container that no longer exists? |
@pointtoken can you share more information about your setup?
If For our own infrastructure, we pipe all logs to Elasticsearch and Kiabana so we always have a way to search them even if the Docker container is not running. If you want, you can opt-in to send us your logs by following this guide then we could help you debug any potential issues. Alternatively you could use a simple bash script to redirect the output from Docker to a file. E.g., something like: # Don't forget to include any needed environment variables.
docker run 0xorg/mesh:3.0.1-beta > /file/on/host/machine |
It is running in an EC2 container. Here's the command used:
Running the latest image that's been pushed to DockerHub. Seems to die after about 48 hours. |
@pointtoken what version of Mesh are you running? Also are you able to see any logs and if so can you share them with me? Without seeing the logs there is no way for me to understand what is happening to your node. One thing I realized is that technically Mesh logs go to stderr instead of stdout. Both stderr and stdout appear in the terminal when running a command but it does make a difference if you are trying to redirect the output. If you are using the
Are you able to monitor resource usage? Do you see anything abnormal happening with CPU or memory usage? |
Possibly related: #452. |
@pointtoken we haven't heard from you in two months, so I'm closing this issue for now. If you are still having problems and are able to share any additional information, I'd be happy to re-open it. |
What is the expected uptime for a mesh node? Ours seems to die after 8 hours. We are running the latest from DockerHub on a VM with 1 Gig ram. Thoughts?
The text was updated successfully, but these errors were encountered: