Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

node crashed #150

Closed
zozyo opened this issue Jul 21, 2022 · 8 comments
Closed

node crashed #150

zozyo opened this issue Jul 21, 2022 · 8 comments

Comments

@zozyo
Copy link
Contributor

zozyo commented Jul 21, 2022

====================                                                                                                           
                                                                                                                               
Version: 0.1.16-82d9a956a2b                                                                                                    
                                                                                                                               
   0: sp_panic_handler::set::{{closure}}                                                                                       
   1: std::panicking::rust_panic_with_hook                                                                                     
             at /rustc/0677edc86e342f333d4828b0ee1ef395a4e70fe5/library/std/src/panicking.rs:702:17                            
   2: std::panicking::begin_panic::{{closure}}                                                                                 
   3: std::sys_common::backtrace::__rust_end_short_backtrace                                                                   
   4: std::panicking::begin_panic                                                                                              
   5: <quicksink::SinkImpl<S,F,T,A,E> as futures_sink::Sink<A>>::poll_flush                                                    
   6: <libp2p::bandwidth::BandwidthConnecLogging<TInner> as futures_io::if_std::AsyncWrite>::poll_flush                        
   7: <libp2p_noise::io::framed::NoiseFramed<T,S> as futures_sink::Sink<&alloc::vec::Vec<u8>>>::poll_flush                     
   8: <libp2p_noise::io::NoiseOutput<T> as futures_io::if_std::AsyncWrite>::poll_flush                                         
   9: multistream_select::negotiated::Negotiated<TInner>::poll                                                                 
  10: <multistream_select::negotiated::Negotiated<TInner> as futures_io::if_std::AsyncWrite>::poll_close                       
  11: yamux::connection::into_stream::{{closure}}::{{closure}}                                                                 
  12: <futures_util::stream::try_stream::ErrInto<St,E> as futures_core::stream::Stream>::poll_next                             
  13: <libp2p_core::muxing::Wrap<T> as libp2p_core::muxing::StreamMuxer>::poll_close                                           
  14: <futures_util::future::poll_fn::PollFn<F> as core::future::future::Future>::poll                                         
  15: tokio::runtime::task::harness::poll_future                                                                               
  16: tokio::runtime::task::raw::poll                                                                                          
  17: tokio::runtime::thread_pool::worker::Context::run_task                                                                   
  18: tokio::runtime::thread_pool::worker::run                                                                                 
  19: tokio::runtime::task::raw::poll                                                                                          
  20: std::sys_common::backtrace::__rust_begin_short_backtrace                                                                 
  21: core::ops::function::FnOnce::call_once{{vtable.shim}}                                                                    
  22: <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once                                          [4/933]
             at /rustc/0677edc86e342f333d4828b0ee1ef395a4e70fe5/library/alloc/src/boxed.rs:1861:9
      <alloc::boxed::Box<F,A> as core::ops::function::FnOnce<Args>>::call_once
             at /rustc/0677edc86e342f333d4828b0ee1ef395a4e70fe5/library/alloc/src/boxed.rs:1861:9
      std::sys::unix::thread::Thread::new::thread_start
             at /rustc/0677edc86e342f333d4828b0ee1ef395a4e70fe5/library/std/src/sys/unix/thread.rs:108:17
  23: start_thread
  24: clone


Thread 'tokio-runtime-worker' panicked at 'SinkImpl::poll_flush called after error.', /root/.cargo/registry/src/github.com-1ecc
6299db9ec823/quicksink-0.1.2/src/lib.rs:225

This is a bug. Please report it at:

        https://github.com/Phala-Network/khala-parachain/issues/new

./start_node.sh: line 70:     9 Segmentation fault      (core dumped) /usr/local/bin/khala-node --chain $PARACHAIN --base-path 
$DATA_PATH --name $NODE_NAME --port $PARACHAIN_PORT --prometheus-port 9615 --rpc-port 9933 --ws-port 9944 --prometheus-external
 --ws-external --rpc-cors all --no-hardware-benchmarks $PARACHAIN_ROLE_ARGS $PARACHAIN_EXTRA_ARGS -- --chain $RELAYCHAIN --port
 $RELAYCHAIN_PORT --prometheus-port 9616 --rpc-port 9934 --ws-port 9945 --prometheus-external --ws-external --rpc-cors all --no
-hardware-benchmarks $RELAYCHAIN_ROLE_ARGS $RELAYCHAIN_EXTRA_ARGS
@jasl
Copy link
Contributor

jasl commented Jul 21, 2022

Known issue #138
have to wait libp2p fixes

@jasl
Copy link
Contributor

jasl commented Jul 25, 2022

Hi can you show me your memory usage when running khala-node?

@zozyo
Copy link
Contributor Author

zozyo commented Jul 25, 2022

CONTAINER ID   NAME         CPU %     MEM USAGE / LIMIT     MEM %     NET I/O          BLOCK I/O         PIDS
948e79c3a2f6   phala-node   106.31%   28.84GiB / 125.7GiB   22.95%    816GB / 4.88TB   2.33TB / 2.99TB   218

@zozyo
Copy link
Contributor Author

zozyo commented Jul 25, 2022

20220725225723

@jasl
Copy link
Contributor

jasl commented Aug 11, 2022

latest khala-node fixed this
phalanetwork/khala-node:v0.1.17
DIGEST:sha256:d69bbc8cdecf152a891f5c1b32028da680b51ca716443207136ffc824a191ff7
WARNING: once upgrade, you can't downgrade to previous version

@jasl jasl closed this as completed Aug 11, 2022
@wowvwow
Copy link

wowvwow commented Sep 20, 2022

image

0.1.17的node镜像,bug复现

@wowvwow
Copy link

wowvwow commented Sep 20, 2022

image

@jasl
Copy link
Contributor

jasl commented Sep 20, 2022

image

0.1.17的node镜像,bug复现

不是一个问题,你这个是 WASM 虚拟机崩了,重启node应该可以接着跑,看是不是频繁出现

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants