Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[QUESTION] kvrocks process crash sometimes in kvrocks cluster. #570

Closed
erwadba opened this issue May 10, 2022 · 4 comments
Closed

[QUESTION] kvrocks process crash sometimes in kvrocks cluster. #570

erwadba opened this issue May 10, 2022 · 4 comments

Comments

@erwadba
Copy link

erwadba commented May 10, 2022

Env: 6 same server 4c 16G

# uname -a
Linux kvrocks-0001 3.10.0-1160.53.1.el7.x86_64 #1 SMP Fri Jan 14 13:59:45 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
# cat /etc/redhat-release 
CentOS Linux release 7.8.2003 (Core)
# 
10.181.130.15:6666> cluster nodes
kvrockskvrockskvrockskvrockskvrocksnode6 10.181.130.52:6666@16666 slave kvrockskvrockskvrockskvrockskvrocksnode5 1652168487999 1652168488000 1 connected
kvrockskvrockskvrockskvrockskvrocksnode5 10.181.130.154:6666@16666 master - 1652168487999 1652168488000 1 connected 10993-16383
kvrockskvrockskvrockskvrockskvrocksnode3 10.181.130.248:6666@16666 master - 1652168487999 1652168488000 1 connected 5461-10992
kvrockskvrockskvrockskvrockskvrocksnode4 10.181.130.194:6666@16666 slave kvrockskvrockskvrockskvrockskvrocksnode3 1652168487999 1652168488000 1 connected
kvrockskvrockskvrockskvrockskvrocksnode2 10.181.130.188:6666@16666 slave kvrockskvrockskvrockskvrockskvrocksnode1 1652168487999 1652168488000 1 connected
kvrockskvrockskvrockskvrockskvrocksnode1 10.181.130.15:6666@16666 myself,master - 1652168487999 1652168488000 1 connected 0-5460
10.181.130.15:6666>

Problem:
kvrocks process crash sometimes. The kernel error like this

May 10 14:44:01 kvrocks-0001 systemd: Started Session 28215 of user root.
May 10 14:44:02 kvrocks-0001 kernel: traps: worker[8996] general protection ip:886515 sp:7fc215bef530 error:0 in kvrocks[400000+5c6000]
May 10 14:45:01 kvrocks-0001 systemd: Started Session 28216 of user root.
@ShooterIT
Copy link
Member

do you have core dump stack trace?

@erwadba
Copy link
Author

erwadba commented May 10, 2022

I find the server not open core dump.
[root@kvrocks-0001 kvrocks]# addr2line -e /www/kvrocks/bin/kvrocks 886515
/__w/kvrocks/kvrocks/external/jemalloc/include/jemalloc/internal/pai.h:36
[root@kvrocks-0001 kvrocks]#

This is kvorcks one node conf.
kvrocks.conf.txt

@ShooterIT
Copy link
Member

Hi @erwadba from current messages, i have no idea to catch. Please open core dump, and reproduce it

@tisonkun
Copy link
Member

Closed as stale. You can ask questions at the Discussions forum.

@tisonkun tisonkun closed this as not planned Won't fix, can't repro, duplicate, stale Sep 11, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants