Corosync / Cman with IP_VS : Missing dlm module : CONFIG_DLM=m #281

hvenzke · 2013-04-23T23:09:53Z

... this going Crasy.. ocfs2_dlm enabled without the base linux dlm

This shuold be enabled per default allways : CONFIG_DLM=m

root@lb1:~# service cman start

Starting cluster:
   Checking Network Manager... [  OK  ]
   Global setup... [  OK  ]
   Loading kernel modules... FATAL: Module dlm not found.
[FAILED]

root@lb1:~# find /lib/modules | grep -i dlm
/lib/modules/3.8.8+/kernel/fs/ocfs2/dlm
/lib/modules/3.8.8+/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko
/lib/modules/3.8.8+/kernel/fs/ocfs2/dlmfs
/lib/modules/3.8.8+/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko
/lib/modules/3.6.11+/kernel/fs/ocfs2/dlm
/lib/modules/3.6.11+/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko
/lib/modules/3.6.11+/kernel/fs/ocfs2/dlmfs
/lib/modules/3.6.11+/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko

root@lb2:~# service cman start
Starting cluster:
   Checking Network Manager... [  OK  ]
   Global setup... [  OK  ]
   Loading kernel modules... [  OK  ]
   Mounting configfs... [  OK  ]
   Starting cman... [  OK  ]
   Waiting for quorum... [  OK  ]
   Starting fenced... [  OK  ]
   Starting dlm_controld... [  OK  ]
   Starting gfs_controld... [  OK  ]
   Unfencing self... [  OK  ]
   Joining fence domain... [  OK  ]

root@lb2:~# lsmod
Module                  Size  Used by


dlm                   138857  7
sctp                  188067  3 dlm

ip_vs_wrr               2260  1
ip_vs_wlc               1433  1
ip_vs_sh                2589  0
ip_vs_sed               1483  0
ip_vs_rr                1634  0
ip_vs_nq                1492  0
ip_vs_lc                1436  0
ip_vs_lblcr             6889  0
ip_vs_lblc              4909  0
ip_vs_dh                2295  0
ip_vs                 158484  23 ip_vs_dh,ip_vs_lc,ip_vs_nq,ip_vs_rr,ip_vs_sh,ip_vs_sed,ip_vs_wlc,ip_vs_wrr,ip_vs_lblcr,ip_vs_lblc
nf_conntrack           83599  1 ip_vs


root@lb2:~#  find /lib/modules | grep -i dlm
/lib/modules/3.8.4+/kernel/fs/ocfs2/dlm
/lib/modules/3.8.4+/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko
/lib/modules/3.8.4+/kernel/fs/ocfs2/dlmfs
/lib/modules/3.8.4+/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko
/lib/modules/3.8.7-4-raspberrypi/kernel/fs/dlm
/lib/modules/3.8.7-4-raspberrypi/kernel/fs/dlm/dlm.ko
/lib/modules/3.8.7-4-raspberrypi/kernel/fs/ocfs2/dlm
/lib/modules/3.8.7-4-raspberrypi/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko
/lib/modules/3.8.7-4-raspberrypi/kernel/fs/ocfs2/dlmfs
/lib/modules/3.8.7-4-raspberrypi/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko
/lib/modules/3.6.11+/kernel/fs/ocfs2/dlm
/lib/modules/3.6.11+/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko
/lib/modules/3.6.11+/kernel/fs/ocfs2/dlmfs
/lib/modules/3.6.11+/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko
root@lb2:~#

hvenzke · 2013-05-09T13:02:30Z

patch for that :

--- config-3.8.y        2013-05-09 15:00:09.305888785 +0200
+++ config-3.8.12       2013-05-09 15:01:17.042195938 +0200
@@ -3126,7 +3126,7 @@
 # CONFIG_NLS_MAC_ROMANIAN is not set
 # CONFIG_NLS_MAC_TURKISH is not set
 CONFIG_NLS_UTF8=m
-# CONFIG_DLM is not set
+CONFIG_DLM=m
 #
 # Kernel hacking

hvenzke · 2013-12-22T16:57:40Z

@popcornmix and others Please add the kernelmodule dlm the rasberian FIRMWARE !!

popcornmix · 2013-12-23T23:53:51Z

It's in 3.10.y firmware:

$ zcat /proc/config.gz |grep DLM
CONFIG_DLM=m

hvenzke · 2013-12-24T00:24:29Z

sorry - more clear :
it´s not in rasberian´s Firmware.
as up now i still have to use the 3.10.y firmware or newer instead the default rasberian installed.
my complains with modules was not going in that was i assumed past 6 month.

popcornmix · 2013-12-24T01:22:07Z

It should be in latest "apt-get upgrade" firmware.
It will be in next sdcard image.

hvenzke · 2013-12-24T13:23:21Z

@popcornmix
Nice to hear that .

it was not in at default 3.10.24 rasberian from apt-get distupgrade done ~ 12.12.2013

can you kindly check that the IPVS modules as well that they are permanently going into rasberian´s Firmware.

Why i realy want to have this :
As my Corosync/ldirectord/heartbeat3 Loadbalancer aka Linux Cluster run rasberian ;
any updates must come from apt without manualy changes.
Manualy Udates on corosync etc pp are an horrible job.

Heartbeat-3 Infrastruckture espacaily the cman require that dlm & IPVS modules for startup .

popcornmix · 2013-12-24T14:32:25Z

The default kernel has
CONFIG_IP_VS=m
I believe latest apt-get kernel is "Thu Dec 19".

hvenzke · 2013-12-24T16:58:39Z

Thanks

this are required for Linux HA Clusters ( + that depends on that ):

zcat /proc/config.gz | grep -i ip_vs
CONFIG_IP_VS=m
# CONFIG_IP_VS_IPV6 is not set
# CONFIG_IP_VS_DEBUG is not set
CONFIG_IP_VS_TAB_BITS=12
CONFIG_IP_VS_PROTO_TCP=y
CONFIG_IP_VS_PROTO_UDP=y
CONFIG_IP_VS_PROTO_AH_ESP=y
CONFIG_IP_VS_PROTO_ESP=y
CONFIG_IP_VS_PROTO_AH=y
CONFIG_IP_VS_PROTO_SCTP=y
CONFIG_IP_VS_RR=m
CONFIG_IP_VS_WRR=m
CONFIG_IP_VS_LC=m
CONFIG_IP_VS_WLC=m
CONFIG_IP_VS_LBLC=m
CONFIG_IP_VS_LBLCR=m
CONFIG_IP_VS_DH=m
CONFIG_IP_VS_SH=m
CONFIG_IP_VS_SED=m
CONFIG_IP_VS_NQ=m
CONFIG_IP_VS_SH_TAB_BITS=8
CONFIG_IP_VS_FTP=m
CONFIG_IP_VS_NFCT=y
CONFIG_IP_VS_PE_SIP=m

popcornmix · 2013-12-24T17:32:57Z

Latest firmware has:

pi@raspberrypi ~ $ zcat /proc/config.gz | grep -i ip_vs
CONFIG_IP_VS=m
# CONFIG_IP_VS_IPV6 is not set
# CONFIG_IP_VS_DEBUG is not set
CONFIG_IP_VS_TAB_BITS=12
CONFIG_IP_VS_PROTO_TCP=y
CONFIG_IP_VS_PROTO_UDP=y
CONFIG_IP_VS_PROTO_AH_ESP=y
CONFIG_IP_VS_PROTO_ESP=y
CONFIG_IP_VS_PROTO_AH=y
CONFIG_IP_VS_PROTO_SCTP=y
CONFIG_IP_VS_RR=m
CONFIG_IP_VS_WRR=m
CONFIG_IP_VS_LC=m
CONFIG_IP_VS_WLC=m
CONFIG_IP_VS_LBLC=m
CONFIG_IP_VS_LBLCR=m
CONFIG_IP_VS_DH=m
CONFIG_IP_VS_SH=m
CONFIG_IP_VS_SED=m
CONFIG_IP_VS_NQ=m
CONFIG_IP_VS_SH_TAB_BITS=8
CONFIG_IP_VS_FTP=m
CONFIG_IP_VS_NFCT=y
CONFIG_IP_VS_PE_SIP=m

[ Upstream commit 54d8791 ] The user_entry_size is supplied by the user and later used as a denominator to calculate number of entries. The zero supplied by the user will trigger the following divide-by-zero error: divide error: 0000 [raspberrypi#1] SMP KASAN PTI CPU: 4 PID: 497 Comm: c_repro Not tainted 5.13.0-rc1+ raspberrypi#281 Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.13.0-0-gf21b5a4aeb02-prebuilt.qemu.org 04/01/2014 RIP: 0010:ib_uverbs_handler_UVERBS_METHOD_QUERY_GID_TABLE+0x1b1/0x510 Code: 87 59 03 00 00 e8 9f ab 1e ff 48 8d bd a8 00 00 00 e8 d3 70 41 ff 44 0f b7 b5 a8 00 00 00 e8 86 ab 1e ff 31 d2 4c 89 f0 31 ff <49> f7 f5 48 89 d6 48 89 54 24 10 48 89 04 24 e8 1b ad 1e ff 48 8b RSP: 0018:ffff88810416f828 EFLAGS: 00010246 RAX: 0000000000000008 RBX: 1ffff1102082df09 RCX: ffffffff82183f3d RDX: 0000000000000000 RSI: ffff888105f2da00 RDI: 0000000000000000 RBP: ffff88810416fa98 R08: 0000000000000001 R09: ffffed102082df5f R10: ffff88810416faf7 R11: ffffed102082df5e R12: 0000000000000000 R13: 0000000000000000 R14: 0000000000000008 R15: ffff88810416faf0 FS: 00007f5715efa740(0000) GS:ffff88811a700000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 0000000020000840 CR3: 000000010c2e0001 CR4: 0000000000370ea0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Call Trace: ? ib_uverbs_handler_UVERBS_METHOD_INFO_HANDLES+0x4b0/0x4b0 ib_uverbs_cmd_verbs+0x1546/0x1940 ib_uverbs_ioctl+0x186/0x240 __x64_sys_ioctl+0x38a/0x1220 do_syscall_64+0x3f/0x80 entry_SYSCALL_64_after_hwframe+0x44/0xae Fixes: 9f85cbe ("RDMA/uverbs: Expose the new GID query API to user space") Link: https://lore.kernel.org/r/b971cc70a8b240a8b5eda33c99fa0558a0071be2.1620657876.git.leonro@nvidia.com Reviewed-by: Jason Gunthorpe <jgg@nvidia.com> Signed-off-by: Leon Romanovsky <leonro@nvidia.com> Signed-off-by: Jason Gunthorpe <jgg@nvidia.com> Signed-off-by: Sasha Levin <sashal@kernel.org>

[ Upstream commit 54d8791 ] The user_entry_size is supplied by the user and later used as a denominator to calculate number of entries. The zero supplied by the user will trigger the following divide-by-zero error: divide error: 0000 [#1] SMP KASAN PTI CPU: 4 PID: 497 Comm: c_repro Not tainted 5.13.0-rc1+ #281 Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.13.0-0-gf21b5a4aeb02-prebuilt.qemu.org 04/01/2014 RIP: 0010:ib_uverbs_handler_UVERBS_METHOD_QUERY_GID_TABLE+0x1b1/0x510 Code: 87 59 03 00 00 e8 9f ab 1e ff 48 8d bd a8 00 00 00 e8 d3 70 41 ff 44 0f b7 b5 a8 00 00 00 e8 86 ab 1e ff 31 d2 4c 89 f0 31 ff <49> f7 f5 48 89 d6 48 89 54 24 10 48 89 04 24 e8 1b ad 1e ff 48 8b RSP: 0018:ffff88810416f828 EFLAGS: 00010246 RAX: 0000000000000008 RBX: 1ffff1102082df09 RCX: ffffffff82183f3d RDX: 0000000000000000 RSI: ffff888105f2da00 RDI: 0000000000000000 RBP: ffff88810416fa98 R08: 0000000000000001 R09: ffffed102082df5f R10: ffff88810416faf7 R11: ffffed102082df5e R12: 0000000000000000 R13: 0000000000000000 R14: 0000000000000008 R15: ffff88810416faf0 FS: 00007f5715efa740(0000) GS:ffff88811a700000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 0000000020000840 CR3: 000000010c2e0001 CR4: 0000000000370ea0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Call Trace: ? ib_uverbs_handler_UVERBS_METHOD_INFO_HANDLES+0x4b0/0x4b0 ib_uverbs_cmd_verbs+0x1546/0x1940 ib_uverbs_ioctl+0x186/0x240 __x64_sys_ioctl+0x38a/0x1220 do_syscall_64+0x3f/0x80 entry_SYSCALL_64_after_hwframe+0x44/0xae Fixes: 9f85cbe ("RDMA/uverbs: Expose the new GID query API to user space") Link: https://lore.kernel.org/r/b971cc70a8b240a8b5eda33c99fa0558a0071be2.1620657876.git.leonro@nvidia.com Reviewed-by: Jason Gunthorpe <jgg@nvidia.com> Signed-off-by: Leon Romanovsky <leonro@nvidia.com> Signed-off-by: Jason Gunthorpe <jgg@nvidia.com> Signed-off-by: Sasha Levin <sashal@kernel.org>

notro mentioned this issue Dec 29, 2014

PR and issue list purging? #751

Closed

popcornmix closed this as completed Dec 29, 2014

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Corosync / Cman with IP_VS : Missing dlm module : CONFIG_DLM=m #281

Corosync / Cman with IP_VS : Missing dlm module : CONFIG_DLM=m #281

hvenzke commented Apr 23, 2013

hvenzke commented May 9, 2013

hvenzke commented Dec 22, 2013

popcornmix commented Dec 23, 2013

hvenzke commented Dec 24, 2013

popcornmix commented Dec 24, 2013

hvenzke commented Dec 24, 2013

popcornmix commented Dec 24, 2013

hvenzke commented Dec 24, 2013

popcornmix commented Dec 24, 2013

Corosync / Cman with IP_VS : Missing dlm module : CONFIG_DLM=m #281

Corosync / Cman with IP_VS : Missing dlm module : CONFIG_DLM=m #281

Comments

hvenzke commented Apr 23, 2013

hvenzke commented May 9, 2013

hvenzke commented Dec 22, 2013

popcornmix commented Dec 23, 2013

hvenzke commented Dec 24, 2013

popcornmix commented Dec 24, 2013

hvenzke commented Dec 24, 2013

popcornmix commented Dec 24, 2013

hvenzke commented Dec 24, 2013

popcornmix commented Dec 24, 2013