Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unable to handle kernel paging request on avl_walk #6220

Closed
tuomari opened this issue Jun 12, 2017 · 3 comments
Closed

Unable to handle kernel paging request on avl_walk #6220

tuomari opened this issue Jun 12, 2017 · 3 comments

Comments

@tuomari
Copy link

tuomari commented Jun 12, 2017

System information

Type Version/Name
Distribution Name Debian
Distribution Version 8.7 (Jessie)
Linux Kernel 4.9.20
Architecture amd64
ZFS Version 7.0-RC3 84c07ad +ntrim2
SPL Version 7.0-RC3 bf8abea

Describe the problem you're observing

I was hitting some strange stacktraces and zfs problems with my system and payload (see #4895, #5071, #5226, #5429 and #5910). The system was up for maximum of two days before crashing. After upgrading to these versions the system was stable for almost two months, after which I got the following stacktrace:

Jun 10 16:11:07 helvi kernel: [5767162.001696] BUG: unable to handle kernel paging request at 000000009b9da09d
Jun 10 16:11:07 helvi kernel: [5767162.001781] IP: [<ffffffffa00e202e>] avl_walk+0x2e/0x60 [zavl]
Jun 10 16:11:07 helvi kernel: [5767162.001865] PGD 0 
Jun 10 16:11:07 helvi kernel: [5767162.001878] 
Jun 10 16:11:07 helvi kernel: [5767162.001946] Oops: 0000 [#1] SMP
Jun 10 16:11:07 helvi kernel: [5767162.002013] Modules linked in: usb_storage binfmt_misc iscsi_target_mod target_core_mod 8021q garp ipt_MASQUERADE nf_nat_masquerade_ipv4 xfrm_user xfrm_algo iptable_nat xt_addrtype iptable_filter ip_tables xt_conntrack x_tables br_netfilter bridge stp llc dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio loop openvswitch nf_conntrack_ipv6 nf_nat_ipv6 nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_defrag_ipv6 nf_nat nf_conntrack configfs nfsd auth_rpcgss oid_registry nfs_acl nfs lockd grace sunrpc zfs(PO) zunicode(PO) zavl(PO) icp(PO) iTCO_wdt gpio_ich iTCO_vendor_support crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 ablk_helper cryptd lrw gf128mul glue_helper serio_raw pcspkr i2c_i801 i2c_smbus ast ftdi_sio bttv usbserial ttm tveeprom videobuf_dma_sg drm_kms_helper
Jun 10 16:11:07 helvi kernel: [5767162.003034]  tea575x syscopyarea videobuf_core sysfillrect rc_core sysimgblt v4l2_common fb_sys_fops drm videodev snd_hda_intel agpgart media snd_hda_codec lpc_ich mfd_core snd_hda_core snd_pcm btrfs snd_timer zcommon(PO) snd soundcore znvpair(PO) i7core_edac ioatdma spl(O) dca zlib_deflate i5500_temp edac_core ipmi_si ipmi_msghandler shpchp evdev acpi_cpufreq tpm_tis tpm_tis_core tpm w83795 w83627ehf hwmon_vid coretemp autofs4 hid_generic usbhid hid crc32c_intel psmouse uhci_hcd ehci_pci ehci_hcd usbcore usb_common sg sd_mod
Jun 10 16:11:07 helvi kernel: [5767162.003769] CPU: 2 PID: 1446 Comm: z_wr_iss Tainted: P           O    4.9.20.iudex.kvm.ovs.1 #1
Jun 10 16:11:07 helvi kernel: [5767162.003888] Hardware name: System manufacturer System Product Name/Z8NA-D6(C), BIOS 1303    05/10/2012
Jun 10 16:11:07 helvi kernel: [5767162.004011] task: ffff880421450000 task.stack: ffffc90005fa0000
Jun 10 16:11:07 helvi kernel: [5767162.004078] RIP: 0010:[<ffffffffa00e202e>]  [<ffffffffa00e202e>] avl_walk+0x2e/0x60 [zavl]
Jun 10 16:11:07 helvi kernel: [5767162.004175] RSP: 0018:ffffc90005fa3b38  EFLAGS: 00010202
Jun 10 16:11:07 helvi kernel: [5767162.004246] RAX: 000000009b9da09d RBX: ffff88002a903700 RCX: 0000000000000000
Jun 10 16:11:07 helvi kernel: [5767162.004350] RDX: 000000009b9da09d RSI: ffff88002a903700 RDI: ffff88002a903700
Jun 10 16:11:07 helvi kernel: [5767162.004458] RBP: ffffc90005fa3b38 R08: 0000000000000000 R09: 0000000000000000
Jun 10 16:11:07 helvi kernel: [5767162.004543] R10: 0000000000000000 R11: 0000000000000001 R12: 0000000000028000
Jun 10 16:11:07 helvi kernel: [5767162.004665] R13: ffff88082858a800 R14: 0000064ccbbc6000 R15: ffff88082ba44b00
Jun 10 16:11:07 helvi kernel: [5767162.007623] FS:  0000000000000000(0000) GS:ffff88042fc80000(0000) knlGS:0000000000000000
Jun 10 16:11:07 helvi kernel: [5767162.007725] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jun 10 16:11:07 helvi kernel: [5767162.007790] CR2: 000000009b9da09d CR3: 0000000001c08000 CR4: 00000000000006e0
Jun 10 16:11:07 helvi kernel: [5767162.007896] Stack:
Jun 10 16:11:07 helvi kernel: [5767162.007940]  ffffc90005fa3bc0 ffffffffa10d5653 ffff88082ba44800 ffffc90005fa3b70
Jun 10 16:11:07 helvi kernel: [5767162.008051]  0000000000000246 ffffc90005fa3ba0 ffffffff816d47e9 ffffffff811cd06c
Jun 10 16:11:07 helvi kernel: [5767162.008175]  0000000000000246 ffff88042f803040 0000064cab64e000 0000064cab676000
Jun 10 16:11:07 helvi kernel: [5767162.008305] Call Trace:
Jun 10 16:11:07 helvi kernel: [5767162.008432]  [<ffffffffa10d5653>] metaslab_block_picker.constprop.19+0xa3/0x100 [zfs]
Jun 10 16:11:07 helvi kernel: [5767162.008560]  [<ffffffff816d47e9>] ? __mutex_unlock_slowpath+0xa9/0x140
Jun 10 16:11:07 helvi kernel: [5767162.008632]  [<ffffffff811cd06c>] ? __kmalloc_node+0x20c/0x2c0
Jun 10 16:11:07 helvi kernel: [5767162.008734]  [<ffffffffa10d61f0>] metaslab_df_alloc+0x90/0xd0 [zfs]
Jun 10 16:11:07 helvi kernel: [5767162.008821]  [<ffffffffa10d8529>] metaslab_alloc+0x649/0xe60 [zfs]
Jun 10 16:11:07 helvi kernel: [5767162.008928]  [<ffffffffa1143f6c>] zio_dva_allocate+0xac/0x560 [zfs]
Jun 10 16:11:07 helvi kernel: [5767162.008997]  [<ffffffff816d7129>] ? _raw_spin_unlock+0x9/0x10
Jun 10 16:11:07 helvi kernel: [5767162.009070]  [<ffffffffa01bcc20>] ? tsd_hash_search.isra.0+0x70/0x90 [spl]
Jun 10 16:11:07 helvi kernel: [5767162.009143]  [<ffffffffa01bccb9>] ? tsd_get_by_thread+0x29/0x40 [spl]
Jun 10 16:11:07 helvi kernel: [5767162.009197]  [<ffffffffa01b7633>] ? taskq_member+0x13/0x20 [spl]
Jun 10 16:11:07 helvi kernel: [5767162.009307]  [<ffffffffa1140507>] zio_execute+0x97/0x100 [zfs]
Jun 10 16:11:07 helvi kernel: [5767162.009372]  [<ffffffffa01b84df>] taskq_thread+0x25f/0x490 [spl]
Jun 10 16:11:07 helvi kernel: [5767162.009435]  [<ffffffff810d1140>] ? wake_up_q+0x70/0x70
Jun 10 16:11:07 helvi kernel: [5767162.009502]  [<ffffffffa01b8280>] ? taskq_cancel_id+0x110/0x110 [spl]
Jun 10 16:11:07 helvi kernel: [5767162.009555]  [<ffffffff810c7069>] kthread+0xe9/0x100
Jun 10 16:11:07 helvi kernel: [5767162.009609]  [<ffffffff810c6f80>] ? kthread_park+0x60/0x60
Jun 10 16:11:07 helvi kernel: [5767162.009705]  [<ffffffff816d75d2>] ret_from_fork+0x22/0x30
Jun 10 16:11:07 helvi kernel: [5767162.009776] Code: 47 10 b9 01 00 00 00 29 d1 48 89 e5 4c 01 c6 48 85 f6 74 40 48 63 d2 48 89 f7 48 8b 04 d6 48 85 c0 74 1a 48 63 c9 eb 03 48 89 d0 <48> 8b 14 c8 48 85 d2 75 f4 4c 29 c0 5d c3 39 ca 74 f7 48 8b 47 
Jun 10 16:11:07 helvi kernel: [5767162.010097] RIP  [<ffffffffa00e202e>] avl_walk+0x2e/0x60 [zavl]
Jun 10 16:11:07 helvi kernel: [5767162.010165]  RSP <ffffc90005fa3b38>
Jun 10 16:11:07 helvi kernel: [5767162.010221] CR2: 000000009b9da09d
Jun 10 16:11:07 helvi kernel: [5767162.010587] ---[ end trace df26484b3ebdf0b3 ]---
Jun 10 16:11:07 helvi kernel: [5767162.010700] BUG: unable to handle kernel NULL pointer dereference at 0000000000000009
Jun 10 16:11:07 helvi kernel: [5767162.010920] IP: [<ffffffff810e4885>] __wake_up_common+0x25/0x80
Jun 10 16:11:07 helvi kernel: [5767162.011063] PGD 0 
Jun 10 16:11:07 helvi kernel: [5767162.011105] 
Jun 10 16:11:07 helvi kernel: [5767162.011221] Oops: 0000 [#2] SMP
Jun 10 16:11:07 helvi kernel: [5767162.011307] Modules linked in: usb_storage binfmt_misc iscsi_target_mod target_core_mod 8021q garp ipt_MASQUERADE nf_nat_masquerade_ipv4 xfrm_user xfrm_algo iptable_nat xt_addrtype iptable_filter ip_tables xt_conntrack x_tables br_netfilter bridge stp llc dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio loop openvswitch nf_conntrack_ipv6 nf_nat_ipv6 nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_defrag_ipv6 nf_nat nf_conntrack configfs nfsd auth_rpcgss oid_registry nfs_acl nfs lockd grace sunrpc zfs(PO) zunicode(PO) zavl(PO) icp(PO) iTCO_wdt gpio_ich iTCO_vendor_support crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 ablk_helper cryptd lrw gf128mul glue_helper serio_raw pcspkr i2c_i801 i2c_smbus ast ftdi_sio bttv usbserial ttm tveeprom videobuf_dma_sg drm_kms_helper
Jun 10 16:11:07 helvi kernel: [5767162.014671]  tea575x syscopyarea videobuf_core sysfillrect rc_core sysimgblt v4l2_common fb_sys_fops drm videodev snd_hda_intel agpgart media snd_hda_codec lpc_ich mfd_core snd_hda_core snd_pcm btrfs snd_timer zcommon(PO) snd soundcore znvpair(PO) i7core_edac ioatdma spl(O) dca zlib_deflate i5500_temp edac_core ipmi_si ipmi_msghandler shpchp evdev acpi_cpufreq tpm_tis tpm_tis_core tpm w83795 w83627ehf hwmon_vid coretemp autofs4 hid_generic usbhid hid crc32c_intel psmouse uhci_hcd ehci_pci ehci_hcd usbcore usb_common sg sd_mod
Jun 10 16:11:07 helvi kernel: [5767162.017216] CPU: 2 PID: 1446 Comm: z_wr_iss Tainted: P      D    O    4.9.20.iudex.kvm.ovs.1 #1
Jun 10 16:11:07 helvi kernel: [5767162.017369] Hardware name: System manufacturer System Product Name/Z8NA-D6(C), BIOS 1303    05/10/2012
Jun 10 16:11:07 helvi kernel: [5767162.017522] task: ffff880421450000 task.stack: ffffc90005fa0000
Jun 10 16:11:07 helvi kernel: [5767162.017617] RIP: 0010:[<ffffffff810e4885>]  [<ffffffff810e4885>] __wake_up_common+0x25/0x80
Jun 10 16:11:07 helvi kernel: [5767162.017800] RSP: 0018:ffffc90005fa3e50  EFLAGS: 00010086
Jun 10 16:11:07 helvi kernel: [5767162.017894] RAX: 0000000000000286 RBX: ffffc90005fa3f08 RCX: 0000000000000000
Jun 10 16:11:07 helvi kernel: [5767162.018030] RDX: 0000000000000009 RSI: 0000000000000003 RDI: ffffc90005fa3f08
Jun 10 16:11:07 helvi kernel: [5767162.018174] RBP: ffffc90005fa3e88 R08: 0000000000000000 R09: 0000000000000000
Jun 10 16:11:07 helvi kernel: [5767162.018321] R10: 0000000000000740 R11: ffffffff81882500 R12: ffffc90005fa3f08
Jun 10 16:11:07 helvi kernel: [5767162.018440] R13: 0000000000000286 R14: 0000000000000000 R15: 0000000000000003
Jun 10 16:11:07 helvi kernel: [5767162.018575] FS:  0000000000000000(0000) GS:ffff88042fc80000(0000) knlGS:0000000000000000
Jun 10 16:11:07 helvi kernel: [5767162.018720] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jun 10 16:11:07 helvi kernel: [5767162.018805] CR2: 0000000000000009 CR3: 0000000001c08000 CR4: 00000000000006e0
Jun 10 16:11:07 helvi kernel: [5767162.018951] Stack:
Jun 10 16:11:07 helvi kernel: [5767162.019030]  0000000100000740 0000000000000000 ffffc90005fa3f08 ffffc90005fa3f00
Jun 10 16:11:07 helvi kernel: [5767162.019331]  0000000000000286 0000000000000000 000000000000000b ffffc90005fa3e98
Jun 10 16:11:07 helvi kernel: [5767162.019617]  ffffffff810e48ee ffffc90005fa3ec0 ffffffff810e52c2 ffff880421450640
Jun 10 16:11:07 helvi kernel: [5767162.019911] Call Trace:
Jun 10 16:11:07 helvi kernel: [5767162.019991]  [<ffffffff810e48ee>] __wake_up_locked+0xe/0x10
Jun 10 16:11:07 helvi kernel: [5767162.020094]  [<ffffffff810e52c2>] complete+0x32/0x50
Jun 10 16:11:07 helvi kernel: [5767162.020199]  [<ffffffff810a75f0>] mm_release+0xb0/0x130
Jun 10 16:11:07 helvi kernel: [5767162.020295]  [<ffffffff810ad4d2>] do_exit+0x132/0xb10
Jun 10 16:11:07 helvi kernel: [5767162.020386]  [<ffffffff816d9297>] rewind_stack_do_exit+0x17/0x20
Jun 10 16:11:07 helvi kernel: [5767162.020502] Code: 00 00 00 00 00 90 55 48 89 e5 41 57 41 89 f7 41 56 41 89 ce 41 55 41 54 49 89 fc 53 48 83 ec 10 89 55 cc 48 8b 57 18 4c 89 45 d0 <4c> 8b 02 48 8d 42 e8 48 39 c7 4d 8d 68 e8 75 05 eb 34 49 89 d5 
Jun 10 16:11:07 helvi kernel: [5767162.023297] RIP  [<ffffffff810e4885>] __wake_up_common+0x25/0x80
Jun 10 16:11:07 helvi kernel: [5767162.023436]  RSP <ffffc90005fa3e50>
Jun 10 16:11:07 helvi kernel: [5767162.023523] CR2: 0000000000000009
Jun 10 16:11:07 helvi kernel: [5767162.023617] ---[ end trace df26484b3ebdf0b4 ]---
Jun 10 16:11:07 helvi kernel: [5767162.023722] Fixing recursive fault but reboot is needed!
@tuomari
Copy link
Author

tuomari commented Jul 11, 2017

I just noticed that I have scrub running (since 2017-06-20), which might be also a factor.

@tuomari
Copy link
Author

tuomari commented Jul 20, 2017

Another bug from the same system. This time with

kernel 4.9.36 and ZFS version 0.7.0-rc4_103_ge19572e4c

Jul 20 09:40:05 helvi kernel: [17518.957544] BUG: unable to handle kernel paging request at 0000000049809491
Jul 20 09:40:05 helvi kernel: [17518.957604] IP: [<ffffffffa012702e>] avl_walk+0x2e/0x60 [zavl]
Jul 20 09:40:05 helvi kernel: [17518.957641] PGD 0 
Jul 20 09:40:05 helvi kernel: [17518.957651] 
Jul 20 09:40:05 helvi kernel: [17518.957665] Oops: 0000 [#1] SMP
Jul 20 09:40:05 helvi kernel: [17518.957680] Modules linked in: binfmt_misc iscsi_target_mod target_core_mod 8021q garp ipt_MASQUERADE nf_nat_masquerade_ipv4 xfrm_user xfrm_algo iptable_nat xt_addrtype iptable_filter ip_tables xt_conntrack x_tables br_netfilter bridge stp llc dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio loop openvswitch nf_conntrack_ipv6 nf_nat_ipv6 nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_defrag_ipv6 nf_nat nf_conntrack configfs nfsd auth_rpcgss oid_registry nfs_acl nfs lockd grace sunrpc zfs(PO) zunicode(PO) zavl(PO) icp(PO) iTCO_wdt iTCO_vendor_support gpio_ich usb_storage crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 ablk_helper cryptd lrw gf128mul glue_helper pcspkr serio_raw i2c_i801 i2c_smbus ftdi_sio usbserial bttv tveeprom videobuf_dma_sg tea575x videobuf_core
Jul 20 09:40:05 helvi kernel: [17518.958239]  rc_core v4l2_common ast videodev ttm media drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops drm snd_hda_intel snd_hda_codec agpgart snd_hda_core snd_pcm lpc_ich mfd_core snd_timer snd soundcore zcommon(PO) btrfs znvpair(PO) i7core_edac ioatdma spl(O) zlib_deflate i5500_temp dca edac_core shpchp ipmi_si ipmi_msghandler evdev acpi_cpufreq tpm_tis tpm_tis_core tpm w83795 w83627ehf hwmon_vid coretemp autofs4 hid_generic usbhid hid crc32c_intel psmouse ehci_pci uhci_hcd ehci_hcd usbcore usb_common sg sd_mod
Jul 20 09:40:05 helvi kernel: [17518.958682] CPU: 7 PID: 1462 Comm: z_wr_iss Tainted: P           O    4.9.36.iudex.kvm.ovs.1 #2
Jul 20 09:40:05 helvi kernel: [17518.958840] Hardware name: System manufacturer System Product Name/Z8NA-D6(C), BIOS 1303    05/10/2012
Jul 20 09:40:05 helvi kernel: [17518.958995] task: ffff88082c722340 task.stack: ffffc90005d18000
Jul 20 09:40:05 helvi kernel: [17518.959091] RIP: 0010:[<ffffffffa012702e>]  [<ffffffffa012702e>] avl_walk+0x2e/0x60 [zavl]
Jul 20 09:40:05 helvi kernel: [17518.959224] RSP: 0018:ffffc90005d1bb00  EFLAGS: 00010202
Jul 20 09:40:05 helvi kernel: [17518.959301] RAX: 0000000049809491 RBX: 0000000000028000 RCX: 0000000000000000
Jul 20 09:40:05 helvi kernel: [17518.959389] RDX: 0000000049809491 RSI: ffff8800205957c0 RDI: ffff8800205957c0
Jul 20 09:40:05 helvi kernel: [17518.959493] RBP: ffffc90005d1bb00 R08: 0000000000000000 R09: 0000000000000000
Jul 20 09:40:05 helvi kernel: [17518.959585] R10: ffff88041c610140 R11: 0000000000000001 R12: ffff88082bde3000
Jul 20 09:40:05 helvi kernel: [17518.959679] R13: ffff88082bde2e10 R14: ffff88082bde3000 R15: 00000000000693ad
Jul 20 09:40:05 helvi kernel: [17518.959771] FS:  0000000000000000(0000) GS:ffff88083fcc0000(0000) knlGS:0000000000000000
Jul 20 09:40:05 helvi kernel: [17518.959935] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 20 09:40:05 helvi kernel: [17518.960017] CR2: 0000000049809491 CR3: 0000000001c08000 CR4: 00000000000006e0
Jul 20 09:40:05 helvi kernel: [17518.960110] Stack:
Jul 20 09:40:05 helvi kernel: [17518.960178]  ffffc90005d1bb70 ffffffffa12625c8 ffff88041c610140 ffffc90005d1bb10
Jul 20 09:40:05 helvi kernel: [17518.960327]  ffff8804283ada08 ffff8804283ada48 0000000000000003 ffff8804283ada08
Jul 20 09:40:05 helvi kernel: [17518.960463]  ffffffff811cbecc 00000501d201c000 00000501d2044000 ffff88082bde2c00
Jul 20 09:40:05 helvi kernel: [17518.960626] Call Trace:
Jul 20 09:40:05 helvi kernel: [17518.960774]  [<ffffffffa12625c8>] metaslab_block_picker.constprop.13+0x48/0xb0 [zfs]
Jul 20 09:40:05 helvi kernel: [17518.960910]  [<ffffffff811cbecc>] ? __kmalloc_node+0x20c/0x2c0
Jul 20 09:40:05 helvi kernel: [17518.961063]  [<ffffffffa1263a31>] metaslab_df_alloc+0x111/0x180 [zfs]
Jul 20 09:40:05 helvi kernel: [17518.961179]  [<ffffffffa12671cf>] metaslab_alloc+0x89f/0x15a0 [zfs]
Jul 20 09:40:05 helvi kernel: [17518.961256]  [<ffffffff816da669>] ? __mutex_unlock_slowpath+0xa9/0x140
Jul 20 09:40:05 helvi kernel: [17518.961402]  [<ffffffffa12f0eea>] zio_dva_allocate+0x17a/0x930 [zfs]
Jul 20 09:40:05 helvi kernel: [17518.961491]  [<ffffffff816dcfb9>] ? _raw_spin_unlock+0x9/0x10
Jul 20 09:40:05 helvi kernel: [17518.961572]  [<ffffffffa019e300>] ? tsd_hash_search.isra.0+0x70/0x90 [spl]
Jul 20 09:40:05 helvi kernel: [17518.961644]  [<ffffffffa019e3ed>] ? tsd_get_by_thread+0x3d/0x90 [spl]
Jul 20 09:40:05 helvi kernel: [17518.961745]  [<ffffffffa0196b33>] ? taskq_member+0x13/0x20 [spl]
Jul 20 09:40:05 helvi kernel: [17518.961894]  [<ffffffffa12eae13>] zio_execute+0x103/0x320 [zfs]
Jul 20 09:40:05 helvi kernel: [17518.961985]  [<ffffffffa019802b>] taskq_thread+0x29b/0x590 [spl]
Jul 20 09:40:05 helvi kernel: [17518.962075]  [<ffffffff810d12e0>] ? wake_up_q+0x70/0x70
Jul 20 09:40:05 helvi kernel: [17518.962167]  [<ffffffffa0197d90>] ? taskq_thread_should_stop+0x80/0x80 [spl]
Jul 20 09:40:05 helvi kernel: [17518.962264]  [<ffffffff810c71f9>] kthread+0xf9/0x110
Jul 20 09:40:05 helvi kernel: [17518.962338]  [<ffffffff810c7100>] ? kthread_park+0x60/0x60
Jul 20 09:40:05 helvi kernel: [17518.962398]  [<ffffffff816dd492>] ret_from_fork+0x22/0x30
Jul 20 09:40:05 helvi kernel: [17518.962498] Code: 47 10 b9 01 00 00 00 29 d1 48 89 e5 4c 01 c6 48 85 f6 74 40 48 63 d2 48 89 f7 48 8b 04 d6 48 85 c0 74 1a 48 63 c9 eb 03 48 89 d0 <48> 8b 14 c8 48 85 d2 75 f4 4c 29 c0 5d c3 39 ca 74 f7 48 8b 47 
Jul 20 09:40:05 helvi kernel: [17518.962893] RIP  [<ffffffffa012702e>] avl_walk+0x2e/0x60 [zavl]
Jul 20 09:40:05 helvi kernel: [17518.962992]  RSP <ffffc90005d1bb00>
Jul 20 09:40:05 helvi kernel: [17518.963054] CR2: 0000000049809491
Jul 20 09:40:05 helvi kernel: [17518.963453] ---[ end trace c3710e7fb2c2eb58 ]---
Jul 20 09:40:05 helvi kernel: [17518.963582] BUG: unable to handle kernel NULL pointer dereference at 0000000000000009
Jul 20 09:40:05 helvi kernel: [17518.963846] IP: [<ffffffff810e4a15>] __wake_up_common+0x25/0x80
Jul 20 09:40:05 helvi kernel: [17518.964022] PGD 0 
Jul 20 09:40:05 helvi kernel: [17518.964080] 
Jul 20 09:40:05 helvi kernel: [17518.964210] Oops: 0000 [#2] SMP
Jul 20 09:40:05 helvi kernel: [17518.964312] Modules linked in: binfmt_misc iscsi_target_mod target_core_mod 8021q garp ipt_MASQUERADE nf_nat_masquerade_ipv4 xfrm_user xfrm_algo iptable_nat xt_addrtype iptable_filter ip_tables xt_conntrack x_tables br_netfilter bridge stp llc dm_thin_pool dm_persistent_data dm_bio_prison dm_bufio loop openvswitch nf_conntrack_ipv6 nf_nat_ipv6 nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_defrag_ipv6 nf_nat nf_conntrack configfs nfsd auth_rpcgss oid_registry nfs_acl nfs lockd grace sunrpc zfs(PO) zunicode(PO) zavl(PO) icp(PO) iTCO_wdt iTCO_vendor_support gpio_ich usb_storage crct10dif_pclmul crc32_pclmul ghash_clmulni_intel aesni_intel aes_x86_64 ablk_helper cryptd lrw gf128mul glue_helper pcspkr serio_raw i2c_i801 i2c_smbus ftdi_sio usbserial bttv tveeprom videobuf_dma_sg tea575x videobuf_core
Jul 20 09:40:05 helvi kernel: [17518.968177]  rc_core v4l2_common ast videodev ttm media drm_kms_helper syscopyarea sysfillrect sysimgblt fb_sys_fops drm snd_hda_intel snd_hda_codec agpgart snd_hda_core snd_pcm lpc_ich mfd_core snd_timer snd soundcore zcommon(PO) btrfs znvpair(PO) i7core_edac ioatdma spl(O) zlib_deflate i5500_temp dca edac_core shpchp ipmi_si ipmi_msghandler evdev acpi_cpufreq tpm_tis tpm_tis_core tpm w83795 w83627ehf hwmon_vid coretemp autofs4 hid_generic usbhid hid crc32c_intel psmouse ehci_pci uhci_hcd ehci_hcd usbcore usb_common sg sd_mod
Jul 20 09:40:05 helvi kernel: [17518.971158] CPU: 7 PID: 1462 Comm: z_wr_iss Tainted: P      D    O    4.9.36.iudex.kvm.ovs.1 #2
Jul 20 09:40:05 helvi kernel: [17518.971336] Hardware name: System manufacturer System Product Name/Z8NA-D6(C), BIOS 1303    05/10/2012
Jul 20 09:40:05 helvi kernel: [17518.971529] task: ffff88082c722340 task.stack: ffffc90005d18000
Jul 20 09:40:05 helvi kernel: [17518.971633] RIP: 0010:[<ffffffff810e4a15>]  [<ffffffff810e4a15>] __wake_up_common+0x25/0x80
Jul 20 09:40:05 helvi kernel: [17518.971860] RSP: 0018:ffffc90005d1be50  EFLAGS: 00010086
Jul 20 09:40:05 helvi kernel: [17518.971974] RAX: 0000000000000286 RBX: ffffc90005d1bf08 RCX: 0000000000000000
Jul 20 09:40:05 helvi kernel: [17518.972074] RDX: 0000000000000009 RSI: 0000000000000003 RDI: ffffc90005d1bf08
Jul 20 09:40:05 helvi kernel: [17518.972185] RBP: ffffc90005d1be88 R08: 0000000000000000 R09: 0000000000000000
Jul 20 09:40:05 helvi kernel: [17518.972292] R10: 00000000000005d2 R11: ffffffff81882500 R12: ffffc90005d1bf08
Jul 20 09:40:05 helvi kernel: [17518.972422] R13: 0000000000000286 R14: 0000000000000000 R15: 0000000000000003
Jul 20 09:40:05 helvi kernel: [17518.972525] FS:  0000000000000000(0000) GS:ffff88083fcc0000(0000) knlGS:0000000000000000
Jul 20 09:40:05 helvi kernel: [17518.972679] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jul 20 09:40:05 helvi kernel: [17518.972762] CR2: 0000000000000009 CR3: 0000000001c08000 CR4: 00000000000006e0
Jul 20 09:40:05 helvi kernel: [17518.972869] Stack:
Jul 20 09:40:05 helvi kernel: [17518.972971]  00000001000005d2 0000000000000000 ffffc90005d1bf08 ffffc90005d1bf00
Jul 20 09:40:05 helvi kernel: [17518.973255]  0000000000000286 0000000000000000 000000000000000b ffffc90005d1be98
Jul 20 09:40:05 helvi kernel: [17518.973578]  ffffffff810e4a7e ffffc90005d1bec0 ffffffff810e5452 ffff88082c722980
Jul 20 09:40:05 helvi kernel: [17518.973962] Call Trace:
Jul 20 09:40:05 helvi kernel: [17518.974074]  [<ffffffff810e4a7e>] __wake_up_locked+0xe/0x10
Jul 20 09:40:05 helvi kernel: [17518.974189]  [<ffffffff810e5452>] complete+0x32/0x50
Jul 20 09:40:05 helvi kernel: [17518.974314]  [<ffffffff810a7680>] mm_release+0xb0/0x130
Jul 20 09:40:05 helvi kernel: [17518.974460]  [<ffffffff810ad602>] do_exit+0x132/0xb10
Jul 20 09:40:05 helvi kernel: [17518.974570]  [<ffffffff816df157>] rewind_stack_do_exit+0x17/0x20
Jul 20 09:40:05 helvi kernel: [17518.974700] Code: 00 00 00 00 00 90 55 48 89 e5 41 57 41 89 f7 41 56 41 89 ce 41 55 41 54 49 89 fc 53 48 83 ec 10 89 55 cc 48 8b 57 18 4c 89 45 d0 <4c> 8b 02 48 8d 42 e8 48 39 c7 4d 8d 68 e8 75 05 eb 34 49 89 d5 
Jul 20 09:40:05 helvi kernel: [17518.977738] RIP  [<ffffffff810e4a15>] __wake_up_common+0x25/0x80
Jul 20 09:40:05 helvi kernel: [17518.977913]  RSP <ffffc90005d1be50>
Jul 20 09:40:05 helvi kernel: [17518.978018] CR2: 0000000000000009
Jul 20 09:40:05 helvi kernel: [17518.978129] ---[ end trace c3710e7fb2c2eb59 ]---
Jul 20 09:40:05 helvi kernel: [17518.978252] Fixing recursive fault but reboot is needed!

@tuomari
Copy link
Author

tuomari commented Feb 27, 2018

Have not encountered this in a while. Assume fixed

@tuomari tuomari closed this as completed Feb 27, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant