Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Snapshot renaming on Ubuntu 12.04 #876

Closed
mctroyd opened this issue Aug 20, 2012 · 8 comments
Closed

Snapshot renaming on Ubuntu 12.04 #876

mctroyd opened this issue Aug 20, 2012 · 8 comments
Milestone
0.6.0-rc11

Comments

@mctroyd
Copy link

mctroyd commented Aug 20, 2012

Hello all,

I'm running Ubuntu Server 12.04.1 Precise Pangolin x64 (uname: Linux kaylee 3.2.0-29-generic #46-Ubuntu SMP Fri Jul 27 17:03:23 UTC 2012 x86_64 x86_64 x86_64 GNU/Linux). I use the Ubuntu PPA (stable) to install ZoL, and initially installed 0.6.0-rc9 (or whatever the Ubuntu version equivalent was) on an otherwise stock Precise install. Everything was running quite smoothly until I "apt-get update"ed to rc10.

Now, I've noticed when renaming a snapshot, I get the following error:

root@kaylee:~# zfs rename -r export@week1 @week2
zfs: ../../lib/libzfs/libzfs_dataset.c:3169: Assertion `nvlist_add_boolean(dd->nvl, name) == 0' failed.
Aborted (core dumped)

The specific name of the snapshot doesn't seem to matter; I've tried dozens. I should mention I had had this issue under kernel 3.2.0-27-generic as well, which is what I was running at the time of the initial upgrade (upgraded to *29-generic wondering if that would fix it).

I have two zpools as follows:

root@kaylee:~# zpool status
  pool: export
 state: ONLINE
 scan: scrub repaired 0 in 1h12m with 0 errors on Mon Aug 20 11:43:15 2012
config:

        NAME        STATE     READ WRITE CKSUM
        export      ONLINE       0     0     0
          raidz1-0  ONLINE       0     0     0
            sdb     ONLINE       0     0     0
            sdc     ONLINE       0     0     0
            sdd     ONLINE       0     0     0
        cache
          sda3      ONLINE       0     0     0

errors: No known data errors

  pool: media
 state: ONLINE
 scan: scrub repaired 0 in 1h0m with 0 errors on Mon Aug 20 10:25:24 2012
config:

        NAME        STATE     READ WRITE CKSUM
        media       ONLINE       0     0     0
          sde       ONLINE       0     0     0
          sdf       ONLINE       0     0     0
        cache
          sda4      ONLINE       0     0     0

errors: No known data errors

This happens 100% of the time renaming a snapshot on the RAIDz1 ("export") pool; it does not happen at all on the striped ("media") pool. I have tried scrubbing the array, destroying and re-snapshot-ing, and "apt-get install --reinstall ubuntu-zfs spl-dkms zfs-dkms". Nothing seems to work. I feel like I'm missing something dumb. Ideas?

This is an older Dell Poweredge SC430, with a Pentium D processor and 4 GB ECC RAM. dmesg output follows. Thanks!

[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Linux version 3.2.0-29-generic (buildd@allspice) (gcc version 4.6.3 (Ubuntu/Linaro 4.6.3-1ubuntu5) ) #46-Ubuntu SMP Fri Jul 27 17:03:23 UTC 2012 (Ubuntu 3.2.0-29.46-generic 3.2.24)
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-3.2.0-29-generic root=UUID=4ea02415-4ac1-4c09-a588-1f358cb5e5e2 ro
[    0.000000] KERNEL supported cpus:
[    0.000000]   Intel GenuineIntel
[    0.000000]   AMD AuthenticAMD
[    0.000000]   Centaur CentaurHauls
[    0.000000] BIOS-provided physical RAM map:
[    0.000000]  BIOS-e820: 0000000000000000 - 00000000000a0000 (usable)
[    0.000000]  BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
[    0.000000]  BIOS-e820: 0000000000100000 - 00000000efe8cc00 (usable)
[    0.000000]  BIOS-e820: 00000000efe8cc00 - 00000000efe8ec00 (ACPI NVS)
[    0.000000]  BIOS-e820: 00000000efe8ec00 - 00000000efe90c00 (ACPI data)
[    0.000000]  BIOS-e820: 00000000efe90c00 - 00000000f4000000 (reserved)
[    0.000000]  BIOS-e820: 00000000fec00000 - 00000000fed00400 (reserved)
[    0.000000]  BIOS-e820: 00000000fed20000 - 00000000feda0000 (reserved)
[    0.000000]  BIOS-e820: 00000000fee00000 - 00000000fef00000 (reserved)
[    0.000000]  BIOS-e820: 00000000ffb00000 - 0000000100000000 (reserved)
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] DMI 2.3 present.
[    0.000000] DMI: Dell Inc.                 PowerEdge SC430              /0NJ886, BIOS A04 10/06/2006
[    0.000000] e820 update range: 0000000000000000 - 0000000000010000 (usable) ==> (reserved)
[    0.000000] e820 remove range: 00000000000a0000 - 0000000000100000 (usable)
[    0.000000] No AGP bridge found
[    0.000000] last_pfn = 0xefe8c max_arch_pfn = 0x400000000
[    0.000000] MTRR default type: uncachable
[    0.000000] MTRR fixed ranges enabled:
[    0.000000]   00000-9FFFF write-back
[    0.000000]   A0000-BFFFF uncachable
[    0.000000]   C0000-CFFFF write-protect
[    0.000000]   D0000-EFFFF uncachable
[    0.000000]   F0000-FFFFF write-protect
[    0.000000] MTRR variable ranges enabled:
[    0.000000]   0 base 000000000 mask F80000000 write-back
[    0.000000]   1 base 080000000 mask FC0000000 write-back
[    0.000000]   2 base 0C0000000 mask FE0000000 write-back
[    0.000000]   3 base 0E0000000 mask FF0000000 write-back
[    0.000000]   4 base 0EFF00000 mask FFFF00000 uncachable
[    0.000000]   5 disabled
[    0.000000]   6 disabled
[    0.000000]   7 disabled
[    0.000000] x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106
[    0.000000] original variable MTRRs
[    0.000000] reg 0, base: 0GB, range: 2GB, type WB
[    0.000000] reg 1, base: 2GB, range: 1GB, type WB
[    0.000000] reg 2, base: 3GB, range: 512MB, type WB
[    0.000000] reg 3, base: 3584MB, range: 256MB, type WB
[    0.000000] reg 4, base: 3839MB, range: 1MB, type UC
[    0.000000] total RAM covered: 3839M
[    0.000000] Found optimal setting for mtrr clean up
[    0.000000]  gran_size: 64K  chunk_size: 512M    num_reg: 3      lose cover RAM: 0G
[    0.000000] New variable MTRRs
[    0.000000] reg 0, base: 0GB, range: 4GB, type WB
[    0.000000] reg 1, base: 3839MB, range: 1MB, type UC
[    0.000000] reg 2, base: 3840MB, range: 256MB, type UC
[    0.000000] found SMP MP-table at [ffff8800000fe710] fe710
[    0.000000] initial memory mapped : 0 - 20000000
[    0.000000] Base memory trampoline at [ffff880000096000] 96000 size 20480
[    0.000000] init_memory_mapping: 0000000000000000-00000000efe8c000
[    0.000000]  0000000000 - 00efe00000 page 2M
[    0.000000]  00efe00000 - 00efe8c000 page 4k
[    0.000000] kernel direct mapping tables up to efe8c000 @ 1fffa000-20000000
[    0.000000] RAMDISK: 35db8000 - 36ed4000
[    0.000000] ACPI: RSDP 00000000000feb00 00024 (v02 DELL  )
[    0.000000] ACPI: XSDT 00000000000fd23b 0005C (v01 DELL    PESC430 00000007 ASL  00000061)
[    0.000000] ACPI: FACP 00000000000fd333 000F4 (v03 DELL    PESC430 00000007 ASL  00000061)
[    0.000000] ACPI: DSDT 00000000fffce4df 02E15 (v01   DELL    dt_ex 00001000 INTL 20050309)
[    0.000000] ACPI: FACS 00000000efe8cc00 00040
[    0.000000] ACPI: SSDT 00000000fffd14c1 00088 (v01   DELL    st_ex 00001000 INTL 20050309)
[    0.000000] ACPI: APIC 00000000000fd427 00072 (v01 DELL    PESC430 00000007 ASL  00000061)
[    0.000000] ACPI: BOOT 00000000000fd499 00028 (v01 DELL    PESC430 00000007 ASL  00000061)
[    0.000000] ACPI: ASF! 00000000000fd4c1 00067 (v16 DELL    PESC430 00000007 ASL  00000061)
[    0.000000] ACPI: MCFG 00000000000fd528 0003E (v01 DELL    PESC430 00000007 ASL  00000061)
[    0.000000] ACPI: HPET 00000000000fd566 00038 (v01 DELL    PESC430 00000007 ASL  00000061)
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] No NUMA configuration found
[    0.000000] Faking a node at 0000000000000000-00000000efe8c000
[    0.000000] Initmem setup node 0 0000000000000000-00000000efe8c000
[    0.000000]   NODE_DATA [00000000efe87000 - 00000000efe8bfff]
[    0.000000]  [ffffea0000000000-ffffea0003bfffff] PMD -> [ffff8800eba00000-ffff8800ef5fffff] on node 0
[    0.000000] Zone PFN ranges:
[    0.000000]   DMA      0x00000010 -> 0x00001000
[    0.000000]   DMA32    0x00001000 -> 0x00100000
[    0.000000]   Normal   empty
[    0.000000] Movable zone start PFN for each node
[    0.000000] early_node_map[2] active PFN ranges
[    0.000000]     0: 0x00000010 -> 0x000000a0
[    0.000000]     0: 0x00000100 -> 0x000efe8c
[    0.000000] On node 0 totalpages: 982556
[    0.000000]   DMA zone: 64 pages used for memmap
[    0.000000]   DMA zone: 10 pages reserved
[    0.000000]   DMA zone: 3910 pages, LIFO batch:0
[    0.000000]   DMA32 zone: 15291 pages used for memmap
[    0.000000]   DMA32 zone: 963281 pages, LIFO batch:31
[    0.000000] ACPI: PM-Timer IO Port: 0x808
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x01] enabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x05] disabled)
[    0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x07] disabled)
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] high level lint[0x1])
[    0.000000] ACPI: IOAPIC (id[0x08] address[0xfec00000] gsi_base[0])
[    0.000000] IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] ACPI: IRQ0 used by override.
[    0.000000] ACPI: IRQ2 used by override.
[    0.000000] ACPI: IRQ9 used by override.
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000
[    0.000000] SMP: Allowing 4 CPUs, 2 hotplug CPUs
[    0.000000] nr_irqs_gsi: 40
[    0.000000] PM: Registered nosave memory: 00000000000a0000 - 00000000000f0000
[    0.000000] PM: Registered nosave memory: 00000000000f0000 - 0000000000100000
[    0.000000] Allocating PCI resources starting at f4000000 (gap: f4000000:ac00000)
[    0.000000] Booting paravirtualized kernel on bare hardware
[    0.000000] setup_percpu: NR_CPUS:256 nr_cpumask_bits:256 nr_cpu_ids:4 nr_node_ids:1
[    0.000000] PERCPU: Embedded 28 pages/cpu @ffff8800efc00000 s83072 r8192 d23424 u524288
[    0.000000] pcpu-alloc: s83072 r8192 d23424 u524288 alloc=1*2097152
[    0.000000] pcpu-alloc: [0] 0 1 2 3 
[    0.000000] Built 1 zonelists in Node order, mobility grouping on.  Total pages: 967191
[    0.000000] Policy zone: DMA32
[    0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-3.2.0-29-generic root=UUID=4ea02415-4ac1-4c09-a588-1f358cb5e5e2 ro
[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[    0.000000] Checking aperture...
[    0.000000] No AGP bridge found
[    0.000000] Calgary: detecting Calgary via BIOS EBDA area
[    0.000000] Calgary: Unable to locate Rio Grande table in EBDA - bailing!
[    0.000000] Memory: 3834960k/3930672k available (6555k kernel code, 448k absent, 95264k reserved, 6645k data, 920k init)
[    0.000000] SLUB: Genslabs=15, HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1
[    0.000000] Hierarchical RCU implementation.
[    0.000000]  RCU dyntick-idle grace-period acceleration is enabled.
[    0.000000] NR_IRQS:16640 nr_irqs:712 16
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [tty0] enabled
[    0.000000] allocated 31457280 bytes of page_cgroup
[    0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups
[    0.000000] hpet clockevent registered
[    0.000000] Fast TSC calibration failed
[    0.000000] TSC: PIT calibration matches HPET. 1 loops
[    0.000000] Detected 2793.060 MHz processor.
[    0.008005] Calibrating delay loop (skipped), value calculated using timer frequency.. 5586.12 BogoMIPS (lpj=11172240)
[    0.008134] pid_max: default: 32768 minimum: 301
[    0.008229] Security Framework initialized
[    0.008311] AppArmor: AppArmor initialized
[    0.008373] Yama: becoming mindful.
[    0.012726] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes)
[    0.015568] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes)
[    0.016770] Mount-cache hash table entries: 256
[    0.017060] Initializing cgroup subsys cpuacct
[    0.017128] Initializing cgroup subsys memory
[    0.017199] Initializing cgroup subsys devices
[    0.017262] Initializing cgroup subsys freezer
[    0.017324] Initializing cgroup subsys blkio
[    0.017394] Initializing cgroup subsys perf_event
[    0.017506] CPU: Physical Processor ID: 0
[    0.017568] CPU: Processor Core ID: 0
[    0.017629] mce: CPU supports 4 MCE banks
[    0.017702] CPU0: Thermal monitoring enabled (TM1)
[    0.017769] using mwait in idle threads.
[    0.020791] ACPI: Core revision 20110623
[    0.089772] ftrace: allocating 26998 entries in 106 pages
[    0.092466] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.135281] CPU0: Intel(R) Pentium(R) D CPU 2.80GHz stepping 04
[    0.136007] Performance Events: Netburst events, Netburst P4/Xeon PMU driver.
[    0.136007] ... version:                0
[    0.136007] ... bit width:              40
[    0.136007] ... generic registers:      18
[    0.136007] ... value mask:             000000ffffffffff
[    0.136007] ... max period:             0000007fffffffff
[    0.136007] ... fixed-purpose events:   0
[    0.136007] ... event mask:             000000000003ffff
[    0.136007] NMI watchdog enabled, takes one hw-pmu counter.
[    0.136007] Booting Node   0, Processors  #1
[    0.136007] smpboot cpu 1: start_ip = 96000
[    0.228049] NMI watchdog enabled, takes one hw-pmu counter.
[    0.228154] Brought up 2 CPUs
[    0.228216] Total of 2 processors activated (11172.29 BogoMIPS).
[    0.229432] devtmpfs: initialized
[    0.229578] EVM: security.selinux
[    0.229638] EVM: security.SMACK64
[    0.229697] EVM: security.capability
[    0.229795] PM: Registering ACPI NVS region at efe8cc00 (8192 bytes)
[    0.232939] print_constraints: dummy: 
[    0.233036] RTC time: 16:44:57, date: 08/20/12
[    0.233156] NET: Registered protocol family 16
[    0.233350] Trying to unpack rootfs image as initramfs...
[    0.240560] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    0.240650] ACPI: bus type pci registered
[    0.240802] PCI: MMCONFIG for domain 0000 [bus 00-3f] at [mem 0xf0000000-0xf3ffffff] (base 0xf0000000)
[    0.240893] PCI: MMCONFIG at [mem 0xf0000000-0xf3ffffff] reserved in E820
[    0.260598] PCI: Using configuration type 1 for base access
[    0.272229] bio: create slab  at 0
[    0.272455] ACPI: Added _OSI(Module Device)
[    0.272518] ACPI: Added _OSI(Processor Device)
[    0.272580] ACPI: Added _OSI(3.0 _SCP Extensions)
[    0.272642] ACPI: Added _OSI(Processor Aggregator Device)
[    0.273614] ACPI: EC: Look up EC in DSDT
[    0.307455] [Firmware Bug]: ACPI: BIOS _OSI(Linux) query ignored
[    0.325420] ACPI: Interpreter enabled
[    0.325489] ACPI: (supports S0 S1 S4 S5)
[    0.325718] ACPI: Using IOAPIC for interrupt routing
[    0.431119] ACPI: No dock devices found.
[    0.431186] HEST: Table not found.
[    0.431248] PCI: Ignoring host bridge windows from ACPI; if necessary, use "pci=use_crs" and report a bug
[    0.464098] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[    0.512192] pci_root PNP0A03:00: host bridge window [io  0x0000-0x0cf7] (ignored)
[    0.512198] pci_root PNP0A03:00: host bridge window [io  0x0d00-0xffff] (ignored)
[    0.512202] pci_root PNP0A03:00: host bridge window [mem 0x000a0000-0x000bffff] (ignored)
[    0.512206] pci_root PNP0A03:00: host bridge window [mem 0x000c0000-0x000effff] (ignored)
[    0.512209] pci_root PNP0A03:00: host bridge window [mem 0x000f0000-0x000fffff] (ignored)
[    0.512213] pci_root PNP0A03:00: host bridge window [mem 0xeff00000-0xefffffff] (ignored)
[    0.512217] pci_root PNP0A03:00: host bridge window [mem 0xf4000000-0xfebfffff] (ignored)
[    0.512220] pci_root PNP0A03:00: host bridge window [mem 0xffa80800-0xffa80bff] (ignored)
[    0.512239] pci 0000:00:00.0: [8086:2778] type 0 class 0x000600
[    0.512314] pci 0000:00:01.0: [8086:2779] type 1 class 0x000604
[    0.512376] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
[    0.512381] pci 0000:00:01.0: PME# disabled
[    0.512435] pci 0000:00:1c.0: [8086:27d0] type 1 class 0x000604
[    0.512522] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
[    0.512527] pci 0000:00:1c.0: PME# disabled
[    0.512558] pci 0000:00:1c.4: [8086:27e0] type 1 class 0x000604
[    0.512643] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold
[    0.512648] pci 0000:00:1c.4: PME# disabled
[    0.512676] pci 0000:00:1c.5: [8086:27e2] type 1 class 0x000604
[    0.512760] pci 0000:00:1c.5: PME# supported from D0 D3hot D3cold
[    0.512765] pci 0000:00:1c.5: PME# disabled
[    0.512791] pci 0000:00:1d.0: [8086:27c8] type 0 class 0x000c03
[    0.512840] pci 0000:00:1d.0: reg 20: [io  0xff80-0xff9f]
[    0.512879] pci 0000:00:1d.1: [8086:27c9] type 0 class 0x000c03
[    0.512927] pci 0000:00:1d.1: reg 20: [io  0xff60-0xff7f]
[    0.512966] pci 0000:00:1d.2: [8086:27ca] type 0 class 0x000c03
[    0.513013] pci 0000:00:1d.2: reg 20: [io  0xff40-0xff5f]
[    0.513052] pci 0000:00:1d.3: [8086:27cb] type 0 class 0x000c03
[    0.513099] pci 0000:00:1d.3: reg 20: [io  0xff20-0xff3f]
[    0.513152] pci 0000:00:1d.7: [8086:27cc] type 0 class 0x000c03
[    0.513176] pci 0000:00:1d.7: reg 10: [mem 0xffa80800-0xffa80bff]
[    0.513272] pci 0000:00:1d.7: PME# supported from D0 D3hot D3cold
[    0.513278] pci 0000:00:1d.7: PME# disabled
[    0.513301] pci 0000:00:1e.0: [8086:244e] type 1 class 0x000604
[    0.513378] pci 0000:00:1f.0: [8086:27b8] type 0 class 0x000601
[    0.513472] pci 0000:00:1f.0: ICH7 LPC Generic IO decode 1 PIO at 0c00 (mask 007f)
[    0.513564] pci 0000:00:1f.0: ICH7 LPC Generic IO decode 2 PIO at 00e0 (mask 0007)
[    0.513697] pci 0000:00:1f.1: [8086:27df] type 0 class 0x000101
[    0.513714] pci 0000:00:1f.1: reg 10: [io  0x01f0-0x01f7]
[    0.513725] pci 0000:00:1f.1: reg 14: [io  0x03f4-0x03f7]
[    0.513736] pci 0000:00:1f.1: reg 18: [io  0x0170-0x0177]
[    0.513748] pci 0000:00:1f.1: reg 1c: [io  0x0374-0x0377]
[    0.513759] pci 0000:00:1f.1: reg 20: [io  0xffa0-0xffaf]
[    0.513802] pci 0000:00:1f.2: [8086:27c0] type 0 class 0x000101
[    0.513820] pci 0000:00:1f.2: reg 10: [io  0xfe00-0xfe07]
[    0.513830] pci 0000:00:1f.2: reg 14: [io  0xfe10-0xfe13]
[    0.513840] pci 0000:00:1f.2: reg 18: [io  0xfe20-0xfe27]
[    0.513850] pci 0000:00:1f.2: reg 1c: [io  0xfe30-0xfe33]
[    0.513860] pci 0000:00:1f.2: reg 20: [io  0xfea0-0xfeaf]
[    0.513870] pci 0000:00:1f.2: reg 24: [mem 0x00000000-0x000003ff]
[    0.513906] pci 0000:00:1f.2: PME# supported from D3hot
[    0.513911] pci 0000:00:1f.2: PME# disabled
[    0.513933] pci 0000:00:1f.3: [8086:27da] type 0 class 0x000c05
[    0.513991] pci 0000:00:1f.3: reg 20: [io  0xece0-0xecff]
[    0.514070] pci 0000:00:01.0: PCI bridge to [bus 01-01]
[    0.515008] pci 0000:00:01.0:   bridge window [mem 0xfea00000-0xfeafffff]
[    0.515060] pci 0000:00:1c.0: PCI bridge to [bus 02-02]
[    0.515128] pci 0000:00:1c.0:   bridge window [mem 0xfe900000-0xfe9fffff]
[    0.515207] pci 0000:03:00.0: [1095:0242] type 0 class 0x000104
[    0.515238] pci 0000:03:00.0: reg 10: [mem 0xfe7fbf80-0xfe7fbfff 64bit]
[    0.515262] pci 0000:03:00.0: reg 18: [mem 0xfe7fc000-0xfe7fffff 64bit]
[    0.515278] pci 0000:03:00.0: reg 20: [io  0xdc80-0xdcff]
[    0.515308] pci 0000:03:00.0: reg 30: [mem 0xfe800000-0xfe87ffff pref]
[    0.515384] pci 0000:03:00.0: supports D1 D2
[    0.520207] pci 0000:00:1c.4: PCI bridge to [bus 03-03]
[    0.520277] pci 0000:00:1c.4:   bridge window [io  0xd000-0xdfff]
[    0.520283] pci 0000:00:1c.4:   bridge window [mem 0xfe700000-0xfe8fffff]
[    0.520367] pci 0000:04:00.0: [14e4:1677] type 0 class 0x000200
[    0.520397] pci 0000:04:00.0: reg 10: [mem 0xfe6f0000-0xfe6fffff 64bit]
[    0.520537] pci 0000:04:00.0: PME# supported from D3hot D3cold
[    0.520544] pci 0000:04:00.0: PME# disabled
[    0.528357] pci 0000:00:1c.5: PCI bridge to [bus 04-04]
[    0.528430] pci 0000:00:1c.5:   bridge window [mem 0xfe600000-0xfe6fffff]
[    0.528481] pci 0000:05:02.0: [10b7:9050] type 0 class 0x000200
[    0.528499] pci 0000:05:02.0: reg 10: [io  0xcc40-0xcc7f]
[    0.528557] pci 0000:05:02.0: reg 30: [mem 0xfe500000-0xfe50ffff pref]
[    0.528590] pci 0000:05:04.0: [11c1:5811] type 0 class 0x000c00
[    0.528611] pci 0000:05:04.0: reg 10: [mem 0xfe4bf000-0xfe4bffff]
[    0.528698] pci 0000:05:04.0: supports D1 D2
[    0.528701] pci 0000:05:04.0: PME# supported from D0 D1 D2 D3hot
[    0.528707] pci 0000:05:04.0: PME# disabled
[    0.528732] pci 0000:05:07.0: [18ca:0020] type 0 class 0x000300
[    0.528753] pci 0000:05:07.0: reg 10: [mem 0xfc000000-0xfdffffff pref]
[    0.528766] pci 0000:05:07.0: reg 14: [mem 0xfe4c0000-0xfe4fffff]
[    0.528778] pci 0000:05:07.0: reg 18: [io  0xcc80-0xccff]
[    0.528817] pci 0000:05:07.0: reg 30: [mem 0xfe500000-0xfe50ffff pref]
[    0.528851] pci 0000:05:07.0: supports D1 D2
[    0.528895] pci 0000:00:1e.0: PCI bridge to [bus 05-05] (subtractive decode)
[    0.528966] pci 0000:00:1e.0:   bridge window [io  0xc000-0xcfff]
[    0.528972] pci 0000:00:1e.0:   bridge window [mem 0xfe400000-0xfe5fffff]
[    0.528980] pci 0000:00:1e.0:   bridge window [mem 0xfc000000-0xfdffffff 64bit pref]
[    0.528984] pci 0000:00:1e.0:   bridge window [io  0x0000-0xffff] (subtractive decode)
[    0.528987] pci 0000:00:1e.0:   bridge window [mem 0x00000000-0xfffffffff] (subtractive decode)
[    0.529023] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0._PRT]
[    0.529458] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PCI4._PRT]
[    0.529824] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PCI2._PRT]
[    0.530083] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PCI1._PRT]
[    0.530286] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PCI5._PRT]
[    0.530494] ACPI: PCI Interrupt Routing Table [\_SB_.PCI0.PCI6._PRT]
[    0.530686]  pci0000:00: Requesting ACPI _OSC control (0x1d)
[    0.530754]  pci0000:00: ACPI _OSC request failed (AE_NOT_FOUND), returned control mask: 0x1d
[    0.530840] ACPI _OSC control for PCIe not granted, disabling ASPM
[    1.208761] Freeing initrd memory: 17520k freed
[    1.413931] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 9 10 *11 12 15)
[    1.414811] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 9 *10 11 12 15)
[    1.415727] ACPI: PCI Interrupt Link [LNKC] (IRQs *3 4 5 6 7 9 10 11 12 15)
[    1.416692] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 7 9 10 11 12 15) *0, disabled.
[    1.417663] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 *5 6 7 9 10 11 12 15)
[    1.418581] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 *9 10 11 12 15)
[    1.419451] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 *5 6 7 9 10 11 12 15)
[    1.420383] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 7 9 *10 11 12 15)
[    1.421088] vgaarb: device added: PCI:0000:05:07.0,decodes=io+mem,owns=io+mem,locks=none
[    1.421088] vgaarb: loaded
[    1.421088] vgaarb: bridge control possible 0000:05:07.0
[    1.421088] i2c-core: driver [aat2870] using legacy suspend method
[    1.421088] i2c-core: driver [aat2870] using legacy resume method
[    1.421088] SCSI subsystem initialized
[    1.421088] libata version 3.00 loaded.
[    1.421088] usbcore: registered new interface driver usbfs
[    1.421088] usbcore: registered new interface driver hub
[    1.421088] usbcore: registered new device driver usb
[    1.421088] PCI: Using ACPI for IRQ routing
[    1.424206] PCI: pci_cache_line_size set to 64 bytes
[    1.424315] reserve RAM buffer: 00000000efe8cc00 - 00000000efffffff 
[    1.424481] NetLabel: Initializing
[    1.424542] NetLabel:  domain hash size = 128
[    1.424602] NetLabel:  protocols = UNLABELED CIPSOv4
[    1.424681] NetLabel:  unlabeled traffic allowed by default
[    1.424779] HPET: 3 timers in total, 0 timers will be used for per-cpu timer
[    1.424779] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
[    1.424779] hpet0: 3 comparators, 64-bit 14.318180 MHz counter
[    1.428198] Switching to clocksource hpet
[    1.443740] AppArmor: AppArmor Filesystem Enabled
[    1.443845] pnp: PnP ACPI init
[    1.443931] ACPI: bus type pnp registered
[    1.448337] pnp 00:00: [bus 00-ff]
[    1.448342] pnp 00:00: [io  0x0cf8-0x0cff]
[    1.448346] pnp 00:00: [io  0x0000-0x0cf7 window]
[    1.448349] pnp 00:00: [io  0x0d00-0xffff window]
[    1.448353] pnp 00:00: [mem 0x000a0000-0x000bffff window]
[    1.448356] pnp 00:00: [mem 0x000c0000-0x000effff window]
[    1.448359] pnp 00:00: [mem 0x000f0000-0x000fffff window]
[    1.448363] pnp 00:00: [mem 0xeff00000-0xefffffff window]
[    1.448366] pnp 00:00: [mem 0xf4000000-0xfebfffff window]
[    1.448369] pnp 00:00: [mem 0xffa80800-0xffa80bff window]
[    1.448432] pnp 00:00: Plug and Play ACPI device, IDs PNP0a03 (active)
[    1.450942] pnp 00:01: [io  0x0060]
[    1.450946] pnp 00:01: [io  0x0064]
[    1.450948] pnp 00:01: [io  0x0062-0x0063]
[    1.450951] pnp 00:01: [io  0x0065-0x006f]
[    1.450953] pnp 00:01: [io  0x00e0-0x00ef]
[    1.450956] pnp 00:01: [io  0x0800-0x085f]
[    1.450958] pnp 00:01: [io  0x0c00-0x0c7f]
[    1.450961] pnp 00:01: [io  0x0860-0x08ff]
[    1.451051] system 00:01: [io  0x0800-0x085f] has been reserved
[    1.451119] system 00:01: [io  0x0c00-0x0c7f] has been reserved
[    1.451185] system 00:01: [io  0x0860-0x08ff] has been reserved
[    1.451253] system 00:01: Plug and Play ACPI device, IDs PNP0c01 (active)
[    1.451461] pnp 00:02: [io  0x0080-0x009f]
[    1.451465] pnp 00:02: [io  0x0000-0x001f]
[    1.451467] pnp 00:02: [io  0x00c0-0x00df]
[    1.451471] pnp 00:02: [dma 4]
[    1.451516] pnp 00:02: Plug and Play ACPI device, IDs PNP0200 (active)
[    1.451657] pnp 00:03: [io  0x00f0-0x00ff]
[    1.451672] pnp 00:03: [irq 13]
[    1.451714] pnp 00:03: Plug and Play ACPI device, IDs PNP0c04 (active)
[    1.451851] pnp 00:04: [io  0x0061]
[    1.451897] pnp 00:04: Plug and Play ACPI device, IDs PNP0800 (active)
[    1.452077] pnp 00:05: [io  0x0070-0x007f]
[    1.452086] pnp 00:05: [irq 8]
[    1.452142] pnp 00:05: Plug and Play ACPI device, IDs PNP0b00 (active)
[    1.460888] pnp 00:06: [io  0x03f8-0x03ff]
[    1.460897] pnp 00:06: [irq 4]
[    1.461247] pnp 00:06: Plug and Play ACPI device, IDs PNP0501 (active)
[    1.472038] pnp 00:07: [mem 0x00000000-0x0009ffff]
[    1.472043] pnp 00:07: [mem 0x00100000-0x00ffffff]
[    1.472046] pnp 00:07: [mem 0x01000000-0xefe8cbff]
[    1.472049] pnp 00:07: [mem 0x000f0000-0x000fffff]
[    1.472052] pnp 00:07: [mem 0x000c0000-0x000cffff]
[    1.472054] pnp 00:07: [mem 0xfec00000-0xfecfffff]
[    1.472057] pnp 00:07: [mem 0xfee00000-0xfeefffff]
[    1.472060] pnp 00:07: [mem 0xfed20000-0xfed9ffff]
[    1.472063] pnp 00:07: [mem 0xffb00000-0xffbfffff]
[    1.472066] pnp 00:07: [mem 0xffc00000-0xffffffff]
[    1.472161] system 00:07: [mem 0x00000000-0x0009ffff] could not be reserved
[    1.472232] system 00:07: [mem 0x00100000-0x00ffffff] could not be reserved
[    1.472301] system 00:07: [mem 0x01000000-0xefe8cbff] could not be reserved
[    1.472369] system 00:07: [mem 0x000f0000-0x000fffff] could not be reserved
[    1.472438] system 00:07: [mem 0x000c0000-0x000cffff] could not be reserved
[    1.472506] system 00:07: [mem 0xfec00000-0xfecfffff] could not be reserved
[    1.472574] system 00:07: [mem 0xfee00000-0xfeefffff] has been reserved
[    1.472642] system 00:07: [mem 0xfed20000-0xfed9ffff] has been reserved
[    1.472709] system 00:07: [mem 0xffb00000-0xffbfffff] has been reserved
[    1.472777] system 00:07: [mem 0xffc00000-0xffffffff] has been reserved
[    1.472845] system 00:07: Plug and Play ACPI device, IDs PNP0c01 (active)
[    1.473247] pnp 00:08: [mem 0xf0000000-0xf3ffffff]
[    1.473251] pnp 00:08: [mem 0xfeda0000-0xfedacfff]
[    1.473331] system 00:08: [mem 0xf0000000-0xf3ffffff] has been reserved
[    1.473399] system 00:08: [mem 0xfeda0000-0xfedacfff] has been reserved
[    1.473468] system 00:08: Plug and Play ACPI device, IDs PNP0c02 (active)
[    1.473478] pnp: PnP ACPI: found 9 devices
[    1.473539] ACPI: ACPI bus type pnp unregistered
[    1.482062] pci 0000:05:07.0: address space collision: [mem 0xfe500000-0xfe50ffff pref] conflicts with 0000:05:02.0 [mem 0xfe500000-0xfe50ffff pref]
[    1.482165] PCI: max bus depth: 1 pci_try_num: 2
[    1.482215] pci 0000:00:1f.2: BAR 5: assigned [mem 0xf4000000-0xf40003ff]
[    1.482287] pci 0000:00:1f.2: BAR 5: set to [mem 0xf4000000-0xf40003ff] (PCI address [0xf4000000-0xf40003ff])
[    1.482381] pci 0000:00:1c.5: BAR 15: assigned [mem 0xf4100000-0xf42fffff 64bit pref]
[    1.482470] pci 0000:00:1c.5: BAR 13: assigned [io  0x1000-0x1fff]
[    1.482537] pci 0000:00:1c.4: BAR 15: assigned [mem 0xf4300000-0xf44fffff 64bit pref]
[    1.482624] pci 0000:00:1c.0: BAR 15: assigned [mem 0xf4500000-0xf46fffff 64bit pref]
[    1.482711] pci 0000:00:1c.0: BAR 13: assigned [io  0x2000-0x2fff]
[    1.482778] pci 0000:00:01.0: PCI bridge to [bus 01-01]
[    1.482844] pci 0000:00:01.0:   bridge window [mem 0xfea00000-0xfeafffff]
[    1.482917] pci 0000:00:1c.0: PCI bridge to [bus 02-02]
[    1.482983] pci 0000:00:1c.0:   bridge window [io  0x2000-0x2fff]
[    1.483052] pci 0000:00:1c.0:   bridge window [mem 0xfe900000-0xfe9fffff]
[    1.483123] pci 0000:00:1c.0:   bridge window [mem 0xf4500000-0xf46fffff 64bit pref]
[    1.483214] pci 0000:00:1c.4: PCI bridge to [bus 03-03]
[    1.483281] pci 0000:00:1c.4:   bridge window [io  0xd000-0xdfff]
[    1.483350] pci 0000:00:1c.4:   bridge window [mem 0xfe700000-0xfe8fffff]
[    1.483420] pci 0000:00:1c.4:   bridge window [mem 0xf4300000-0xf44fffff 64bit pref]
[    1.483512] pci 0000:00:1c.5: PCI bridge to [bus 04-04]
[    1.483578] pci 0000:00:1c.5:   bridge window [io  0x1000-0x1fff]
[    1.483647] pci 0000:00:1c.5:   bridge window [mem 0xfe600000-0xfe6fffff]
[    1.483717] pci 0000:00:1c.5:   bridge window [mem 0xf4100000-0xf42fffff 64bit pref]
[    1.483812] pci 0000:05:07.0: BAR 6: assigned [mem 0xfe400000-0xfe40ffff pref]
[    1.483899] pci 0000:00:1e.0: PCI bridge to [bus 05-05]
[    1.483964] pci 0000:00:1e.0:   bridge window [io  0xc000-0xcfff]
[    1.484049] pci 0000:00:1e.0:   bridge window [mem 0xfe400000-0xfe5fffff]
[    1.484120] pci 0000:00:1e.0:   bridge window [mem 0xfc000000-0xfdffffff 64bit pref]
[    1.484231] pci 0000:00:01.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
[    1.484302] pci 0000:00:01.0: setting latency timer to 64
[    1.484312] pci 0000:00:1c.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
[    1.484381] pci 0000:00:1c.0: setting latency timer to 64
[    1.484390] pci 0000:00:1c.4: PCI INT A -> GSI 16 (level, low) -> IRQ 16
[    1.484459] pci 0000:00:1c.4: setting latency timer to 64
[    1.484479] pci 0000:00:1c.5: PCI INT B -> GSI 17 (level, low) -> IRQ 17
[    1.484549] pci 0000:00:1c.5: setting latency timer to 64
[    1.484559] pci 0000:00:1e.0: setting latency timer to 64
[    1.484566] pci_bus 0000:00: resource 0 [io  0x0000-0xffff]
[    1.484569] pci_bus 0000:00: resource 1 [mem 0x00000000-0xfffffffff]
[    1.484573] pci_bus 0000:01: resource 1 [mem 0xfea00000-0xfeafffff]
[    1.484576] pci_bus 0000:02: resource 0 [io  0x2000-0x2fff]
[    1.484579] pci_bus 0000:02: resource 1 [mem 0xfe900000-0xfe9fffff]
[    1.484583] pci_bus 0000:02: resource 2 [mem 0xf4500000-0xf46fffff 64bit pref]
[    1.484586] pci_bus 0000:03: resource 0 [io  0xd000-0xdfff]
[    1.484589] pci_bus 0000:03: resource 1 [mem 0xfe700000-0xfe8fffff]
[    1.484593] pci_bus 0000:03: resource 2 [mem 0xf4300000-0xf44fffff 64bit pref]
[    1.484596] pci_bus 0000:04: resource 0 [io  0x1000-0x1fff]
[    1.484599] pci_bus 0000:04: resource 1 [mem 0xfe600000-0xfe6fffff]
[    1.484603] pci_bus 0000:04: resource 2 [mem 0xf4100000-0xf42fffff 64bit pref]
[    1.484606] pci_bus 0000:05: resource 0 [io  0xc000-0xcfff]
[    1.484609] pci_bus 0000:05: resource 1 [mem 0xfe400000-0xfe5fffff]
[    1.484612] pci_bus 0000:05: resource 2 [mem 0xfc000000-0xfdffffff 64bit pref]
[    1.484616] pci_bus 0000:05: resource 4 [io  0x0000-0xffff]
[    1.484619] pci_bus 0000:05: resource 5 [mem 0x00000000-0xfffffffff]
[    1.484674] NET: Registered protocol family 2
[    1.485040] IP route cache hash table entries: 131072 (order: 8, 1048576 bytes)
[    1.487556] TCP established hash table entries: 524288 (order: 11, 8388608 bytes)
[    1.492456] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    1.493042] TCP: Hash tables configured (established 524288 bind 65536)
[    1.493112] TCP reno registered
[    1.493200] UDP hash table entries: 2048 (order: 4, 65536 bytes)
[    1.493316] UDP-Lite hash table entries: 2048 (order: 4, 65536 bytes)
[    1.493539] NET: Registered protocol family 1
[    1.493654] pci 0000:00:1d.0: PCI INT A -> GSI 21 (level, low) -> IRQ 21
[    1.493740] pci 0000:00:1d.0: PCI INT A disabled
[    1.493817] pci 0000:00:1d.1: PCI INT B -> GSI 22 (level, low) -> IRQ 22
[    1.493901] pci 0000:00:1d.1: PCI INT B disabled
[    1.493977] pci 0000:00:1d.2: PCI INT C -> GSI 18 (level, low) -> IRQ 18
[    1.494060] pci 0000:00:1d.2: PCI INT C disabled
[    1.494142] pci 0000:00:1d.3: PCI INT D -> GSI 23 (level, low) -> IRQ 23
[    1.494226] pci 0000:00:1d.3: PCI INT D disabled
[    1.494297] pci 0000:00:1d.7: PCI INT A -> GSI 21 (level, low) -> IRQ 21
[    1.494391] pci 0000:00:1d.7: PCI INT A disabled
[    1.494489] pci 0000:05:07.0: Boot video device
[    1.494496] PCI: CLS 64 bytes, default 64
[    1.494513] Simple Boot Flag at 0x7a set to 0x1
[    1.495058] audit: initializing netlink socket (disabled)
[    1.495134] type=2000 audit(1345481097.488:1): initialized
[    1.533878] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[    1.560034] VFS: Disk quotas dquot_6.5.2
[    1.560186] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    1.561078] fuse init (API version 7.17)
[    1.561290] msgmni has been set to 7524
[    1.561951] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 253)
[    1.562080] io scheduler noop registered
[    1.562142] io scheduler deadline registered
[    1.562256] io scheduler cfq registered (default)
[    1.562482] pcieport 0000:00:01.0: setting latency timer to 64
[    1.562529] pcieport 0000:00:01.0: irq 40 for MSI/MSI-X
[    1.562601] pcieport 0000:00:1c.0: setting latency timer to 64
[    1.562648] pcieport 0000:00:1c.0: irq 41 for MSI/MSI-X
[    1.562727] pcieport 0000:00:1c.4: setting latency timer to 64
[    1.562774] pcieport 0000:00:1c.4: irq 42 for MSI/MSI-X
[    1.562853] pcieport 0000:00:1c.5: setting latency timer to 64
[    1.562899] pcieport 0000:00:1c.5: irq 43 for MSI/MSI-X
[    1.563015] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[    1.563117] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[    1.563382] input: Power Button as /devices/LNXSYSTM:00/device:00/PNP0C0C:00/input/input0
[    1.563475] ACPI: Power Button [VBTN]
[    1.563608] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1
[    1.563696] ACPI: Power Button [PWRF]
[    1.611000] ERST: Table is not found!
[    1.611062] GHES: HEST is not enabled!
[    1.611247] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
[    1.631749] serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    1.800552] 00:06: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
[    1.800938] Linux agpgart interface v0.103
[    1.803349] brd: module loaded
[    1.804632] loop: module loaded
[    1.804993] ata_piix 0000:00:1f.1: version 2.13
[    1.805010] ata_piix 0000:00:1f.1: PCI INT A -> GSI 16 (level, low) -> IRQ 16
[    1.805124] ata_piix 0000:00:1f.1: setting latency timer to 64
[    1.805601] scsi0 : ata_piix
[    1.805780] scsi1 : ata_piix
[    1.805907] ata1: PATA max UDMA/100 cmd 0x1f0 ctl 0x3f6 bmdma 0xffa0 irq 14
[    1.805975] ata2: PATA max UDMA/100 cmd 0x170 ctl 0x376 bmdma 0xffa8 irq 15
[    1.806116] ata1: port disabled--ignoring
[    1.806123] ata_piix 0000:00:1f.2: PCI INT C -> GSI 20 (level, low) -> IRQ 20
[    1.806135] ata_piix 0000:00:1f.2: MAP [ P0 P2 P1 P3 ]
[    1.806180] ata_piix 0000:00:1f.2: setting latency timer to 64
[    1.806326] ata2: port disabled--ignoring
[    1.806667] scsi2 : ata_piix
[    1.806835] scsi3 : ata_piix
[    1.806959] ata3: SATA max UDMA/133 cmd 0xfe00 ctl 0xfe10 bmdma 0xfea0 irq 20
[    1.807027] ata4: SATA max UDMA/133 cmd 0xfe20 ctl 0xfe30 bmdma 0xfea8 irq 20
[    1.807665] Fixed MDIO Bus: probed
[    1.807759] tun: Universal TUN/TAP device driver, 1.6
[    1.807822] tun: (C) 1999-2004 Max Krasnyansky 
[    1.807974] PPP generic driver version 2.4.2
[    1.808224] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    1.808312] ehci_hcd 0000:00:1d.7: PCI INT A -> GSI 21 (level, low) -> IRQ 21
[    1.808402] ehci_hcd 0000:00:1d.7: setting latency timer to 64
[    1.808407] ehci_hcd 0000:00:1d.7: EHCI Host Controller
[    1.808555] ehci_hcd 0000:00:1d.7: new USB bus registered, assigned bus number 1
[    1.808666] ehci_hcd 0000:00:1d.7: using broken periodic workaround
[    1.808742] ehci_hcd 0000:00:1d.7: debug port 1
[    1.812692] ehci_hcd 0000:00:1d.7: cache line size of 64 is not supported
[    1.812714] ehci_hcd 0000:00:1d.7: irq 21, io mem 0xffa80800
[    1.828028] ehci_hcd 0000:00:1d.7: USB 2.0 started, EHCI 1.00
[    1.828283] hub 1-0:1.0: USB hub found
[    1.828348] hub 1-0:1.0: 8 ports detected
[    1.828531] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    1.828617] uhci_hcd: USB Universal Host Controller Interface driver
[    1.828711] uhci_hcd 0000:00:1d.0: PCI INT A -> GSI 21 (level, low) -> IRQ 21
[    1.828786] uhci_hcd 0000:00:1d.0: setting latency timer to 64
[    1.828791] uhci_hcd 0000:00:1d.0: UHCI Host Controller
[    1.828934] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2
[    1.829912] uhci_hcd 0000:00:1d.0: irq 21, io base 0x0000ff80
[    1.830172] hub 2-0:1.0: USB hub found
[    1.830237] hub 2-0:1.0: 2 ports detected
[    1.830396] uhci_hcd 0000:00:1d.1: PCI INT B -> GSI 22 (level, low) -> IRQ 22
[    1.830474] uhci_hcd 0000:00:1d.1: setting latency timer to 64
[    1.830479] uhci_hcd 0000:00:1d.1: UHCI Host Controller
[    1.830608] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3
[    1.830730] uhci_hcd 0000:00:1d.1: irq 22, io base 0x0000ff60
[    1.830982] hub 3-0:1.0: USB hub found
[    1.831047] hub 3-0:1.0: 2 ports detected
[    1.831204] uhci_hcd 0000:00:1d.2: PCI INT C -> GSI 18 (level, low) -> IRQ 18
[    1.831279] uhci_hcd 0000:00:1d.2: setting latency timer to 64
[    1.831283] uhci_hcd 0000:00:1d.2: UHCI Host Controller
[    1.831414] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4
[    1.831537] uhci_hcd 0000:00:1d.2: irq 18, io base 0x0000ff40
[    1.831792] hub 4-0:1.0: USB hub found
[    1.831856] hub 4-0:1.0: 2 ports detected
[    1.832030] uhci_hcd 0000:00:1d.3: PCI INT D -> GSI 23 (level, low) -> IRQ 23
[    1.832104] uhci_hcd 0000:00:1d.3: setting latency timer to 64
[    1.832109] uhci_hcd 0000:00:1d.3: UHCI Host Controller
[    1.832246] uhci_hcd 0000:00:1d.3: new USB bus registered, assigned bus number 5
[    1.832365] uhci_hcd 0000:00:1d.3: irq 23, io base 0x0000ff20
[    1.832628] hub 5-0:1.0: USB hub found
[    1.832693] hub 5-0:1.0: 2 ports detected
[    1.832921] usbcore: registered new interface driver libusual
[    1.833046] i8042: PNP: No PS/2 controller found. Probing ports directly.
[    1.835886] serio: i8042 KBD port at 0x60,0x64 irq 1
[    1.835961] serio: i8042 AUX port at 0x60,0x64 irq 12
[    1.836246] mousedev: PS/2 mouse device common for all mice
[    1.836537] rtc_cmos 00:05: RTC can wake from S4
[    1.836738] rtc_cmos 00:05: rtc core: registered rtc_cmos as rtc0
[    1.836830] rtc0: alarms up to one day, 242 bytes nvram, hpet irqs
[    1.837035] device-mapper: uevent: version 1.0.3
[    1.837224] device-mapper: ioctl: 4.22.0-ioctl (2011-10-19) initialised: dm-devel@redhat.com
[    1.837319] cpuidle: using governor ladder
[    1.837381] cpuidle: using governor menu
[    1.837441] EFI Variables Facility v0.08 2004-May-17
[    1.837874] TCP cubic registered
[    1.838104] NET: Registered protocol family 10
[    1.838894] NET: Registered protocol family 17
[    1.838960] Registering the dns_resolver key type
[    1.839221] PM: Hibernation image not present or could not be loaded.
[    1.839241] registered taskstats version 1
[    1.860093]   Magic number: 8:895:742
[    1.860252] rtc_cmos 00:05: setting system clock to 2012-08-20 16:44:58 UTC (1345481098)
[    1.860363] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found
[    1.860429] EDD information not available.
[    1.976273] ata4.00: ATA-7: WDC WD2500JS-22MHB0, 02.01C03, max UDMA/133
[    1.976347] ata4.00: 488397168 sectors, multi 8: LBA48 
[    1.976552] ata4.01: ATA-7: WDC WD2500JS-22MHB0, 02.01C03, max UDMA/133
[    1.976620] ata4.01: 488397168 sectors, multi 8: LBA48 
[    1.976804] ata3.00: ATA-8: WDC WD3200AAKS-75B3A0, 01.03A01, max UDMA/133
[    1.976881] ata3.00: 625142448 sectors, multi 8: LBA48 NCQ (depth 0/32)
[    1.977096] ata3.01: ATA-7: WDC WD2500JS-22MHB0, 02.01C03, max UDMA/133
[    1.977166] ata3.01: 488397168 sectors, multi 8: LBA48 
[    1.984373] ata4.00: configured for UDMA/133
[    1.984800] ata3.00: configured for UDMA/133
[    1.992365] ata3.01: configured for UDMA/133
[    1.992594] scsi 2:0:0:0: Direct-Access     ATA      WDC WD3200AAKS-7 01.0 PQ: 0 ANSI: 5
[    1.992921] sd 2:0:0:0: [sda] 625142448 512-byte logical blocks: (320 GB/298 GiB)
[    1.992954] sd 2:0:0:0: Attached scsi generic sg0 type 0
[    1.993128] ata4.01: configured for UDMA/133
[    1.993191] scsi 2:0:1:0: Direct-Access     ATA      WDC WD2500JS-22M 02.0 PQ: 0 ANSI: 5
[    1.993334] sd 2:0:0:0: [sda] Write Protect is off
[    1.993402] sd 2:0:0:0: [sda] Mode Sense: 00 3a 00 00
[    1.993441] sd 2:0:1:0: Attached scsi generic sg1 type 0
[    1.993446] sd 2:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    1.993700] sd 2:0:1:0: [sdb] 488397168 512-byte logical blocks: (250 GB/232 GiB)
[    1.993919] scsi 3:0:0:0: Direct-Access     ATA      WDC WD2500JS-22M 02.0 PQ: 0 ANSI: 5
[    1.994214] sd 3:0:0:0: Attached scsi generic sg2 type 0
[    1.994410] scsi 3:0:1:0: Direct-Access     ATA      WDC WD2500JS-22M 02.0 PQ: 0 ANSI: 5
[    1.994681] sd 3:0:1:0: Attached scsi generic sg3 type 0
[    1.994851] sd 3:0:0:0: [sdc] 488397168 512-byte logical blocks: (250 GB/232 GiB)
[    1.994866] sd 3:0:1:0: [sdd] 488397168 512-byte logical blocks: (250 GB/232 GiB)
[    1.994952] sd 3:0:1:0: [sdd] Write Protect is off
[    1.994956] sd 3:0:1:0: [sdd] Mode Sense: 00 3a 00 00
[    1.994991] sd 3:0:1:0: [sdd] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    1.995270] sd 3:0:0:0: [sdc] Write Protect is off
[    1.995336] sd 3:0:0:0: [sdc] Mode Sense: 00 3a 00 00
[    1.995377] sd 3:0:0:0: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    2.012551]  sdd:
[    2.033674]  sdc:
[    2.033784] sd 3:0:1:0: [sdd] Attached SCSI disk
[    2.033992] sd 3:0:0:0: [sdc] Attached SCSI disk
[    2.047231] sd 2:0:1:0: [sdb] Write Protect is off
[    2.047234]  sda: sda1 sda2 < sda5 > sda3 sda4
[    2.047360] sd 2:0:1:0: [sdb] Mode Sense: 00 3a 00 00
[    2.047414] sd 2:0:1:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    2.063323]  sdb:
[    2.063448] sd 2:0:0:0: [sda] Attached SCSI disk
[    2.063630] sd 2:0:1:0: [sdb] Attached SCSI disk
[    2.066142] Freeing unused kernel memory: 920k freed
[    2.066627] Write protecting the kernel read-only data: 12288k
[    2.074908] Freeing unused kernel memory: 1616k freed
[    2.081772] Freeing unused kernel memory: 1200k freed
[    2.114067] udevd[94]: starting version 175
[    2.205994] sata_sil24 0000:03:00.0: version 1.1
[    2.206019] sata_sil24 0000:03:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
[    2.206183] sata_sil24 0000:03:00.0: setting latency timer to 64
[    2.207248] scsi4 : sata_sil24
[    2.207635] scsi5 : sata_sil24
[    2.207777] ata5: SATA max UDMA/100 host m128@0xfe7fbf80 port 0xfe7fc000 irq 16
[    2.207867] ata6: SATA max UDMA/100 host m128@0xfe7fbf80 port 0xfe7fe000 irq 16
[    2.214868] tg3.c:v3.121 (November 2, 2011)
[    2.214950] tg3 0000:04:00.0: PCI INT A -> GSI 17 (level, low) -> IRQ 17
[    2.216097] tg3 0000:04:00.0: setting latency timer to 64
[    2.234346] 3c59x 0000:05:02.0: PCI INT A -> GSI 18 (level, low) -> IRQ 18
[    2.234424] 3c59x: Donald Becker and others.
[    2.234493] 0000:05:02.0: 3Com PCI 3c905 Boomerang 100baseTx at 000000000001cc40.
[    2.263829] tg3 0000:04:00.0: eth0: Tigon3 [partno(BCM95751) rev 4001] (PCI Express) MAC address 00:13:72:14:8e:a4
[    2.263934] tg3 0000:04:00.0: eth0: attached PHY is 5750 (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[0])
[    2.264073] tg3 0000:04:00.0: eth0: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[0] TSOcap[1]
[    2.264164] tg3 0000:04:00.0: eth0: dma_rwctrl[76180000] dma_mask[64-bit]
[    2.492018] Refined TSC clocksource calibration: 2793.072 MHz.
[    2.492091] Switching to clocksource tsc
[    4.408035] ata5: SATA link up 3.0 Gbps (SStatus 123 SControl 0)
[    4.428470] ata5.00: ATA-8: WDC WD5000AAKS-00D2B0, 12.01C02, max UDMA/133
[    4.428539] ata5.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[    4.429507] ata5.00: configured for UDMA/100
[    4.429724] scsi 4:0:0:0: Direct-Access     ATA      WDC WD5000AAKS-0 12.0 PQ: 0 ANSI: 5
[    4.430078] sd 4:0:0:0: [sde] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[    4.430249] sd 4:0:0:0: [sde] Write Protect is off
[    4.430314] sd 4:0:0:0: [sde] Mode Sense: 00 3a 00 00
[    4.430351] sd 4:0:0:0: [sde] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    4.430596] sd 4:0:0:0: Attached scsi generic sg4 type 0
[    4.446632]  sde:
[    4.446970] sd 4:0:0:0: [sde] Attached SCSI disk
[    6.628033] ata6: SATA link up 3.0 Gbps (SStatus 123 SControl 0)
[    6.648133] ata6.00: ATA-8: WDC WD5000AAKS-00D2B0, 12.01C02, max UDMA/133
[    6.648202] ata6.00: 976773168 sectors, multi 0: LBA48 NCQ (depth 31/32)
[    6.649165] ata6.00: configured for UDMA/100
[    6.649361] scsi 5:0:0:0: Direct-Access     ATA      WDC WD5000AAKS-0 12.0 PQ: 0 ANSI: 5
[    6.649656] sd 5:0:0:0: [sdf] 976773168 512-byte logical blocks: (500 GB/465 GiB)
[    6.649815] sd 5:0:0:0: Attached scsi generic sg5 type 0
[    6.649848] sd 5:0:0:0: [sdf] Write Protect is off
[    6.649852] sd 5:0:0:0: [sdf] Mode Sense: 00 3a 00 00
[    6.649888] sd 5:0:0:0: [sdf] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    6.658013]  sdf:
[    6.658343] sd 5:0:0:0: [sdf] Attached SCSI disk
[    6.660631] firewire_ohci 0000:05:04.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
[    6.716065] firewire_ohci: Added fw-ohci device 0000:05:04.0, OHCI v1.0, 8 IR + 8 IT contexts, quirks 0x0
[    7.216165] firewire_core: created device fw0: GUID 0000d10080877a99, S400
[    8.016326] md: linear personality registered for level -1
[    8.019334] md: multipath personality registered for level -4
[    8.021911] md: raid0 personality registered for level 0
[    8.025159] md: raid1 personality registered for level 1
[    8.027709] async_tx: api initialized (async)
[    8.096015] raid6: int64x1   1222 MB/s
[    8.164032] raid6: int64x2   1745 MB/s
[    8.232012] raid6: int64x4   1825 MB/s
[    8.300023] raid6: int64x8   1537 MB/s
[    8.368023] raid6: sse2x1    2007 MB/s
[    8.436023] raid6: sse2x2    3049 MB/s
[    8.504025] raid6: sse2x4    2910 MB/s
[    8.504039] raid6: using algorithm sse2x2 (3049 MB/s)
[    8.504669] xor: automatically using best checksumming function: generic_sse
[    8.524012]    generic_sse:  4296.000 MB/sec
[    8.524028] xor: using function: generic_sse (4296.000 MB/sec)
[    8.525258] md: raid6 personality registered for level 6
[    8.525278] md: raid5 personality registered for level 5
[    8.525295] md: raid4 personality registered for level 4
[    8.533774] md: raid10 personality registered for level 10
[    8.676240] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null)
[   16.733918] SPL: Loaded module v0.6.0.71-rc10
[   16.734405] zunicode: module license 'CDDL' taints kernel.
[   16.734443] Disabling lock debugging due to kernel taint
[   19.279771] ZFS: Loaded module v0.6.0.71-rc10, ZFS pool version 28, ZFS filesystem version 5
[   19.318563] SPL: using hostid 0x007f0101
[   32.504365] ADDRCONF(NETDEV_UP): eth0: link is not ready
[   32.504377] ADDRCONF(NETDEV_UP): eth1: link is not ready
[   32.522050] udevd[743]: starting version 175
[   32.565611] lp: driver loaded but no devices found
[   32.645118] EDAC MC: Ver: 2.1.0
[   32.650845] EDAC MC0: Giving out device to 'i3000_edac' 'i3000': DEV 0000:00:00.0
[   32.650969] EDAC PCI0: Giving out device to module 'i3000_edac' controller 'EDAC PCI controller': DEV '0000:00:00.0' (POLLED)
[   32.660330] Adding 5831676k swap on /dev/sda5.  Priority:-1 extents:1 across:5831676k 
[   32.745280] intel_rng: Firmware space is locked read-only. If you can't or
[   32.745283] intel_rng: don't want to disable this in firmware setup, and if
[   32.745285] intel_rng: you are certain that your system has a functional
[   32.745286] intel_rng: RNG, try using the 'no_fwh_detect' option.
[   32.758031] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro
[   32.759729] type=1400 audit(1345481129.393:2): apparmor="STATUS" operation="profile_load" name="/sbin/dhclient" pid=807 comm="apparmor_parser"
[   32.760153] type=1400 audit(1345481129.397:3): apparmor="STATUS" operation="profile_load" name="/usr/lib/NetworkManager/nm-dhcp-client.action" pid=807 comm="apparmor_parser"
[   32.760353] type=1400 audit(1345481129.397:4): apparmor="STATUS" operation="profile_load" name="/usr/lib/connman/scripts/dhclient-script" pid=807 comm="apparmor_parser"
[   32.767954] xgifb: module is from the staging directory, the quality is unknown, you have been warned.
[   32.769804] type=1400 audit(1345481129.405:5): apparmor="STATUS" operation="profile_load" name="/usr/sbin/ntpd" pid=817 comm="apparmor_parser"
[   32.772859] udevd[757]: renamed network interface eth1 to eth2
[   32.774956] leds_ss4200: no LED devices found
[   32.797042] XGIfb: Relocate IO address: cc80 [00000000]
[   32.797063] XGIfb:chipid = 30
[   32.797066] XGIfb: Video ROM usage disabled
[   32.797071] XGIfb: SR14=41 DramSzie 1000000 ChannelNum 1
[   32.810056] ip_tables: (C) 2000-2006 Netfilter Core Team
[   32.819455] XGIfb: Framebuffer at 0xfc000000, mapped to 0xffffc9000cb80000, size 16384k
[   32.819461] XGIfb: MMIO at 0xfe4c0000, mapped to 0xffffc9000dc00000, size 256k
[   32.819464] XGIfb: XGIInitNew() ...12345678910111215171818118218319202122232425OK
[   32.827490] XGIfb: No or unknown bridge type detected
[   32.827495] XGIfb: Default mode is 800x600x16 (60Hz)
[   32.828430] mtrr: type mismatch for fc000000,1000000 old: write-back new: write-combining
[   32.828438] xgifb 0000:05:07.0: added MTRR
[   32.828556] fbcon:  (fb0) is primary device
[   32.829347] XGIfb: var->pixclock=25000, htotal=1056, vtotal=1256
[   32.829351] XGIfb: Change mode to 800x600x16-60Hz
[   32.866764] Console: switching to colour frame buffer device 100x37
[   32.907532] nf_conntrack version 0.5.0 (16384 buckets, 65536 max)
[   33.042602] ADDRCONF(NETDEV_UP): eth0: link is not ready
[   33.047934] eth2:  setting full-duplex.
[   33.312928] dcdbas dcdbas: Dell Systems Management Base Driver (version 5.6.0-3.2)
[   34.172498] RPC: Registered named UNIX socket transport module.
[   34.172502] RPC: Registered udp transport module.
[   34.172504] RPC: Registered tcp transport module.
[   34.172506] RPC: Registered tcp NFSv4.1 backchannel transport module.
[   34.178373] FS-Cache: Loaded
[   34.189982] FS-Cache: Netfs 'nfs' registered for caching
[   34.203807] Installing knfsd (copyright (C) 1996 okir@monad.swb.de).
[   34.565785] ppdev: user-space parallel port driver
[   34.616445] init: udev-fallback-graphics main process (1258) terminated with status 1
[   34.731428] type=1400 audit(1345481131.365:6): apparmor="STATUS" operation="profile_load" name="/usr/lib/cups/backend/cups-pdf" pid=1306 comm="apparmor_parser"
[   34.734013] type=1400 audit(1345481131.369:7): apparmor="STATUS" operation="profile_load" name="/usr/sbin/cupsd" pid=1306 comm="apparmor_parser"
[   36.198852] tg3 0000:04:00.0: eth0: Link is up at 1000 Mbps, full duplex
[   36.198857] tg3 0000:04:00.0: eth0: Flow control is on for TX and on for RX
[   36.199493] ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[   37.393382] init: failsafe main process (1222) killed by TERM signal
[   37.525375] type=1400 audit(1345481134.161:8): apparmor="STATUS" operation="profile_load" name="/usr/bin/freshclam" pid=1560 comm="apparmor_parser"
[   37.525612] type=1400 audit(1345481134.161:9): apparmor="STATUS" operation="profile_replace" name="/sbin/dhclient" pid=1559 comm="apparmor_parser"
[   37.526027] type=1400 audit(1345481134.161:10): apparmor="STATUS" operation="profile_replace" name="/usr/lib/NetworkManager/nm-dhcp-client.action" pid=1559 comm="apparmor_parser"
[   37.526230] type=1400 audit(1345481134.161:11): apparmor="STATUS" operation="profile_replace" name="/usr/lib/connman/scripts/dhclient-script" pid=1559 comm="apparmor_parser"
[   37.820713] audit_printk_skb: 24 callbacks suppressed
[   37.820717] type=1400 audit(1345481134.457:20): apparmor="DENIED" operation="mknod" parent=1639 profile="/usr/sbin/named" name="/run/named/named.pid" pid=1659 comm="named" requested_mask="c" denied_mask="c" fsuid=107 ouid=107
[   37.821002] type=1400 audit(1345481134.457:21): apparmor="DENIED" operation="mknod" parent=1639 profile="/usr/sbin/named" name="/run/named/session.key" pid=1659 comm="named" requested_mask="c" denied_mask="c" fsuid=107 ouid=107
[   37.835937] type=1400 audit(1345481134.469:22): apparmor="STATUS" operation="profile_replace" name="/usr/sbin/mysqld" pid=1672 comm="apparmor_parser"
[   37.868250] init: Failed to spawn mysql main process: unable to execute: No such file or directory
[   38.995741] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
[   38.999111] NFSD: starting 90-second grace period
[   39.400095] init: idmapd main process (2024) terminated with status 1
[   39.400142] init: idmapd main process ended, respawning
[   40.353132] init: plymouth-upstart-bridge main process (1266) killed by TERM signal
[   43.864009] eth2: no IPv6 routers present
[   46.384010] eth0: no IPv6 routers present
@behlendorf
Copy link
Contributor

This is the first report I've seen of this issue. It's possible it was accidentally introduced by some of the Illumos backports, we'll need to investigate further to get to the bottom of it.

@droebbel
Copy link

I just ran into the very same issue both on my main system and on a live cd with fresh ubuntu-zfs installed from the stable ppa. It worked again after downgrading libzfs from 0.6.0.71-0ubuntu1precise1 to an old 0.6.0.62-0ubuntu1oneiric1 I still had in the cache.

@behlendorf
Copy link
Contributor

@vx This looks like an issue introduced by commit 330d06f which was an Illumos backport. Interestingly, there doesn't appear to be a fix for this upstream. So either they haven't noticed yet, or circumstances are such that it just hasn't caused problems.

@droebbel At a minimum it would be nice to handle the error similarly to get_clones_cb(). Can you add the following debug patch to your build so the next time it occurs we'll get a little more information about exactly what caused the failure.

behlendorf/zfs@6900a8a

@mmatuska
Copy link
Contributor

This is strange - I am unable to reproduce this behavior on FreeBSD or OpenIndiana.

@mmatuska mmatuska mentioned this issue Aug 21, 2012
Closed
@mmatuska
Copy link
Contributor

This is zfsonlinux-specific code.
We need to initialize and free the new destroydata nvlist on recursive rename (checking of zvol links).
Fix: 8ac4ba0
Pull request #878

@droebbel
Copy link

With the debug patch above, I get the following:

zfs rename -r wawabackup01@alt wawabackup01@modrig
snapname wawabackup01/home@alt could not be added to nvlist (nil): 22

Going to test mmatuskas fix in a minute...
... works. Fantastic work, thanks a lot for such a prompt fix!

@mmatuska mmatuska mentioned this issue Aug 21, 2012
Closed
@mmatuska
Copy link
Contributor

I have added a minimalistic version of the fix: 774d61b

@behlendorf
Copy link
Contributor

Thanks for the fix. It looks good to me and nicely explains why this was a Linux only issue. I'll run it through the automated tests here and hopefully get it in to the tree tomorrow.

pcd1193182 pushed a commit to pcd1193182/zfs that referenced this issue Sep 26, 2023
@ahrens
clean up logging (openzfs#876)
3baacf6 
Configure logging to only log our own packages at DEBUG/TRACE.  This way
we don't have to keep adding too-chatty 3rd party packages to the
exception list.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
0.6.0-rc11
4 participants
@behlendorf @mmatuska @mctroyd @droebbel