Project

General

Profile

Bug #75235

System restart at intervals

Added by Danny jackshen 3 months ago. Updated 3 months ago.

Status:
Closed
Priority:
No priority
Assignee:
Alexander Motin
Category:
Hardware
Target version:
Seen in:
Severity:
New
Reason for Closing:
Third Party to Resolve
Reason for Blocked:
Needs QA:
Yes
Needs Doc:
Yes
Needs Merging:
Yes
Needs Automation:
No
Support Suite Ticket:
n/a
Hardware Configuration:
ChangeLog Required:
No
Tags:

Description

After installing the system, the system will hang up at intervals and restart after a period of time.

This is my dmesg:

Copyright (c) 1992-2017 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 11.1-STABLE #0 r321665+6bdfda58b62(HEAD): Thu Dec 20 14:29:17 EST 2018
:/freenas-releng-final/freenas/_BE/objs/freenas-releng-final/freenas/_BE/os/sys/FreeNAS.amd64-DEBU
G amd64
FreeBSD clang version 5.0.0 (tags/RELEASE_500/final 312559) (based on LLVM 5.0.0svn)
WARNING: WITNESS option enabled, expect reduced performance.
CPU: Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz (2095.19-MHz K8-class CPU)
Origin="GenuineIntel" Id=0x406f1 Family=0x6 Model=0x4f Stepping=1
Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,
SS,HTT,TM,PBE>
Features2=0x7ffefbf7<SSE3,PCLMULQDQ,DTES64,DS_CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,M
OVBE,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND>
AMD Features=0x2c100800<SYSCALL,NX,Page1GB,RDTSCP,LM>
AMD Features2=0x121<LAHF,ABM,Prefetch>
Structured Extended Features=0x21cbfbb<FSGSBASE,TSCADJ,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,NFPUSG,PQE,RDSEED,ADX,SMAP,
PROCTRACE>
XSAVE Features=0x1<XSAVEOPT>
VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr
TSC: P-state invariant, performance statistics
real memory = 277025390592 (264192 MB)
avail memory = 266917609472 (254552 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <INSYDE HSW-LPT>
FreeBSD/SMP: Multiprocessor System Detected: 32 CPUs
FreeBSD/SMP: 2 package(s) x 8 core(s) x 2 hardware threads
WARNING: VIMAGE (virtualized network stack) is a highly experimental feature.
ioapic0 <Version 2.0> irqs 0-23 on motherboard
ioapic1 <Version 2.0> irqs 24-47 on motherboard
ioapic2 <Version 2.0> irqs 48-71 on motherboard
SMP: AP CPU #1 Launched!
SMP: AP CPU #18 Launched!
SMP: AP CPU #7 Launched!
SMP: AP CPU #6 Launched!
SMP: AP CPU #16 Launched!
SMP: AP CPU #27 Launched!
SMP: AP CPU #10 Launched!
SMP: AP CPU #11 Launched!
SMP: AP CPU #9 Launched!
SMP: AP CPU #25 Launched!
SMP: AP CPU #14 Launched!
SMP: AP CPU #2 Launched!
SMP: AP CPU #31 Launched!
SMP: AP CPU #5 Launched!
SMP: AP CPU #21 Launched!
SMP: AP CPU #26 Launched!
SMP: AP CPU #23 Launched!
SMP: AP CPU #24 Launched!
SMP: AP CPU #29 Launched!
SMP: AP CPU #17 Launched!
SMP: AP CPU #19 Launched!
SMP: AP CPU #8 Launched!
SMP: AP CPU #22 Launched!
SMP: AP CPU #13 Launched!
SMP: AP CPU #28 Launched!
SMP: AP CPU #20 Launched!
SMP: AP CPU #30 Launched!
SMP: AP CPU #3 Launched!
SMP: AP CPU #12 Launched!
SMP: AP CPU #4 Launched!
SMP: AP CPU #15 Launched!
Timecounter "TSC" frequency 2095190296 Hz quality 1000
random: entropy device external interface
kbd1 at kbdmux0
random: registering fast source Intel Secure Key RNG
random: fast provider: "Intel Secure Key RNG"
nexus0
cryptosoft0: <software crypto> on motherboard
aesni0: <AES-CBC,AES-XTS,AES-GCM,AES-ICM> on motherboard
padlock0: No ACE support.
acpi0: <INSYDE HSW-LPT> on motherboard
acpi0: Power Button (fixed)
cpu0: <ACPI CPU> numa-domain 0 on acpi0
cpu1: <ACPI CPU> numa-domain 0 on acpi0
cpu2: <ACPI CPU> numa-domain 0 on acpi0
cpu3: <ACPI CPU> numa-domain 0 on acpi0
cpu4: <ACPI CPU> numa-domain 0 on acpi0
cpu5: <ACPI CPU> numa-domain 0 on acpi0
cpu6: <ACPI CPU> numa-domain 0 on acpi0
cpu7: <ACPI CPU> numa-domain 0 on acpi0
cpu8: <ACPI CPU> numa-domain 0 on acpi0
cpu9: <ACPI CPU> numa-domain 0 on acpi0
cpu10: <ACPI CPU> numa-domain 0 on acpi0
cpu11: <ACPI CPU> numa-domain 0 on acpi0
cpu12: <ACPI CPU> numa-domain 0 on acpi0
cpu13: <ACPI CPU> numa-domain 0 on acpi0
cpu14: <ACPI CPU> numa-domain 0 on acpi0
cpu15: <ACPI CPU> numa-domain 0 on acpi0
cpu16: <ACPI CPU> numa-domain 1 on acpi0
cpu17: <ACPI CPU> numa-domain 1 on acpi0
cpu18: <ACPI CPU> numa-domain 1 on acpi0
cpu21: <ACPI CPU> numa-domain 1 on acpi0
cpu22: <ACPI CPU> numa-domain 1 on acpi0
cpu23: <ACPI CPU> numa-domain 1 on acpi0
cpu24: <ACPI CPU> numa-domain 1 on acpi0
cpu27: <ACPI CPU> numa-domain 1 on acpi0
cpu28: <ACPI CPU> numa-domain 1 on acpi0
cpu29: <ACPI CPU> numa-domain 1 on acpi0
cpu30: <ACPI CPU> numa-domain 1 on acpi0
cpu31: <ACPI CPU> numa-domain 1 on acpi0
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 350
Event timer "HPET1" frequency 14318180 Hz quality 340
Event timer "HPET2" frequency 14318180 Hz quality 340
Event timer "HPET5" frequency 14318180 Hz quality 340
Event timer "HPET6" frequency 14318180 Hz quality 340
Event timer "HPET7" frequency 14318180 Hz quality 340
atrtc0: <AT realtime clock> port 0x70-0x77 irq 8 on acpi0
atrtc0: Warning: Couldn't map I/O.
atrtc0: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
attimer0: <AT timer> port 0x40-0x43,0x50-0x53 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff numa-domain 0 on acpi0
pci0: <ACPI PCI bus> numa-domain 0 on pcib0
pcib1: <ACPI PCI-PCI bridge> irq 26 at device 1.0 numa-domain 0 on pci0
numa-domain 0 on pci1
mpr0: Firmware: 12.00.02.00, Driver: 18.03.00.00-fbsd
mpr0: IOCCapabilities: 6985c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,IR,MSIXIndex,FastPath,RDPQArray>
pcib2: <ACPI PCI-PCI bridge> irq 32 at device 2.0 numa-domain 0 on pci0
pci2: <ACPI PCI bus> numa-domain 0 on pcib2
igb0: <Intel(R) PRO/1000 Network Connection, Version - 2.5.3-k> port 0x2020-0x203f mem 0x92300000-0x923fffff,0x92404000-0x92407ff
f irq 32 at device 0.0 numa-domain 0 on pci2
igb0: Using MSIX interrupts with 9 vectors
igb0: Ethernet address: dc:99:14:6e:de:57
igb0: Bound queue 0 to cpu 0
igb0: Bound queue 1 to cpu 1
igb0: Bound queue 2 to cpu 2
igb0: Bound queue 3 to cpu 3
igb0: Bound queue 4 to cpu 4
igb0: Bound queue 5 to cpu 5
igb0: Bound queue 6 to cpu 6
igb0: Bound queue 7 to cpu 7
igb1: <Intel(R) PRO/1000 Network Connection, Version - 2.5.3-k> port 0x2000-0x201f mem 0x92200000-0x922fffff,0x92400000-0x92403ff
f irq 36 at device 0.1 numa-domain 0 on pci2
igb1: Using MSIX interrupts with 9 vectors
igb1: Ethernet address: dc:99:14:6e:de:58
igb1: Bound queue 0 to cpu 8
igb1: Bound queue 1 to cpu 9
igb1: Bound queue 2 to cpu 10
igb1: Bound queue 3 to cpu 11
igb1: Bound queue 6 to cpu 14
igb1: Bound queue 7 to cpu 15
pcib3: <ACPI PCI-PCI bridge> irq 32 at device 2.2 numa-domain 0 on pci0
pci3: <ACPI PCI bus> numa-domain 0 on pcib3
pcib4: <ACPI PCI-PCI bridge> irq 40 at device 3.0 numa-domain 0 on pci0
pci4: <ACPI PCI bus> numa-domain 0 on pcib4
pci0: <unknown> at device 17.0 (no driver attached)
ahci0: <Intel Wellsburg AHCI SATA controller> port 0x4078-0x407f,0x408c-0x408f,0x4070-0x4077,0x4088-0x408b,0x4040-0x405f mem 0x92
602000-0x926027ff irq 16 at device 17.4 numa-domain 0 on pci0
ahci0: AHCI v1.30 with 4 6Gbps ports, Port Multiplier not supported
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich3: <AHCI channel> at channel 3 on ahci0
pci0: <simple comms> at device 22.0 (no driver attached)
pci0: <simple comms> at device 22.1 (no driver attached)
usbus0 numa-domain 0 on ehci0
usbus0: 480Mbps High Speed USB v2.0
pcib5: <ACPI PCI-PCI bridge> irq 16 at device 28.0 numa-domain 0 on pci0
pci5: <ACPI PCI bus> numa-domain 0 on pcib5
pcib6: <ACPI PCI-PCI bridge> irq 18 at device 28.2 numa-domain 0 on pci0
vgapci0: Boot video device
pcib7: <ACPI PCI-PCI bridge> irq 19 at device 28.3 numa-domain 0 on pci0
pci7: <ACPI PCI bus> numa-domain 0 on pcib7
usbus1 numa-domain 0 on ehci1
usbus1: 480Mbps High Speed USB v2.0
isab0: <PCI-ISA bridge> at device 31.0 numa-domain 0 on pci0
isa0: <ISA bus> numa-domain 0 on isab0
ahci1: <Intel Wellsburg AHCI SATA controller> port 0x4068-0x406f,0x4084-0x4087,0x4060-0x4067,0x4080-0x4083,0x4020-0x403f mem 0x92
601000-0x926017ff irq 19 at device 31.2 numa-domain 0 on pci0
ahci1: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported
ahcich4: <AHCI channel> at channel 0 on ahci1
ahcich5: <AHCI channel> at channel 1 on ahci1
ahcich6: <AHCI channel> at channel 2 on ahci1
ahcich7: <AHCI channel> at channel 3 on ahci1
ahcich8: <AHCI channel> at channel 4 on ahci1
ahcich9: <AHCI channel> at channel 5 on ahci1
pcib8: <ACPI Host-PCI bridge> port 0xcf8-0xcff numa-domain 1 on acpi0
pci8: <ACPI PCI bus> numa-domain 1 on pcib8
pcib9: <ACPI PCI-PCI bridge> irq 56 at device 2.0 numa-domain 1 on pci8
pci9: <ACPI PCI bus> numa-domain 1 on pcib9
ix0: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 3.2.12-k> port 0x9020-0x903f mem 0xc8400000-0xc87fffff,0xc8a04000-
0xc8a07fff irq 56 at device 0.0 numa-domain 1 on pci9
ix0: Using MSI-X interrupts with 9 vectors
ix0: Ethernet address: dc:99:14:da:8d:e0
ix0: PCI Express Bus: Speed 5.0GT/s Width x8
ix1: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 3.2.12-k> port 0x9000-0x901f mem 0xc8000000-0xc83fffff,0xc8800000-
0xc8803fff irq 60 at device 0.1 numa-domain 1 on pci9
ix1: Using MSI-X interrupts with 9 vectors
ix1: Ethernet address: dc:99:14:da:8d:e1
ix1: PCI Express Bus: Speed 5.0GT/s Width x8
pcib10: <ACPI PCI-PCI bridge> irq 56 at device 2.2 numa-domain 1 on pci8
pci10: <ACPI PCI bus> numa-domain 1 on pcib10
ix2: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 3.2.12-k> port 0x8020-0x803f mem 0xc9400000-0xc97fffff,0xc9a04000-
0xc9a07fff irq 58 at device 0.0 numa-domain 1 on pci10
ix2: PCI Express Bus: Speed 5.0GT/s Width x8
ix3: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 3.2.12-k> port 0x8000-0x801f mem 0xc9000000-0xc93fffff,0xc9800000-
0xc9803fff irq 61 at device 0.1 numa-domain 1 on pci10
ix3: Using MSI-X interrupts with 9 vectors
ix3: Ethernet address: dc:99:14:da:8d:ed
ix3: PCI Express Bus: Speed 5.0GT/s Width x8
pcib11: <ACPI Host-PCI bridge> on acpi0
pci11: <ACPI PCI bus> on pcib11
pci11: <dasp, performance counters> at device 8.2 (no driver attached)
pci11: <dasp, performance counters> at device 9.2 (no driver attached)
pci11: <dasp, performance counters> at device 11.1 (no driver attached)
pci11: <dasp, performance counters> at device 11.2 (no driver attached)
pci11: <dasp, performance counters> at device 16.1 (no driver attached)
pci11: <dasp, performance counters> at device 16.6 (no driver attached)
pci11: <dasp, performance counters> at device 18.1 (no driver attached)
pcib12: <ACPI Host-PCI bridge> on acpi0
pci12: <ACPI PCI bus> on pcib12
pci12: <dasp, performance counters> at device 8.2 (no driver attached)
pci12: <dasp, performance counters> at device 9.2 (no driver attached)
pci12: <dasp, performance counters> at device 11.1 (no driver attached)
pci12: <dasp, performance counters> at device 11.2 (no driver attached)
pci12: <dasp, performance counters> at device 16.1 (no driver attached)
pci12: <dasp, performance counters> at device 16.6 (no driver attached)
pci12: <dasp, performance counters> at device 18.1 (no driver attached)
acpi_syscontainer0: <System Container> on acpi0
acpi_syscontainer1: <System Container> on acpi0
acpi_syscontainer2: <System Container> on acpi0
uart0: <16650 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
ichwd0: <Intel Wellsburg watchdog timer> on isa0
ichwd0: ICH WDT present but disabled in BIOS or hardware
device_attach: ichwd0 attach returned 6
ichwd0: <Intel Wellsburg watchdog timer> at port 0x430-0x437,0x460-0x47f on isa0
ichwd0: ICH WDT present but disabled in BIOS or hardware
device_attach: ichwd0 attach returned 6
orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xd4000-0xd4fff,0xd5000-0xd5fff,0xd6000-0xd6fff,0xd7000-0xd7fff,0xd8000-0xd8fff
on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
coretemp0: <CPU On-Die Thermal Sensors> numa-domain 0 on cpu0
est0: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu0
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1b3200001500
device_attach: est0 attach returned 6
coretemp1: <CPU On-Die Thermal Sensors> numa-domain 0 on cpu1
est1: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu1
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1b3200001500
device_attach: est1 attach returned 6
coretemp2: <CPU On-Die Thermal Sensors> numa-domain 0 on cpu2
est2: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu2
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1b3200001500
device_attach: est2 attach returned 6
coretemp3: <CPU On-Die Thermal Sensors> numa-domain 0 on cpu3
est3: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu3
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1b3200001500
device_attach: est3 attach returned 6
coretemp4: <CPU On-Die Thermal Sensors> numa-domain 0 on cpu4
est4: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu4
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1b3200001500
device_attach: est4 attach returned 6
coretemp5: <CPU On-Die Thermal Sensors> numa-domain 0 on cpu5
est5: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu5
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1b3200001500
device_attach: est5 attach returned 6
coretemp6: <CPU On-Die Thermal Sensors> numa-domain 0 on cpu6
est6: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1b3200001500
device_attach: est6 attach returned 6
coretemp7: <CPU On-Die Thermal Sensors> numa-domain 0 on cpu7
est7: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu7
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1b3200001500
device_attach: est7 attach returned 6
coretemp8: <CPU On-Die Thermal Sensors> numa-domain 0 on cpu8
est8: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu8
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1b3200001500
device_attach: est8 attach returned 6
coretemp9: <CPU On-Die Thermal Sensors> numa-domain 0 on cpu9
est9: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu9
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1b3200001500
device_attach: est9 attach returned 6
coretemp10: <CPU On-Die Thermal Sensors> numa-domain 0 on cpu10
est10: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu10
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1b3200001500
device_attach: est10 attach returned 6
coretemp11: <CPU On-Die Thermal Sensors> numa-domain 0 on cpu11
est11: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu11
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1b3200001500
device_attach: est11 attach returned 6
coretemp12: <CPU On-Die Thermal Sensors> numa-domain 0 on cpu12
est12: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu12
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1b3200001500
device_attach: est12 attach returned 6
coretemp13: <CPU On-Die Thermal Sensors> numa-domain 0 on cpu13
est13: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu13
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1b3200001500
device_attach: est13 attach returned 6
coretemp14: <CPU On-Die Thermal Sensors> numa-domain 0 on cpu14
est14: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu14
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1b3200001500
device_attach: est14 attach returned 6
coretemp15: <CPU On-Die Thermal Sensors> numa-domain 0 on cpu15
est15: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu15
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1b3200001500
device_attach: est15 attach returned 6
coretemp16: <CPU On-Die Thermal Sensors> numa-domain 1 on cpu16
est16: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu16
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1b3200001500
device_attach: est16 attach returned 6
coretemp17: <CPU On-Die Thermal Sensors> numa-domain 1 on cpu17
est17: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu17
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1b3200001500
device_attach: est17 attach returned 6
coretemp18: <CPU On-Die Thermal Sensors> numa-domain 1 on cpu18
est18: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu18
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1b3200001500
device_attach: est18 attach returned 6
coretemp19: <CPU On-Die Thermal Sensors> numa-domain 1 on cpu19
est19: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu19
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1b3200001500
device_attach: est19 attach returned 6
coretemp20: <CPU On-Die Thermal Sensors> numa-domain 1 on cpu20
est20: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu20
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1b3200001500
device_attach: est20 attach returned 6
coretemp21: <CPU On-Die Thermal Sensors> numa-domain 1 on cpu21
est21: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu21
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1b3200001500
device_attach: est21 attach returned 6
coretemp22: <CPU On-Die Thermal Sensors> numa-domain 1 on cpu22
est22: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu22
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1b3200001500
device_attach: est22 attach returned 6
coretemp23: <CPU On-Die Thermal Sensors> numa-domain 1 on cpu23
est23: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu23
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1b3200001500
device_attach: est23 attach returned 6
coretemp24: <CPU On-Die Thermal Sensors> numa-domain 1 on cpu24
est24: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu24
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1b3200001500
device_attach: est24 attach returned 6
coretemp25: <CPU On-Die Thermal Sensors> numa-domain 1 on cpu25
est25: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu25
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1b3200001500
device_attach: est25 attach returned 6
coretemp26: <CPU On-Die Thermal Sensors> numa-domain 1 on cpu26
est26: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu26
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1b3200001500
device_attach: est26 attach returned 6
coretemp27: <CPU On-Die Thermal Sensors> numa-domain 1 on cpu27
est27: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu27
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1b3200001500
device_attach: est27 attach returned 6
coretemp28: <CPU On-Die Thermal Sensors> numa-domain 1 on cpu28
est28: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu28
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1b3200001500
device_attach: est28 attach returned 6
coretemp29: <CPU On-Die Thermal Sensors> numa-domain 1 on cpu29
est29: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu29
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1b3200001500
device_attach: est29 attach returned 6
coretemp30: <CPU On-Die Thermal Sensors> numa-domain 1 on cpu30
est30: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu30
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1b3200001500
device_attach: est30 attach returned 6
coretemp31: <CPU On-Die Thermal Sensors> numa-domain 1 on cpu31
est31: <Enhanced SpeedStep Frequency Control> numa-domain 1 on cpu31
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1b3200001500
device_attach: est31 attach returned 6
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
Timecounters tick every 1.000 msec
freenas_sysctl: adding account.
freenas_sysctl: adding directoryservice.
freenas_sysctl: adding middlewared.
freenas_sysctl: adding network.
freenas_sysctl: adding services.
ipfw2 (+ipv6) initialized, divert enabled, nat enabled, default to accept, logging disabled
lock order reversal:
1st 0xfffff80124ab9c60 CAM device lock (CAM device lock)
/freenas-releng-final/freenas/_BE/os/sys/cam/cam_xpt.c:2468
2nd 0xfffffe00019f4250 MPR lock (MPR lock) @ /freenas-releng-final/freenas/_BE/os/sys/cam/cam_xpt.c:2665
stack backtrace:
#0 0xffffffff80b01150 at witness_debugger+0x70
#1 0xffffffff80b00fd2 at witness_checkorder+0xe02
#2 0xffffffff80a7f8fd at __mtx_lock_flags+0x9d
#3 0xffffffff80328668 at xpt_action_default+0x1c8
#4 0xffffffff8032dedf at xptsetasyncbusfunc+0x10f
#5 0xffffffff8032f42f at xptbustraverse+0x6f
#6 0xffffffff8032dbf3 at xpt_register_async+0x233
#7 0xffffffff80384899 at ctlfeperiphinit+0x19
#8 0xffffffff803239ac at periphdriver_init+0x4c
#9 0xffffffff8032f113 at xpt_config+0xe3
#10 0xffffffff80ad0aec at run_interrupt_driven_config_hooks+0x7c
#11 0xffffffff80ad0cd0 at boot_run_interrupt_driven_config_hooks+0x20
#12 0xffffffff80a3a29c at mi_startup+0x9c
#13 0xffffffff8032202c at btext+0x2c
ugen0.1: <Intel EHCI root HUB> at usbus0
ugen1.1: <Intel EHCI root HUB> at usbus1
uhub0: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus0
uhub1: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
uhub0: 2 ports with 2 removable, self powered
uhub1: 2 ports with 2 removable, self powered
mpr0: SAS Address from SAS device page0 = 5dc991462e1e3000
mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000a> enclosureHandle<0x0002> slot 0
mpr0: At enclosure level 0 and connector name ( )
mpr0: SAS Address from SAS device page0 = 5dc991462e124000
mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000b> enclosureHandle<0x0002> slot 1
mpr0: At enclosure level 0 and connector name ( )
mpr0: SAS Address from SAS device page0 = 5dc991462e125000
mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000c> enclosureHandle<0x0002> slot 2
mpr0: At enclosure level 0 and connector name ( )
mpr0: SAS Address from SAS device page0 = 5dc991462e123000
mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000d> enclosureHandle<0x0002> slot 3
mpr0: At enclosure level 0 and connector name ( )
mpr0: SAS Address from SAS device page0 = 5dc991462e1d4000
mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000e> enclosureHandle<0x0002> slot 4
mpr0: At enclosure level 0 and connector name ( )
mpr0: SAS Address from SAS device page0 = 5dc991462e1a3000
mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x000f> enclosureHandle<0x0002> slot 5
mpr0: At enclosure level 0 and connector name ( )
mpr0: SAS Address from SAS device page0 = 5dc991462e06a000
mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0010> enclosureHandle<0x0002> slot 6
mpr0: At enclosure level 0 and connector name ( )
mpr0: SAS Address from SAS device page0 = 5dc991462e0f2000
mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0011> enclosureHandle<0x0002> slot 7
mpr0: At enclosure level 0 and connector name ( )
mpr0: SAS Address from SAS device page0 = 5dc991462e11e000
mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0012> enclosureHandle<0x0002> slot 8
mpr0: At enclosure level 0 and connector name ( )
mpr0: SAS Address from SAS device page0 = 5dc991462e099000
mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0013> enclosureHandle<0x0002> slot 9
mpr0: At enclosure level 0 and connector name ( )
mpr0: SAS Address from SAS device page0 = 5dc991462e132000
mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0014> enclosureHandle<0x0002> slot 10
mpr0: At enclosure level 0 and connector name ( )
mpr0: SAS Address from SAS device page0 = 5dc991462e1db000
mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0015> enclosureHandle<0x0002> slot 11
mpr0: At enclosure level 0 and connector name ( )
mpr0: SAS Address from SAS device page0 = 5dc991462e1d7000
mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0016> enclosureHandle<0x0002> slot 12
mpr0: At enclosure level 0 and connector name ( )
mpr0: SAS Address from SAS device page0 = 5dc991462e1dc000
mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0017> enclosureHandle<0x0002> slot 13
mpr0: At enclosure level 0 and connector name ( )
mpr0: SAS Address from SAS device page0 = 5dc991462e0ac000
mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0018> enclosureHandle<0x0002> slot 14
mpr0: At enclosure level 0 and connector name ( )
mpr0: SAS Address from SAS device page0 = 5dc991462e201000
mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x0019> enclosureHandle<0x0002> slot 15
mpr0: At enclosure level 0 and connector name ( )
mpr0: SAS Address from SAS device page0 = 5dc991462e1f5000
mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x001a> enclosureHandle<0x0002> slot 16
mpr0: At enclosure level 0 and connector name ( )
mpr0: SAS Address from SAS device page0 = 5dc991462e015000
ugen0.2: <vendor 0x8087 product 0x800a> at usbus0
mpr0: Found device <401<SspTarg>,End Device> <12.0Gbps> handle<0x001b> enclosureHandle<0x0002> slot 17
mpr0: At enclosure level 0 and connector name ( )
mpr0: SAS Address from SAS device page0 = 5080144625878e3e
uhub2mpr0: Found device <4441<SspInit,SspTarg,SepDev>,End Device> <12.0Gbps> handle<0x001c> enclosureHandle<0x0002> slot 36
mpr0: At enclosure level 0 and connector name ( )
numa-domain 0 on uhub0
uhub2: <vendor 0x8087 product 0x800a, class 9/0, rev 2.00/0.05, addr 2> on usbus0
ugen1.2: <vendor 0x8087 product 0x8002> at usbus1
uhub3 numa-domain 0 on uhub1
uhub3: <vendor 0x8087 product 0x8002, class 9/0, rev 2.00/0.05, addr 2> on usbus1
uhub2: 6 ports with 6 removable, self powered
uhub3: 8 ports with 8 removable, self powered
ugen1.3: <vendor 0x12d1 KeyboardMouse KVM 1.1.0> at usbus1
ukbd0 numa-domain 0 on uhub3
ukbd0: <vendor 0x12d1 KeyboardMouse KVM 1.1.0, class 0/0, rev 1.10/1.00, addr 3> on usbus1
kbd0 at ukbd0
random: unblocking device.
ses0 at mpr0 bus 0 scbus0 target 28 lun 0
ses0: <HUAWEI Expander 12Gx28 128> Fixed Enclosure Services SPC-4 SCSI device
ses0: Serial Number 5080144625878e3e
ses0: 1200.000MB/s transfers
ses0: Command Queueing enabled
ses0: SCSI-3 ENC Device
da0 at mpr0 bus 0 scbus0 target 0 lun 0
da1 at mpr0 bus 0 scbus0 target 10 lun 0
da2 at mpr0 bus 0 scbus0 target 11 lun 0
da5 at mpr0 bus 0 scbus0 target 14 lun 0
da4 at mpr0 bus 0 scbus0 target 13 lun 0
da6 at mpr0 bus 0 scbus0 target 15 lun 0
da0: <LSI Logical Volume 3000> Fixed Direct Access SPC-4 SCSI device
da0: Serial Number 1812389732216604874
da0: 150.000MB/s transfers
da0: Command Queueing enabled
da0: 1524925MB (3123046400 512 byte sectors)
da6: <HUAWEI HWE32SS3016M001N 2774> Fixed Direct Access SPC-4 SCSI device
da6: Serial Number 2102311UMK10J7000269
da6: 1200.000MB/s transfers
da6: Command Queueing enabled
da6: 1526185MB (3125627568 512 byte sectors)
da12 at mpr0 bus 0 scbus0 target 21 lun 0
da12: <HUAWEI HWE32SS3016M001N 2774> Fixed Direct Access SPC-4 SCSI device
da12: Serial Number 2102311UMK10J7000273
da12: 1200.000MB/s transfers
da12: Command Queueing enabled
da12: 1526185MB (3125627568 512 byte sectors)
da2: <HUAWEI HWE32SS3016M001N 2774> Fixed Direct Access SPC-4 SCSI device
da2: Serial Number 2102311UMK10J7000088
da2: 1200.000MB/s transfers
da2: Command Queueing enabled
da2: 1526185MB (3125627568 512 byte sectors)
da8 at mpr0 bus 0 scbus0 target 17 lun 0
da8: <HUAWEI HWE32SS3016M001N 2774> Fixed Direct Access SPC-4 SCSI device
da8: Serial Number 2102311UMK10J7000207
da8: 1200.000MB/s transfers
da8: Command Queueing enabled
da8: 1526185MB (3125627568 512 byte sectors)
da5: <HUAWEI HWE32SS3016M001N 2774> Fixed Direct Access SPC-4 SCSI device
da5: Serial Number 2102311UMK10J7000270
da5: 1200.000MB/s transfers
da5: Command Queueing enabled
da5: 1526185MB (3125627568 512 byte sectors)
da11 at mpr0 bus 0 scbus0 target 20 lun 0
da11: <HUAWEI HWE32SS3016M001N 2774> Fixed Direct Access SPC-4 SCSI device
da11: Serial Number 2102311UMK10J7000260
da11: 1200.000MB/s transfersda4: <HUAWEI HWE32SS3016M001N 2774> Fixed Direct Access SPC-4 SCSI device
da4: Serial Number 2102311UMK10J7000263
da4: 1200.000MB/s transfers
da4: Command Queueing enabled
da4: 1526185MB (3125627568 512 byte sectors)
da10 at mpr0 bus 0 scbus0 target 19 lun 0
da10: <HUAWEI HWE32SS3016M001N 2774> Fixed Direct Access SPC-4 SCSI device
da10: Serial Number 2102311UMK10J7000174
da10: 1200.000MB/s transfers
da10: Command Queueing enabled
da10: 1526185MB (3125627568 512 byte sectors)
da16 at mpr0 bus 0 scbus0 target 25 lun 0

da11: Command Queueing enabled
da11: 1526185MB (3125627568 512 byte sectors)
da1: <HUAWEI HWE32SS3016M001N 2774> Fixed Direct Access SPC-4 SCSI device
da1: Serial Number 2102311UMK10J7000204
da1: 1200.000MB/s transfers
da1: Command Queueing enabled
da1: 1526185MB (3125627568 512 byte sectors)
da7 at mpr0 bus 0 scbus0 target 16 lun 0
da3 at mpr0 bus 0 scbus0 target 12 lun 0
da7: <HUAWEI HWE32SS3016M001N 2774> Fixed Direct Access SPC-4 SCSI device
da16: <HUAWEI HWE32SS3016M001N 2774> Fixed Direct Access SPC-4 SCSI device
da16: Serial Number 2102311UMK10J7000079
da16: 1200.000MB/s transfers
da16: Command Queueing enabled
da16: 1526185MB (3125627568 512 byte sectors)
da14 at mpr0 bus 0 scbus0 target 23 lun 0
da14: <HUAWEI HWE32SS3016M001N 2774> Fixed Direct Access SPC-4 SCSI device
da14: Serial Number 2102311UMK10J7000261
da14: 1200.000MB/s transfers
da14: Command Queueing enabled
da14: 1526185MB (3125627568 512 byte sectors)
da3: <HUAWEI HWE32SS3016M001N 2774> Fixed Direct Access SPC-4 SCSI device
da3: Serial Number 2102311UMK10J7000276
da3: 1200.000MB/s transfers
da3: Command Queueing enabled
da3: 1526185MB (3125627568 512 byte sectors)
da9 at mpr0 bus 0 scbus0 target 18 lun 0
da9: <HUAWEI HWE32SS3016M001N 2774> Fixed Direct Access SPC-4 SCSI device
da9: Serial Number 2102311UMK10J7000091
da9: 1200.000MB/s transfers
da9: Command Queueing enabled
da9: 1526185MB (3125627568 512 byte sectors)
da15 at mpr0 bus 0 scbus0 target 24 lun 0
da15: <HUAWEI HWE32SS3016M001N 2774> Fixed Direct Access SPC-4 SCSI device
da15: Serial Number 2102311UMK10J7000140
da15: 1200.000MB/s transfers
da15: Command Queueing enabled
da15: 1526185MB (3125627568 512 byte sectors)
da7: Serial Number 2102311UMK10J7000268
da7: 1200.000MB/s transfers
da7: Command Queueing enabled
da7: 1526185MB (3125627568 512 byte sectors)
da13 at mpr0 bus 0 scbus0 target 22 lun 0
da13: <HUAWEI HWE32SS3016M001N 2774> Fixed Direct Access SPC-4 SCSI device
da13: Serial Number 2102311UMK10J7000087
da13: 1200.000MB/s transfers
da13: Command Queueing enabled
da13: 1526185MB (3125627568 512 byte sectors)
ses0: pass1,da1: Element descriptor: 'Array Device 00 '
ses0: pass1,da1: SAS Device Slot Element: 1 Phys at Slot 0, Not All Phys
ses0: phy 0: SAS device type 1 id 0
ses0: phy 0: protocols: Initiator( None ) Target( SSP )
ses0: phy 0: parent 5080144625878e3f addr 5dc991462e1e3000
ses0: pass2,da2: Element descriptor: 'Array Device 01 '
ses0: pass2,da2: SAS Device Slot Element: 1 Phys at Slot 1, Not All Phys
ses0: phy 0: SAS device type 1 id 0
ses0: phy 0: protocols: Initiator( None ) Target( SSP )
ses0: phy 0: parent 5080144625878e3f addr 5dc991462e124000
ses0: pass3,da3: Element descriptor: 'Array Device 02 '
ses0: pass3,da3: SAS Device Slot Element: 1 Phys at Slot 2, Not All Phys
ses0: phy 0: SAS device type 1 id 0
ses0: phy 0: protocols: Initiator( None ) Target( SSP )
ses0: phy 0: parent 5080144625878e3f addr 5dc991462e125000
ses0: pass4,da4: Element descriptor: 'Array Device 03 '
ses0: pass4,da4: SAS Device Slot Element: 1 Phys at Slot 3, Not All Phys
ses0: phy 0: SAS device type 1 id 0
ses0: phy 0: protocols: Initiator( None ) Target( SSP )
ses0: phy 0: parent 5080144625878e3f addr 5dc991462e123000
ses0: pass5,da5: Element descriptor: 'Array Device 04 '
ses0: pass5,da5: SAS Device Slot Element: 1 Phys at Slot 4, Not All Phys
ses0: phy 0: SAS device type 1 id 0
ses0: phy 0: protocols: Initiator( None ) Target( SSP )
ses0: phy 0: parent 5080144625878e3f addr 5dc991462e1d4000
ses0: pass6,da6: Element descriptor: 'Array Device 05 '
ses0: pass6,da6: SAS Device Slot Element: 1 Phys at Slot 5, Not All Phys
ses0: phy 0: SAS device type 1 id 0
ses0: phy 0: protocols: Initiator( None ) Target( SSP )
ses0: phy 0: parent 5080144625878e3f addr 5dc991462e1a3000
ses0: pass7,da7: Element descriptor: 'Array Device 06 '
ses0: pass7,da7: SAS Device Slot Element: 1 Phys at Slot 6, Not All Phys
ses0: phy 0: SAS device type 1 id 0
ses0: phy 0: protocols: Initiator( None ) Target( SSP )
ses0: phy 0: parent 5080144625878e3f addr 5dc991462e06a000
ses0: pass8,da8: Element descriptor: 'Array Device 07 '
ses0: pass8,da8: SAS Device Slot Element: 1 Phys at Slot 7, Not All Phys
ses0: phy 0: SAS device type 1 id 0
ses0: phy 0: protocols: Initiator( None ) Target( SSP )
ses0: phy 0: parent 5080144625878e3f addr 5dc991462e0f2000
ses0: pass9,da9: Element descriptor: 'Array Device 08 '
ses0: pass9,da9: SAS Device Slot Element: 1 Phys at Slot 8, Not All Phys
ses0: phy 0: SAS device type 1 id 0
ses0: phy 0: protocols: Initiator( None ) Target( SSP )
ses0: phy 0: parent 5080144625878e3f addr 5dc991462e11e000
ses0: pass10,da10: Element descriptor: 'Array Device 09 '
ses0: pass10,da10: SAS Device Slot Element: 1 Phys at Slot 9, Not All Phys
ses0: phy 0: SAS device type 1 id 0
ses0: phy 0: protocols: Initiator( None ) Target( SSP )
ses0: phy 0: parent 5080144625878e3f addr 5dc991462e099000
ses0: pass11,da11: Element descriptor: 'Array Device 10 '
ses0: pass11,da11: SAS Device Slot Element: 1 Phys at Slot 10, Not All Phys
ses0: phy 0: SAS device type 1 id 0
ses0: phy 0: protocols: Initiator( None ) Target( SSP )
ses0: phy 0: parent 5080144625878e3f addr 5dc991462e132000
ses0: pass12,da12: Element descriptor: 'Array Device 11 '
ses0: pass12,da12: SAS Device Slot Element: 1 Phys at Slot 11, Not All Phys
ses0: phy 0: SAS device type 1 id 0
ses0: phy 0: protocols: Initiator( None ) Target( SSP )
ses0: phy 0: parent 5080144625878e3f addr 5dc991462e1db000
ses0: pass13,da13: Element descriptor: 'Array Device 12 '
ses0: pass13,da13: SAS Device Slot Element: 1 Phys at Slot 12, Not All Phys
ses0: phy 0: SAS device type 1 id 0
ses0: phy 0: protocols: Initiator( None ) Target( SSP )
ses0: phy 0: parent 5080144625878e3f addr 5dc991462e1d7000
ses0: pass14,da14: Element descriptor: 'Array Device 13 '
ses0: pass14,da14: SAS Device Slot Element: 1 Phys at Slot 13, Not All Phys
ses0: phy 0: SAS device type 1 id 0
ses0: phy 0: protocols: Initiator( None ) Target( SSP )
ses0: phy 0: parent 5080144625878e3f addr 5dc991462e1dc000
ses0: pass15,da15: Element descriptor: 'Array Device 14 '
ses0: pass15,da15: SAS Device Slot Element: 1 Phys at Slot 14, Not All Phys
ses0: phy 0: SAS device type 1 id 0
ses0: phy 0: protocols: Initiator( None ) Target( SSP )
ses0: phy 0: parent 5080144625878e3f addr 5dc991462e0ac000
ses0: pass16,da16: Element descriptor: 'Array Device 15 '
ses0: pass16,da16: SAS Device Slot Element: 1 Phys at Slot 15, Not All Phys
ses0: phy 0: SAS device type 1 id 0
ses0: phy 0: protocols: Initiator( None ) Target( SSP )
ses0: phy 0: parent 5080144625878e3f addr 5dc991462e201000
igb0: link state changed to UP
igb1: link state changed to UP
warning: KLD '/boot/kernel-debug/vmm.ko' is newer than the linker.hints file
warning: KLD '/boot/kernel-debug/smbus.ko' is newer than the linker.hints file
ichwd0: <Intel Wellsburg watchdog timer> at port 0x430-0x437,0x460-0x47f on isa0
ichwd0: ICH WDT present but disabled in BIOS or hardware
device_attach: ichwd0 attach returned 6
GEOM_RAID5: Module loaded, version 1.3.20140711.62 (rev f91e28e40bf7)
GEOM_MIRROR: Device mirror/swap0 launched (2/2).
GEOM_MIRROR: Device mirror/swap1 launched (2/2).
GEOM_MIRROR: Device mirror/swap2 launched (2/2).
GEOM_MIRROR: Device mirror/swap3 launched (2/2).
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI: Crypto: hardware
GEOM_ELI: Device mirror/swap1.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI: Crypto: hardware
GEOM_ELI: Device mirror/swap2.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI: Crypto: hardware
GEOM_ELI: Device mirror/swap3.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI: Crypto: hardware
GEOM_ELI: Device mirror/swap4.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI: Crypto: hardware
warning: KLD '/boot/kernel-debug/sdt.ko' is newer than the linker.hints file
warning: KLD '/boot/kernel-debug/systrace.ko' is newer than the linker.hints file
warning: KLD '/boot/kernel-debug/systrace_freebsd32.ko' is newer than the linker.hints file
warning: KLD '/boot/kernel-debug/profile.ko' is newer than the linker.hints file
lock order reversal:
1st 0xfffff801aac98d50 tmpfs (tmpfs) /freenas-releng-final/freenas/_BE/os/sys/kern/vfs_mount.c:849
2nd 0xfffff801aac98b78 zfs (zfs)
/freenas-releng-final/freenas/_BE/os/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsop
s.c:1815
stack backtrace:
#0 0xffffffff80b01150 at witness_debugger+0x70
#1 0xffffffff80b00fd2 at witness_checkorder+0xe02
#2 0xffffffff80a75bfe at lockmgr_lock_fast_path+0x1ae
#3 0xffffffff81137698 at VOP_LOCK1_APV+0xe8
#4 0xffffffff80b7af16 at _vn_lock+0x66
#5 0xffffffff804812af at zfs_root+0xcf
#6 0xffffffff80b6174a at vfs_donmount+0x120a
#7 0xffffffff80b60512 at sys_nmount+0x72
#8 0xffffffff80f67538 at amd64_syscall+0x798
#9 0xffffffff80f4665b at Xfast_syscall+0xfb
witness_lock_list_get: witness exhausted
hwpmc: SOFT/16/64/0x67<INT,USR,SYS,REA,WRI> TSC/1/64/0x20<REA> IAP/4/48/0x3ff<INT,USR,SYS,EDG,THR,REA,WRI,INV,QUA,PRC> IAF/3/48/0
x67<INT,USR,SYS,REA,WRI>
warning: KLD '/boot/kernel-debug/t3_tom.ko' is newer than the linker.hints file
warning: KLD '/boot/kernel-debug/toecore.ko' is newer than the linker.hints file
warning: KLD '/boot/kernel-debug/t4_tom.ko' is newer than the linker.hints file
igb0: link state changed to DOWN
igb1: link state changed to DOWN
ix2: link state changed to UP
vlan5: link state changed to UP
ix3: link state changed to UP
igb1: link state changed to UP
vlan4: link state changed to UP
warning: KLD '/boot/kernel-debug/ums.ko' is newer than the linker.hints file
ums0 numa-domain 0 on uhub3
ums0: <vendor 0x12d1 KeyboardMouse KVM 1.1.0, class 0/0, rev 1.10/1.00, addr 3> on usbus1
igb0: link state changed to UPfter installing the system, the system will hang up at intervals and restart after a period of time
.

History

#1 Updated by Danny jackshen 3 months ago

I noticed that memory was exhausted before the system restarted. Memory was used up by the ARC.

#2 Updated by Dru Lavigne 3 months ago

  • Private changed from No to Yes
  • Reason for Blocked set to Need additional information from Author

Danny: please attach a debug (System -> Advanced -> Save debug) to this ticket.

#3 Updated by Danny jackshen 3 months ago

  • File debug-freenas-20190214205104.tgz added

This is debug file

#4 Updated by Danny jackshen 3 months ago

root@freenas:~ # sysctl -a | grep -E '(delete|trim)'
kern.geom.dev.delete_max_sectors: 262144
kern.cam.da.14.delete_max: 1600321314816
kern.cam.da.14.delete_method: UNMAP
kern.cam.da.15.delete_max: 1600321314816
kern.cam.da.15.delete_method: UNMAP
kern.cam.da.9.delete_max: 1600321314816
kern.cam.da.9.delete_method: UNMAP
kern.cam.da.12.delete_max: 1600321314816
kern.cam.da.12.delete_method: UNMAP
kern.cam.da.16.delete_max: 1600321314816
kern.cam.da.16.delete_method: UNMAP
kern.cam.da.10.delete_max: 1600321314816
kern.cam.da.10.delete_method: UNMAP
kern.cam.da.3.delete_max: 1600321314816
kern.cam.da.3.delete_method: UNMAP
kern.cam.da.8.delete_max: 1600321314816
kern.cam.da.8.delete_method: UNMAP
kern.cam.da.13.delete_max: 1600321314816
kern.cam.da.13.delete_method: UNMAP
kern.cam.da.7.delete_max: 1600321314816
kern.cam.da.7.delete_method: UNMAP
kern.cam.da.11.delete_max: 1600321314816
kern.cam.da.11.delete_method: UNMAP
kern.cam.da.6.delete_max: 1600321314816
kern.cam.da.6.delete_method: UNMAP
kern.cam.da.5.delete_max: 1600321314816
kern.cam.da.5.delete_method: UNMAP
kern.cam.da.4.delete_max: 1600321314816
kern.cam.da.4.delete_method: UNMAP
kern.cam.da.2.delete_max: 1600321314816
kern.cam.da.2.delete_method: UNMAP
kern.cam.da.1.delete_max: 1600321314816
kern.cam.da.1.delete_method: UNMAP
kern.cam.da.0.delete_max: 131072
kern.cam.da.0.delete_method: NONE
vfs.zfs.vdev.trim_max_active: 64
vfs.zfs.vdev.trim_min_active: 1
vfs.zfs.vdev.trim_on_init: 1
vfs.zfs.vdev.bio_delete_disable: 0
vfs.zfs.vdev.trim_max_pending: 10000
vfs.zfs.trim.enabled: 1
vfs.zfs.trim.max_interval: 1
vfs.zfs.trim.timeout: 30
vfs.zfs.trim.txg_delay: 32
hw.nvd.delete_max: 1073741824
kstat.zfs.misc.arcstats.deleted: 44
kstat.zfs.misc.zio_trim.failed: 0
kstat.zfs.misc.zio_trim.unsupported: 185
kstat.zfs.misc.zio_trim.success: 21328
kstat.zfs.misc.zio_trim.bytes: 2563391488

I saw "kstat. zfs. misc. zio_trim. unsupported: 185" and "kstat. zfs. misc. zio_trim. success: 21328" and I thought it was bad news.

#5 Updated by Dru Lavigne 3 months ago

  • Assignee changed from Release Council to Alexander Motin
  • Reason for Blocked deleted (Need additional information from Author)

#6 Updated by Alexander Motin 3 months ago

  • Status changed from Unscreened to Blocked
  • Reason for Blocked set to Waiting for feedback

Memory used by ARC is a proper behavior. What is not proper, is a log full of disk-related errors, and I haven't seen other cases like this recently. Error messages tell me about some possible issue between HBA and disks, and since HBA is very widespread, I'd blame Huawei SSDs, which I see first time. Reboots are triggered by ZFS after it detects that some requests didn't complete after any reasonable amount of time. The problem may indeed be related to UNMAP, as you mention, in such case, you can disable it globally by setting loader tunable `vfs.zfs.trim.enabled=0` and rebooting.

But also, why are you using FreeNAS 11.1 for new deployment, while there is already 11.2 (U2 update should be released nearest time)? Also make sure you run latest firmware for HBA, SAS expander and the SSDs.

#7 Updated by Danny jackshen 3 months ago

I execute the command "sysctl vfs. zfs. trim. enabled = 0", but
root@freenas:~ # sysctl vfs.zfs.trim.enabled=0
sysctl: oid 'vfs.zfs.trim.enabled' is a read only tunable
sysctl: Tunable values are set in /boot/loader.conf

then
I added the line "sysctl vfs.zfs.trim.enabled=0" in the file /boot/loader.conf, rebooting
But it didn't work.
root@freenas:~ # sysctl vfs.zfs.trim.enabled
vfs.zfs.trim.enabled: 1

#8 Updated by Alexander Motin 3 months ago

Don't edit any files, just go to System -> Tunables menu and add it there as loader tunable.

#9 Updated by Danny jackshen 3 months ago

Up to now, the system has been running very stable. But ARC always occupies two-thirds of the memory, is this normal?

#10 Updated by Alexander Motin 3 months ago

  • Status changed from Blocked to Closed
  • Target version changed from Backlog to N/A
  • Reason for Closing set to Third Party to Resolve
  • Reason for Blocked deleted (Waiting for feedback)

The memory is there to be used, right? ;)

I am closing this, since it sounds like some issues between Huawei SSD and may be LSI HBA. We do not sell or even have those SSDs to work on this problem.

#11 Updated by Dru Lavigne 3 months ago

  • File deleted (debug-freenas-20190214205104.tgz)

#12 Updated by Dru Lavigne 3 months ago

  • Private changed from Yes to No

Also available in: Atom PDF