Project

General

Profile

Bug #25674

Intel ix hw.ix.unsupported_sfp not working

Added by Mihai Tamas about 3 years ago. Updated about 3 years ago.

Status:
Closed: Cannot reproduce
Priority:
No priority
Assignee:
Alexander Motin
Category:
OS
Target version:
Seen in:
Severity:
New
Reason for Closing:
Reason for Blocked:
Needs QA:
Yes
Needs Doc:
Yes
Needs Merging:
Yes
Needs Automation:
No
Support Suite Ticket:
n/a
Hardware Configuration:

root@freenas:~ # dmesg
Copyright (c) 1992-2017 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 11.0-STABLE #0 r313908+d7d07647f69(freenas/11.0-stable): Thu Jul 20 19:01:05 UTC 2017
root@gauntlet:/freenas-11-releng/freenas/_BE/objs/freenas-11-releng/freenas/_BE/os/sys/FreeNAS.amd64 amd64
FreeBSD clang version 4.0.0 (tags/RELEASE_400/final 297347) (based on LLVM 4.0.0)
VT(efifb): resolution 1024x768
CPU: Intel(R) Xeon(R) CPU D-1531 @ 2.20GHz (2200.04-MHz K8-class CPU)
Origin="GenuineIntel" Id=0x50663 Family=0x6 Model=0x56 Stepping=3
Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
Features2=0x7ffefbff<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND>
AMD Features=0x2c100800<SYSCALL,NX,Page1GB,RDTSCP,LM>
AMD Features2=0x121<LAHF,ABM,Prefetch>
Structured Extended Features=0x21cbfbb<FSGSBASE,TSCADJ,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,NFPUSG,PQE,RDSEED,ADX,SMAP,PROCTRACE>
XSAVE Features=0x1<XSAVEOPT>
VT-x: (disabled in BIOS) PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr
TSC: P-state invariant, performance statistics
real memory = 70866960384 (67584 MB)
avail memory = 66607517696 (63521 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <ALASKA A M I >
FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs
FreeBSD/SMP: 1 package(s) x 6 core(s) x 2 hardware threads
WARNING: VIMAGE (virtualized network stack) is a highly experimental feature.
ioapic0 <Version 2.0> irqs 0-23 on motherboard
ioapic1 <Version 2.0> irqs 24-47 on motherboard
random: entropy device external interface
kbd1 at kbdmux0
module_register_init: MOD_LOAD (vesa, 0xffffffff80fa9d40, 0) error 19
random: registering fast source Intel Secure Key RNG
random: fast provider: "Intel Secure Key RNG"
nexus0
cryptosoft0: <software crypto> on motherboard
aesni0: <AES-CBC,AES-XTS,AES-GCM,AES-ICM> on motherboard
padlock0: No ACE support.
acpi0: <ALASKA A M I > on motherboard
acpi0: Power Button (fixed)
cpu0: <ACPI CPU> numa-domain 0 on acpi0
cpu1: <ACPI CPU> numa-domain 0 on acpi0
cpu2: <ACPI CPU> numa-domain 0 on acpi0
cpu3: <ACPI CPU> numa-domain 0 on acpi0
cpu4: <ACPI CPU> numa-domain 0 on acpi0
cpu5: <ACPI CPU> numa-domain 0 on acpi0
cpu6: <ACPI CPU> numa-domain 0 on acpi0
cpu7: <ACPI CPU> numa-domain 0 on acpi0
cpu8: <ACPI CPU> numa-domain 0 on acpi0
cpu9: <ACPI CPU> numa-domain 0 on acpi0
cpu10: <ACPI CPU> numa-domain 0 on acpi0
cpu11: <ACPI CPU> numa-domain 0 on acpi0
atrtc0: <AT realtime clock> port 0x70-0x71,0x74-0x77 irq 8 on acpi0
Event timer "RTC" frequency 32768 Hz quality 0
attimer0: <AT timer> port 0x40-0x43,0x50-0x53 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 350
Event timer "HPET1" frequency 14318180 Hz quality 340
Event timer "HPET2" frequency 14318180 Hz quality 340
Event timer "HPET3" frequency 14318180 Hz quality 340
Event timer "HPET4" frequency 14318180 Hz quality 340
Event timer "HPET5" frequency 14318180 Hz quality 340
Event timer "HPET6" frequency 14318180 Hz quality 340
Event timer "HPET7" frequency 14318180 Hz quality 340
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
pcib0: <ACPI Host-PCI bridge> on acpi0
pcib0: _OSC returned error 0x10
pci0: <ACPI PCI bus> on pcib0
pci0: <dasp, performance counters> at device 11.1 (no driver attached)
pci0: <dasp, performance counters> at device 11.2 (no driver attached)
pci0: <dasp, performance counters> at device 16.1 (no driver attached)
pci0: <dasp, performance counters> at device 16.6 (no driver attached)
pci0: <dasp, performance counters> at device 18.1 (no driver attached)
pcib1: <ACPI Host-PCI bridge> port 0xcf8-0xcff numa-domain 0 on acpi0
pcib1: _OSC returned error 0x10
pci1: <ACPI PCI bus> numa-domain 0 on pcib1
pcib2: <ACPI PCI-PCI bridge> irq 26 at device 1.0 numa-domain 0 on pci1
pci2: <ACPI PCI bus> numa-domain 0 on pcib2
mpr0: <Avago Technologies (LSI) SAS3008> port 0xe000-0xe0ff mem 0xfb740000-0xfb74ffff,0xfb700000-0xfb73ffff irq 26 at device 0.0 numa-domain 0 on pci2
mpr0: IOCFacts :
MsgVersion: 0x205
HeaderVersion: 0x3000
IOCNumber: 0
IOCExceptions: 0x0
MaxChainDepth: 128
NumberOfPorts: 1
RequestCredit: 10240
ProductID: 0x2221
IOCRequestFrameSize: 32
MaxInitiators: 32
MaxTargets: 1024
MaxSasExpanders: 42
MaxEnclosures: 43
HighPriorityCredit: 128
MaxReplyDescriptorPostQueueDepth: 65504
ReplyFrameSize: 32
MaxVolumes: 0
MaxDevHandle: 1106
MaxPersistentEntries: 128
mpr0: Firmware: 15.00.00.00, Driver: 15.01.00.00-fbsd
mpr0: IOCCapabilities: 7a85c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,MSIXIndex,HostDisc>
pcib3: <ACPI PCI-PCI bridge> irq 32 at device 2.0 numa-domain 0 on pci1
pci3: <ACPI PCI bus> numa-domain 0 on pcib3
pcib4: <ACPI PCI-PCI bridge> irq 32 at device 2.2 numa-domain 0 on pci1
pci4: <ACPI PCI bus> numa-domain 0 on pcib4
ix0: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 3.1.13-k> mem 0xfbc00000-0xfbdfffff,0xfbe04000-0xfbe07fff irq 34 at device 0.0 numa-domain 0 on pci4
ix0: Using MSIX interrupts with 5 vectors
ix0: Ethernet address: a8:1e:84:59:ca:f3
ix1: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 3.1.13-k> mem 0xfba00000-0xfbbfffff,0xfbe00000-0xfbe03fff irq 37 at device 0.1 numa-domain 0 on pci4
ix1: Using MSIX interrupts with 5 vectors
ix1: Ethernet address: a8:1e:84:59:ca:f4
pcib5: <ACPI PCI-PCI bridge> irq 40 at device 3.0 numa-domain 0 on pci1
pci5: <ACPI PCI bus> numa-domain 0 on pcib5
pcib6: <ACPI PCI-PCI bridge> irq 40 at device 3.2 numa-domain 0 on pci1
pci6: <ACPI PCI bus> numa-domain 0 on pcib6
pci1: <simple comms> at device 22.0 (no driver attached)
pci1: <simple comms> at device 22.1 (no driver attached)
pcib7: <ACPI PCI-PCI bridge> irq 16 at device 28.0 numa-domain 0 on pci1
pcib7: [GIANT-LOCKED]
pcib8: <ACPI PCI-PCI bridge> irq 16 at device 28.4 numa-domain 0 on pci1
pci7: <ACPI PCI bus> numa-domain 0 on pcib8
pcib9: <ACPI PCI-PCI bridge> at device 0.0 numa-domain 0 on pci7
pci8: <ACPI PCI bus> numa-domain 0 on pcib9
vgapci0: <VGA-compatible display> port 0xd000-0xd07f mem 0xfa800000-0xfaffffff,0xfb000000-0xfb01ffff irq 16 at device 0.0 numa-domain 0 on pci8
vgapci0: Boot video device
ehci0: <Intel Lynx Point USB 2.0 controller USB-A> mem 0xfb903000-0xfb9033ff irq 18 at device 29.0 numa-domain 0 on pci1
usbus0: EHCI version 1.0
usbus0 numa-domain 0 on ehci0
isab0: <PCI-ISA bridge> at device 31.0 numa-domain 0 on pci1
isa0: <ISA bus> numa-domain 0 on isab0
ahci0: <Intel Lynx Point AHCI SATA controller> port 0xf070-0xf077,0xf060-0xf063,0xf050-0xf057,0xf040-0xf043,0xf020-0xf03f mem 0xfb902000-0xfb9027ff irq 16 at device 31.2 numa-domain 0 on pci1
ahci0: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported
ahcich4: <AHCI channel> at channel 4 on ahci0
ahcich5: <AHCI channel> at channel 5 on ahci0
acpi_button0: <Power Button> on acpi0
ichwd0: <Intel Lynx Point watchdog timer> on isa0
coretemp0: <CPU On-Die Thermal Sensors> numa-domain 0 on cpu0
est0: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu0
coretemp1: <CPU On-Die Thermal Sensors> numa-domain 0 on cpu1
est1: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu1
coretemp2: <CPU On-Die Thermal Sensors> numa-domain 0 on cpu2
est2: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu2
coretemp3: <CPU On-Die Thermal Sensors> numa-domain 0 on cpu3
est3: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu3
coretemp4: <CPU On-Die Thermal Sensors> numa-domain 0 on cpu4
est4: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu4
coretemp5: <CPU On-Die Thermal Sensors> numa-domain 0 on cpu5
est5: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu5
coretemp6: <CPU On-Die Thermal Sensors> numa-domain 0 on cpu6
est6: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu6
coretemp7: <CPU On-Die Thermal Sensors> numa-domain 0 on cpu7
est7: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu7
coretemp8: <CPU On-Die Thermal Sensors> numa-domain 0 on cpu8
est8: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu8
coretemp9: <CPU On-Die Thermal Sensors> numa-domain 0 on cpu9
est9: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu9
coretemp10: <CPU On-Die Thermal Sensors> numa-domain 0 on cpu10
est10: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu10
coretemp11: <CPU On-Die Thermal Sensors> numa-domain 0 on cpu11
est11: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu11
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
Timecounters tick every 1.000 msec
freenas_sysctl: adding account.
usbus0: 480Mbps High Speed USB v2.0
freenas_sysctl: adding directoryservice.
freenas_sysctl: adding middlewared.
freenas_sysctl: adding network.
freenas_sysctl: adding services.
ipfw2 (+ipv6) initialized, divert enabled, nat enabled, default to accept, logging disabled
nvme cam probe device init
ugen0.1: <Intel EHCI root HUB> at usbus0
uhub0: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus0
mpr0: SAS Address for SATA device = a5a7833201cdd097
mpr0: SAS Address from SAS device page0 = 500163600245278c
mpr0: SAS Address from SATA device = a5a7833201cdd097
mpr0: Found device <81<SataDev>,End Device> <12.0Gbps> handle<0x000a> enclosureHandle<0x0002> slot 12
mpr0: At enclosure level 0 and connector name ( )
mpr0: SAS Address from SAS device page0 = 50016360024527bd
mpr0: Found device <4411<SmpInit,SspTarg,SepDev>,End Device> <12.0Gbps> handle<0x000b> enclosureHandle<0x0002> slot 16
mpr0: At enclosure level 0 and connector name ( )
uhub0: 2 ports with 2 removable, self powered
ugen0.2: <vendor 0x8087 product 0x8000> at usbus0
uhub1 numa-domain 0 on uhub0
uhub1: <vendor 0x8087 product 0x8000, class 9/0, rev 2.00/0.05, addr 2> on usbus0
uhub1: 4 ports with 4 removable, self powered
ugen0.3: <American Megatrends Inc. Virtual Hub> at usbus0
uhub2 numa-domain 0 on uhub1
uhub2: <7-port Hub> on usbus0
uhub2: 5 ports with 5 removable, self powered
ugen0.4: <American Megatrends Inc. Virtual Keyboard and Mouse> at usbus0
ukbd0 numa-domain 0 on uhub2
ukbd0: <Keyboard Interface> on usbus0
kbd2 at ukbd0
ugen0.5: <American Megatrends Inc. Virtual Cdrom Device> at usbus0
umass0 numa-domain 0 on uhub2
umass0: <Virtual Cdrom> on usbus0
umass0: SCSI over Bulk-Only; quirks = 0x0100
umass0:4:0: Attached to scbus4
ugen0.6: <American Megatrends Inc. Virtual Floppy Device> at usbus0
umass1 numa-domain 0 on uhub2
umass1: <Virtual Floppy> on usbus0
umass1: SCSI over Bulk-Only; quirks = 0x0100
umass1:5:1: Attached to scbus5
ugen0.7: <American Megatrends Inc. Virtual HardDisk Device> at usbus0
umass2 numa-domain 0 on uhub2
umass2: <Virtual HardDisk> on usbus0
umass2: SCSI over Bulk-Only; quirks = 0x0100
umass2:6:2: Attached to scbus6
ugen0.8: <vendor 0x0424 product 0x2422> at usbus0
uhub3 numa-domain 0 on uhub1
uhub3: <vendor 0x0424 product 0x2422, class 9/0, rev 2.00/2.00, addr 8> on usbus0
uhub3: 2 ports with 0 removable, self powered
ses0 at mpr0 bus 0 scbus0 target 24 lun 0
ses0: <QUANTA D51PH-1ULH 0400> Fixed Enclosure Services SPC-3 SCSI device
ses0: 1200.000MB/s transfers
ses0: Command Queueing enabled
ses0: SCSI-3 ENC Device
ada0 at ahcich4 bus 0 scbus1 target 0 lun 0
ada0: <Samsung SSD 850 PRO 256GB EXM03B6Q> ACS-2 ATA SATA 3.x device
ada0: Serial Number S39KNX0HC10303P
ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes)
ada0: Command Queueing enabled
ada0: 244198MB (500118192 512 byte sectors)
ada0: quirks=0x3<4K,NCQ_TRIM_BROKEN>
ada1 at ahcich5 bus 0 scbus2 target 0 lun 0
cd0 at umass-sim0 bus 0 scbus4 target 0 lun 0
cd0: <AMI Virtual CDROM0 1.00> Removable CD-ROM SCSI device
cd0: Serial Number AAAABBBBCCCC1
cd0: 40.000MB/s transfers
cd0: Attempt to query device size failed: NOT READY, Medium not present
cd0: quirks=0x10<10_BYTE_ONLY>
ada1: <Samsung SSD 850 PRO 256GB EXM03B6Q> ACS-2 ATA SATA 3.x device
ada1: Serial Number S39KNX0HC10309H
ada1: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes)
ada1: Command Queueing enabled
ada1: 244198MB (500118192 512 byte sectors)
ada1: quirks=0x3<4K,NCQ_TRIM_BROKEN>
ses0: da0,pass0: Element descriptor: 'DISK12'
ses0: da0,pass0: SAS Device Slot Element: 1 Phys at Slot 12, Not All Phys
da0 at mpr0 bus 0 scbus0 target 20 lun 0
ses0: phy 0: SATA device
da0: <ATA Samsung SSD 850 4B6Q> Fixed Direct Access SPC-4 SCSI device
ses0: phy 0: parent 50016360024527bf addr 500163600245278c
da0: Serial Number S39KNX0J626886E
da0: 1200.000MB/s transfers
da0: Command Queueing enabled
da0: 244198MB (500118192 512 byte sectors)
da0: quirks=0x8<4K>
da1 at umass-sim1 bus 1 scbus5 target 0 lun 0
da1: <AMI Virtual Floppy0 1.00> Removable Direct Access SCSI device
da1: Serial Number AAAABBBBCCCC2
da1: 40.000MB/s transfers
da1: Attempt to query device size failed: NOT READY, Medium not present
da1: quirks=0x2<NO_6_BYTE>
da2 at umass-sim2 bus 2 scbus6 target 0 lun 0
da2: <AMI Virtual HDISK0 1.00> Removable Direct Access SCSI device
da2: Serial Number AAAABBBBCCCC3
da2: 40.000MB/s transfers
da2: Attempt to query device size failed: NOT READY, Medium not present
da2: quirks=0x2<NO_6_BYTE>
random: unblocking device.
SMP: AP CPU #1 Launched!
SMP: AP CPU #9 Launched!
SMP: AP CPU #8 Launched!
SMP: AP CPU #2 Launched!
SMP: AP CPU #5 Launched!
SMP: AP CPU #7 Launched!
SMP: AP CPU #6 Launched!
SMP: AP CPU #11 Launched!
SMP: AP CPU #10 Launched!
SMP: AP CPU #3 Launched!
SMP: AP CPU #4 Launched!
Timecounter "TSC-low" frequency 1100021410 Hz quality 1000
Trying to mount root from zfs:freenas-boot/ROOT/default []...
vmx_init: VMX operation disabled by BIOS
module_register_init: MOD_LOAD (vmm, 0xffffffff82b1a620, 0) error 6
GEOM_RAID5: Module loaded, version 1.3.20140711.62 (rev f91e28e40bf7)
ipmi0: <IPMI System Interface> port 0xca2,0xca3 on acpi0
ipmi0: KCS mode found at io 0xca2 on acpi
ipmi0: IPMI device rev. 1, firmware rev. 3.12, version 2.0
ipmi0: Number of channels 3
ipmi0: Attached watchdog
hwpmc: SOFT/16/64/0x67<INT,USR,SYS,REA,WRI> TSC/1/64/0x20<REA> IAP/4/48/0x3ff<INT,USR,SYS,EDG,THR,REA,WRI,INV,QUA,PRC> IAF/3/48/0x67<INT,USR,SYS,REA,WRI>

ChangeLog Required:
No

Description

Added tunable hw.ix.unsupported_sfp=1 in System -> Tunables

root@freenas:~ # sysctl -a|grep unsupported
kstat.zfs.misc.zio_trim.unsupported: 0

root@freenas:~ # ifconfig ix1
ix1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=e407bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
ether a8:1e:84:59:ca:f4
inet 10.10.10.12 netmask 0xffffff00 broadcast 10.10.10.255
nd6 options=9<PERFORMNUD,IFDISABLED>
media: Ethernet autoselect
status: no carrier

hw_ix_unsupported_sfp.PNG (8.06 KB) hw_ix_unsupported_sfp.PNG Mihai Tamas, 08/24/2017 04:40 AM
12248

History

#1 Updated by Dru Lavigne about 3 years ago

  • Status changed from Unscreened to 15

Mihai: what are you trying to accomplish by adding this tunable?

Also, please attach a screenshot that shows your Tunable. Finally, is the SFP physically inserted?

#2 Updated by Mihai Tamas about 3 years ago

12248

Hello Dru,

Yes, the SFP is inserted. I am trying to use a SFP/SFP+ modules which is not listed on the Intel approved list.
Attached picture with the defined tunable.
The server was rebooted after applying the tunable.

Cheers!

#3 Updated by Dru Lavigne about 3 years ago

Thanks, Mihai. Please attach a debug (System -> Advanced -> Save Debug) to assist the developer in diagnosing the issue.

#4 Updated by Mihai Tamas about 3 years ago

  • File debug-backup-20170828123019.tgz added

Hello Dru,

Sorry for the late reply, I was traveling for a couple of days.

Attached you can find the debug log.

Cheers,

Mihai

#5 Updated by Dru Lavigne about 3 years ago

  • Assignee changed from Release Council to Alexander Motin
  • Private changed from No to Yes

#6 Updated by Dru Lavigne about 3 years ago

  • Status changed from 15 to Unscreened

#7 Updated by Alexander Motin about 3 years ago

  • Status changed from Unscreened to Closed: Cannot reproduce

This variable exist only as loader tunable, but not as sysctl, that is why you can't read it back. As I see, recently it was changed and in 11.1 there will be a sysctl, but that should only be a cosmetics. I am not sure your problem is in this tunable, since IIRC in case of unsupported SFP module the driver explicitly complained about that in logs, which I don't see in your case.

#8 Updated by Dru Lavigne about 3 years ago

  • File deleted (debug-backup-20170828123019.tgz)

#9 Updated by Dru Lavigne about 3 years ago

  • Target version set to N/A
  • Private changed from Yes to No

Also available in: Atom PDF