Project

General

Profile

Bug #25405

Support hardware with many interrupt vectors, such as Dell R730

Added by Infra ATE over 1 year ago. Updated about 1 year ago.

Status:
Resolved
Priority:
Important
Assignee:
Alexander Motin
Category:
OS
Target version:
Seen in:
Severity:
New
Reason for Closing:
Reason for Blocked:
Needs QA:
No
Needs Doc:
Yes
Needs Merging:
Yes
Needs Automation:
No
Support Suite Ticket:
n/a
Hardware Configuration:

Dell PowerEdge R730
2 PERC H830
1 PERC H730
1 Intel SSD P3520 1.2 TB

ChangeLog Required:
No

Description

I can't install FreeNAS 11 U2 on my Dell PE R730 with 3 storage devices. (PERC H830/H730, PCIe SSD)
This only works with only two PERC or any other combines of 2 PCIE cards.

If I want use more two storage devices i must set hw.mfi.mrsas_enable="0".

Otherwise i have this error message : "panic : couldn't find and APIC for IRQ".

On FreeBSD 11 + hw.mfi.mrsas_enable="1" this works fine.

My firmwares are up to date.

Can you help me?

Associated revisions

Revision 1df39c6f (diff)
Added by Alexander Motin over 1 year ago

Add EARLY_AP_STARTUP kernel option.

It allows to support hardware with many interrupt vectors.

Ticket: #25405

History

#1 Updated by Dru Lavigne over 1 year ago

  • Assignee changed from Release Council to Kris Moore

#2 Avatar?id=14398&size=24x24 Updated by Kris Moore over 1 year ago

  • Category changed from 1 to 129
  • Assignee changed from Kris Moore to Alexander Motin
  • Priority changed from No priority to Important
  • Target version set to 11.1

Interesting, over to Mav for investigation.

#3 Updated by Alexander Motin over 1 year ago

  • Status changed from Unscreened to Screened

The problem seems to be in huge appetite of the LSI controllers and the driver. As I can see from screenshot, driver tries to allocate 47 MSI-X interrupt vectors just for single controller. And during boot stage before SMP is started the number of interrupt vectors is pretty limited. NVMe SSDs may also consume plenty of interrupt vectors. FreeBSD 11.1 fixed that problem by moving SMP startup before PCI device probe, so number of available interrupt vectors is multiplied by number of CPU cores in system. We should get that in FreeNAS 11.1.

#4 Updated by Alexander Motin over 1 year ago

  • Status changed from Screened to 19

I've added required kernel option. Tomorrow nightly build should have this fixed.

#5 Updated by Infra ATE over 1 year ago

  • Category changed from 129 to 1

Alexander Motin wrote:

I've added required kernel option. Tomorrow nightly build should have this fixed.

Thanks i'll try it. :)

#6 Updated by Infra ATE over 1 year ago

I tried the "Nightly Build" and all is working fine.
When this patch will be included in a stable version please?
My server will be soon in production so i need a "Stable" version because a switch from "Nightly Build" to "Stable" is not allowed. :)
Otherwise i can use the stable version with a disabled RAID card and reboot my server in a second step when the patch is out for activate it .
Thanks.

#7 Updated by Alexander Motin over 1 year ago

  • Status changed from 19 to Ready For Release
  • Needs QA changed from Yes to No

It will be part of FreeNAS 11.1 release, which may be released in September.

#8 Updated by Infra ATE over 1 year ago

Super ! :)
Thanks

#9 Updated by Dru Lavigne over 1 year ago

  • Subject changed from Can not install FreeNAS 11 on Dell R730 to Support hardware with many interrupt vectors, such as Dell R730

#10 Updated by Dru Lavigne about 1 year ago

  • Target version changed from 11.1 to 11.1-BETA1

#11 Updated by Dru Lavigne about 1 year ago

  • Status changed from Ready For Release to Resolved

Also available in: Atom PDF