FPDMA TRIM fails on ASMedia ASM1061 AHCI SATA controller
Upon trying to install fresh or upgrade from FreeNAS-9.10.2-U2 (e1497f2) with an OWC Mercury Accelsior 2 PCIe mSATA adapter (bootable; used as boot drive), system hangs continually retrying with..
SEND_FPDMA_QUEUED DATA SET MANAGEMENT
CAM status: Command timeout
Works fine in FreeNAS-9.10.2-U2 (e1497f2), but Corral fails with this error. New driver issue?
#3 Updated by Jason Keller over 4 years ago
Screenshot of a video I took to catch the error displayed on the screen during the failed upgrade (it's identical to what appears during an install attempt). I've tried multiple different mSATA drives and even a second identical adapter with multiple different mSATA drives to rule out any hardware defects.
Adapter is in a Supermicro X9SCM with a Xeon E3-1240 and 16GB ECC memory. I've also tried a different chassis with an Intel motherboard that exhibited exactly the same behavior, so it appears entirely isolated to this adapter chipset (ASMedia ASM1061). Please let me know if any further information is needed and I will try to get it to you in as timely a manner as I can.
#4 Updated by Alexander Motin over 4 years ago
- Status changed from 15 to Screened
According to provided screenshot it looks like NCQ command was not completed by the drive, or HBA haven't noticed that. I don't know how this could be related to the driver changes done recent time. I have no good ideas.
#7 Updated by Alexander Motin over 4 years ago
- Status changed from Screened to Investigation
It seems like the problem is related to NCQ version of TRIM command. Either the HBA or the SSD does not handle requests properly and cause timeouts. Disabling NCQ TRIM in run time seems fixes the issue. Same should help global TRIM disable via setting vfs.zfs.trim.enabled=0 loader tunable, but I haven't tried. Unfortunately I have no any NCQ TRIM capable SSD in my lab now to investigate this area deeper easier.