Hwo to identify HDD location

[xlameee]

I have a 11 ssd x 1TB in raidz1 and on had failed, but I don't know how to identified on server or is it the way to fix the drive ????

My setup is on DELL R720 with 16-bay

 

[Hellione]

have a look at storage-disks, there are serial numbers of each drive

 

[xlameee]

have a look at storage-disks, there are serial numbers of each drive

There are none for the SSD's only. Actually all disk that are in the server doesn't show serial number, but the disk that are in the MD1200 witch is connected to this server have serial numbers

 

[sretalla]

You're using the wrong type of storage attachment. That's a RAID card, which means TrueNAS has no direct access to the disks and can't even see the serial numbers.

You need an HBA card instead if you want to protect your data. Back it all up now and get that sorted before doing anything else.

What's all the noise about HBA's, and why can't I use a RAID controller?

This is relevant to FreeNAS and TrueNAS CORE. Some parts of it might also be relevant to Scale, but I don't really know how reliable the Linux drivers are. 1) An HBA is a Host Bus Adapter. This is a controller that allows SAS and SATA devices to be attached to, and communicate directly with...

www.truenas.com

 

[xlameee]

Hello

I use H310 mini witch have HBA pass trough. I always have a backup :)

 

[jgreco]

HBA passthru is not acceptable. You actually need to crossflash the H310 to IT mode.

 

[Hellione]

right, hba passthru passes the whole controller with all its (unwanted raid-)functions from the bare metal machine to the virtualized machine.
if it is a raid-mode card, it will still be a raid-mode card after passthru.
you have to reflash it.

 

[das1996]

I vaguely recall seeing smartctl read drives behind a raid controller. Could of sworn it was one of the lawrence system videos. Didn't pay much attention to it as it didn't apply in my case (already cross flashed). There were some additional parameters used on the smartctl command line.

Maybe it wasn't lawrence system but artof server videos.... I ******think***** it was this one, https://www.youtube.com/watch?v=BgOcCCAzHiY .

 

[HoneyBadger]

You may be able to use the sesutil locate mfisyspd9 utility from a shell prompt, if the RAID card will pass those commands through to the backplane.

However, the other users here are correct that you need to use IT mode firmware, the passthrough on IR mode cards (edit: that use the MFI firmware and drivers) is usually not a good idea.

HBA passthru is not acceptable. You actually need to crossflash the H310 to IT mode.

The PERC H310 specifically really must be reflashed with the LSI firmware, as the stock Dell firmware has horrendously bad queue depth (25) which will negatively impact your performance. If this is a "Mini/Mono" card you have to follow special instructions, but it's still flashable.

 

[jgreco]

the passthrough on IR mode cards is usually not a good idea.

(raises eyebrows)

Actually, IR mode is similar to IT mode except that it adds basic RAID capabilities. IR mode uses the mps driver as well:

mps1: <Avago Technologies (LSI) SAS2008> port 0xec00-0xecff mem 0xdf4b0000-0xdf4bffff,0xdf4c0000-0xdf4fffff irq 40 at device 0.0 on pci4
mps1: Firmware: 20.00.07.00, Driver: 21.02.00.00-fbsd
mps1: IOCCapabilities: 185c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,IR>

There is a slight performance penalty to IR mode, but basically it works very similarly to IT as long as you do not configure a RAID. And if you do configure a RAID, such as for boot, it functions as you'd expect within the mps driver framework. IT mode is just the IR firmware with some stuff #ifdef'd out.

The reason one might run IR mode is to allow the RAID card to handle guaranteed boot. If you have a cripple platform like a 12-bay R510, your only sane option for boot is to install an extra HBA and some SSD's. An LSI HBA in IT mode with a sorta-failing SSD as ID 0 may not boot as it may "see" the SSD and just fail to load, while an IR RAID1 of both SSD's will still show up as a virtual drive, but the IR RAID firmware will happily boot off whichever SSD is willing to provide the blocks (and I have failed M.2 SSD's where this has actually worked in practice). I am not aware of any reason you can't run the IR code, except that it generally doesn't make sense unless you have a good reason like this. Of course, you lose the ZFS benefits of mirroring and this is just a "hardware" RAID1.

The MFI firmware is actually a different beast. It is that which you should not run.

 

[HoneyBadger]

The MFI firmware is actually a different beast. It is that which you should not run.

I was pretty sure I saw Dell cards with "Dell IR firmware" load the mfi driver, which is why I cautioned against it. If I'm wrong here, that's good news.

But the H310 specifically has bad queue depth on any Dell firmware though and needs crossflashing. Other cards like the H200 and M1015 don't have the same requirement.

 

[xlameee]

I was pretty sure I saw Dell cards with "Dell IR firmware" load the mfi driver, which is why I cautioned against it. If I'm wrong here, that's good news.

But the H310 specifically has bad queue depth on any Dell firmware though and needs crossflashing. Other cards like the H200 and M1015 don't have the same requirement.

eBay is full of this cards, but I have been used this configuration from 2018 on the same server. Never had an issue with any HDD until now. They are all original SSD's from 2018. All the issues started when I upgraded to TrueNAS Core

 

[xlameee]

(raises eyebrows)

Actually, IR mode is similar to IT mode except that it adds basic RAID capabilities. IR mode uses the mps driver as well:

mps1: <Avago Technologies (LSI) SAS2008> port 0xec00-0xecff mem 0xdf4b0000-0xdf4bffff,0xdf4c0000-0xdf4fffff irq 40 at device 0.0 on pci4
mps1: Firmware: 20.00.07.00, Driver: 21.02.00.00-fbsd
mps1: IOCCapabilities: 185c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,IR>

There is a slight performance penalty to IR mode, but basically it works very similarly to IT as long as you do not configure a RAID. And if you do configure a RAID, such as for boot, it functions as you'd expect within the mps driver framework. IT mode is just the IR firmware with some stuff #ifdef'd out.

The reason one might run IR mode is to allow the RAID card to handle guaranteed boot. If you have a cripple platform like a 12-bay R510, your only sane option for boot is to install an extra HBA and some SSD's. An LSI HBA in IT mode with a sorta-failing SSD as ID 0 may not boot as it may "see" the SSD and just fail to load, while an IR RAID1 of both SSD's will still show up as a virtual drive, but the IR RAID firmware will happily boot off whichever SSD is willing to provide the blocks (and I have failed M.2 SSD's where this has actually worked in practice). I am not aware of any reason you can't run the IR code, except that it generally doesn't make sense unless you have a good reason like this. Of course, you lose the ZFS benefits of mirroring and this is just a "hardware" RAID1.

The MFI firmware is actually a different beast. It is that which you should not run.

So if I understand what you are saying here if I replace H310 mini IR with H310 mini with IT this SSD will work again.
Nothing is wrong with SSD just need IT firmware to work ?

 

[jgreco]

So if I understand what you are saying here if I replace H310 mini IR with H310 mini with IT this SSD will work again.
Nothing is wrong with SSD just need IT firmware to work ?

You don't have a card with IR firmware. You have a card with MFI firmware. I expect that there are many people who are unfamiliar with the difference.

 

[xlameee]

You don't have a card with IR firmware. You have a card with MFI firmware. I expect that there are many people who are unfamiliar with the difference.

I understand, but if I replace MFI firmware card with IT firmware card the ssd where giving me a problem will work again?

 

[jgreco]

It's hard to know for sure, but the MFI firmware isn't doing you any favors.

 

[HoneyBadger]

I understand, but if I replace MFI firmware card with IT firmware card the ssd where giving me a problem will work again?

We can't know for sure, because there's no statistics available on it. There might be a fault in the device itself, or the RAID controller might have sensed a "predictive" or "potential" fault and kicked it out there.

Did you configure each of the drives as an independent RAID0 in the H310 BIOS, or did you leave them unconfigured? If you set them up as RAID0 devices you may have a challenging path forwards.

 

[xlameee]

We can't know for sure, because there's no statistics available on it. There might be a fault in the device itself, or the RAID controller might have sensed a "predictive" or "potential" fault and kicked it out there.

Did you configure each of the drives as an independent RAID0 in the H310 BIOS, or did you leave them unconfigured? If you set them up as RAID0 devices you may have a challenging path forwards.

No there ware unconfigured

 

[HoneyBadger]

No there ware unconfigured

You should be able to swap in (or cross-flash) your H310 Mini/Mono into LSI IT firmware then, and ZFS will be able to pick up the drives. Out of an abundance of caution though I would suggest picking up an extra H310 Mini/Mono card and flashing that instead, so that you can quickly "revert back" to your previous setting if needed.

 

[xlameee]

You should be able to swap in (or cross-flash) your H310 Mini/Mono into LSI IT firmware then, and ZFS will be able to pick up the drives. Out of an abundance of caution though I would suggest picking up an extra H310 Mini/Mono card and flashing that instead, so that you can quickly "revert back" to your previous setting if needed.

TrueNAS is also connected to H310 will I have problem with booting up the TrueNAS ? It is also unconfigured