same slot, lots of errors

orddie

Contributor
Joined
Jun 11, 2016
Messages
104
Trying to see if i have a bad slot in the Icy dock MB998SP-B, a bad cable between the Icy dock and the LSI SAS3224, or just a string of bad disks.

Original disk is a 500GB SSD drive. started to show errors so i replaced it. During resilver, the replacement drive had 1800 write errors.
replacing the drive with original drive, allowed the resilver to succeed without issue. a few weeks later, the drive showed errors again.
replacing with another brand new drive, showed 1325 write, 30 read, and checksum errors.

Im confidant that trying another drive will give the same results.

suggestions on what to try next?

when i try zpool reset tank <device id>, dmesg shows the following

Code:
[2237536.863058] ata6: hard resetting link
[2237537.176073] ata6: SATA link up 1.5 Gbps (SStatus 113 SControl 310)
[2237537.178647] ata6.00: ACPI cmd ef/10:06:00:00:00:00 (SET FEATURES) succeeded
[2237537.178654] ata6.00: ACPI cmd f5/00:00:00:00:00:00 (SECURITY FREEZE LOCK) filtered out
[2237537.178827] ata6.00: ACPI cmd b1/c1:00:00:00:00:00 (DEVICE CONFIGURATION OVERLAY) filtered out
[2237537.183068] ata6.00: ACPI cmd ef/10:06:00:00:00:00 (SET FEATURES) succeeded
[2237537.183076] ata6.00: ACPI cmd f5/00:00:00:00:00:00 (SECURITY FREEZE LOCK) filtered out
[2237537.183248] ata6.00: ACPI cmd b1/c1:00:00:00:00:00 (DEVICE CONFIGURATION OVERLAY) filtered out
[2237537.185211] ata6.00: configured for UDMA/33
[2237537.185376] sd 6:0:0:0: [sdt] tag#8 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE cmd_age=0s
[2237537.185548] sd 6:0:0:0: [sdt] tag#8 Sense Key : Illegal Request [current]
[2237537.185691] sd 6:0:0:0: [sdt] tag#8 Add. Sense: Unaligned write command
[2237537.185833] sd 6:0:0:0: [sdt] tag#8 CDB: Write(10) 2a 00 00 e2 ff 80 00 02 00 00
[2237537.186002] blk_update_request: I/O error, dev sdt, sector 14876544 op 0x1:(WRITE) flags 0x700 phys_seg 4 prio class 0
[2237537.186186] zio pool=Tank vdev=/dev/disk/by-partuuid/c5c96e79-b234-4603-b1cb-99dee3f34ce0 error=5 type=2 offset=5469241344 size=131072 flags=1808b6
[2237537.186373] zio pool=Tank vdev=/dev/disk/by-partuuid/c5c96e79-b234-4603-b1cb-99dee3f34ce0 error=5 type=2 offset=5469372416 size=131072 flags=1808b6
[2237537.186573] ata6: EH complete
[2237537.229108] ata6.00: exception Emask 0x10 SAct 0x80e0001c SErr 0x400100 action 0x6 frozen
[2237537.229281] ata6.00: irq_stat 0x08000000, interface fatal error
[2237537.229420] ata6: SError: { UnrecovData Handshk }
[2237537.229557] ata6.00: failed command: WRITE FPDMA QUEUED
[2237537.229705] ata6.00: cmd 61/00:10:80:01:e3/01:00:00:00:00/40 tag 2 ncq dma 131072 out
                          res 40/00:bc:00:46:41/00:00:00:00:00/40 Emask 0x10 (ATA bus error)
[2237537.229936] ata6.00: status: { DRDY }
[2237537.230070] ata6.00: failed command: WRITE FPDMA QUEUED
[2237537.230214] ata6.00: cmd 61/10:18:90:5a:38/00:00:3a:00:00/40 tag 3 ncq dma 8192 out
                          res 40/00:bc:00:46:41/00:00:00:00:00/40 Emask 0x10 (ATA bus error)
[2237537.230442] ata6.00: status: { DRDY }
[2237537.230576] ata6.00: failed command: WRITE FPDMA QUEUED
[2237537.230720] ata6.00: cmd 61/10:20:90:5c:38/00:00:3a:00:00/40 tag 4 ncq dma 8192 out
                          res 40/00:bc:00:46:41/00:00:00:00:00/40 Emask 0x10 (ATA bus error)
[2237537.230947] ata6.00: status: { DRDY }
[2237537.231082] ata6.00: failed command: WRITE FPDMA QUEUED
[2237537.231226] ata6.00: cmd 61/38:a8:30:45:41/00:00:00:00:00/40 tag 21 ncq dma 28672 out
                          res 40/00:bc:00:46:41/00:00:00:00:00/40 Emask 0x10 (ATA bus error)
[2237537.231454] ata6.00: status: { DRDY }
[2237537.231589] ata6.00: failed command: WRITE FPDMA QUEUED
[2237537.231733] ata6.00: cmd 61/20:b0:78:45:41/00:00:00:00:00/40 tag 22 ncq dma 16384 out
                          res 40/00:bc:00:46:41/00:00:00:00:00/40 Emask 0x10 (ATA bus error)
[2237537.231961] ata6.00: status: { DRDY }
[2237537.232094] ata6.00: failed command: WRITE FPDMA QUEUED
[2237537.232236] ata6.00: cmd 61/20:b8:00:46:41/00:00:00:00:00/40 tag 23 ncq dma 16384 out
                          res 40/00:bc:00:46:41/00:00:00:00:00/40 Emask 0x10 (ATA bus error)
[2237537.232462] ata6.00: status: { DRDY }
[2237537.232595] ata6.00: failed command: WRITE FPDMA QUEUED
[2237537.232739] ata6.00: cmd 61/20:f8:88:46:41/00:00:00:00:00/40 tag 31 ncq dma 16384 out
                          res 40/00:bc:00:46:41/00:00:00:00:00/40 Emask 0x10 (ATA bus error)
[2237537.232967] ata6.00: status: { DRDY }
[2237537.233137] ata6: hard resetting link
[2237537.548090] ata6: SATA link up 1.5 Gbps (SStatus 113 SControl 310)
[2237537.550618] ata6.00: ACPI cmd ef/10:06:00:00:00:00 (SET FEATURES) succeeded
[2237537.550626] ata6.00: ACPI cmd f5/00:00:00:00:00:00 (SECURITY FREEZE LOCK) filtered out
[2237537.550796] ata6.00: ACPI cmd b1/c1:00:00:00:00:00 (DEVICE CONFIGURATION OVERLAY) filtered out
[2237537.555155] ata6.00: ACPI cmd ef/10:06:00:00:00:00 (SET FEATURES) succeeded
[2237537.555162] ata6.00: ACPI cmd f5/00:00:00:00:00:00 (SECURITY FREEZE LOCK) filtered out
[2237537.555334] ata6.00: ACPI cmd b1/c1:00:00:00:00:00 (DEVICE CONFIGURATION OVERLAY) filtered out
[2237537.557363] ata6.00: configured for UDMA/33
[2237537.557526] sd 6:0:0:0: [sdt] tag#2 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE cmd_age=0s
[2237537.557697] sd 6:0:0:0: [sdt] tag#2 Sense Key : Illegal Request [current]
[2237537.557841] sd 6:0:0:0: [sdt] tag#2 Add. Sense: Unaligned write command
[2237537.557985] sd 6:0:0:0: [sdt] tag#2 CDB: Write(10) 2a 00 00 e3 01 80 00 01 00 00
[2237537.558152] blk_update_request: I/O error, dev sdt, sector 14877056 op 0x1:(WRITE) flags 0x700 phys_seg 2 prio class 0
[2237537.558333] zio pool=Tank vdev=/dev/disk/by-partuuid/c5c96e79-b234-4603-b1cb-99dee3f34ce0 error=5 type=2 offset=5469503488 size=131072 flags=1808b6
[2237537.558545] sd 6:0:0:0: [sdt] tag#21 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE cmd_age=0s
[2237537.558715] sd 6:0:0:0: [sdt] tag#21 Sense Key : Illegal Request [current]
[2237537.558859] sd 6:0:0:0: [sdt] tag#21 Add. Sense: Unaligned write command
[2237537.559001] sd 6:0:0:0: [sdt] tag#21 CDB: Write(10) 2a 00 00 41 45 30 00 00 38 00
[2237537.559168] blk_update_request: I/O error, dev sdt, sector 4277552 op 0x1:(WRITE) flags 0x700 phys_seg 7 prio class 0
[2237537.559345] zio pool=Tank vdev=/dev/disk/by-partuuid/c5c96e79-b234-4603-b1cb-99dee3f34ce0 error=5 type=2 offset=42557440 size=28672 flags=180880
[2237537.559534] sd 6:0:0:0: [sdt] tag#22 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE cmd_age=0s
[2237537.559706] sd 6:0:0:0: [sdt] tag#22 Sense Key : Illegal Request [current]
[2237537.559850] sd 6:0:0:0: [sdt] tag#22 Add. Sense: Unaligned write command
[2237537.559992] sd 6:0:0:0: [sdt] tag#22 CDB: Write(10) 2a 00 00 41 45 78 00 00 20 00
[2237537.560157] blk_update_request: I/O error, dev sdt, sector 4277624 op 0x1:(WRITE) flags 0x700 phys_seg 4 prio class 0
[2237537.560332] zio pool=Tank vdev=/dev/disk/by-partuuid/c5c96e79-b234-4603-b1cb-99dee3f34ce0 error=5 type=2 offset=42594304 size=16384 flags=180880
[2237537.560520] sd 6:0:0:0: [sdt] tag#23 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE cmd_age=0s
[2237537.560689] sd 6:0:0:0: [sdt] tag#23 Sense Key : Illegal Request [current]
[2237537.560833] sd 6:0:0:0: [sdt] tag#23 Add. Sense: Unaligned write command
[2237537.560976] sd 6:0:0:0: [sdt] tag#23 CDB: Write(10) 2a 00 00 41 46 00 00 00 20 00
[2237537.561175] blk_update_request: I/O error, dev sdt, sector 4277760 op 0x1:(WRITE) flags 0x700 phys_seg 4 prio class 0
[2237537.561350] zio pool=Tank vdev=/dev/disk/by-partuuid/c5c96e79-b234-4603-b1cb-99dee3f34ce0 error=5 type=2 offset=42663936 size=16384 flags=180880
[2237537.561540] sd 6:0:0:0: [sdt] tag#31 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE cmd_age=0s
[2237537.561712] sd 6:0:0:0: [sdt] tag#31 Sense Key : Illegal Request [current]
[2237537.561855] sd 6:0:0:0: [sdt] tag#31 Add. Sense: Unaligned write command
[2237537.561997] sd 6:0:0:0: [sdt] tag#31 CDB: Write(10) 2a 00 00 41 46 88 00 00 20 00
[2237537.562163] blk_update_request: I/O error, dev sdt, sector 4277896 op 0x1:(WRITE) flags 0x700 phys_seg 4 prio class 0
[2237537.562338] zio pool=Tank vdev=/dev/disk/by-partuuid/c5c96e79-b234-4603-b1cb-99dee3f34ce0 error=5 type=2 offset=42733568 size=16384 flags=180880
[2237537.562521] ata6: EH complete
[2237537.581105] ata6.00: exception Emask 0x10 SAct 0x400 SErr 0x400100 action 0x6 frozen
[2237537.587630] ata6.00: irq_stat 0x08000000, interface fatal error
[2237537.587771] ata6: SError: { UnrecovData Handshk }
[2237537.587908] ata6.00: failed command: WRITE FPDMA QUEUED
[2237537.588053] ata6.00: cmd 61/10:50:90:5a:38/00:00:3a:00:00/40 tag 10 ncq dma 8192 out
                          res 40/00:54:90:5a:38/00:00:3a:00:00/40 Emask 0x10 (ATA bus error)
[2237537.588281] ata6.00: status: { DRDY }
[2237537.588416] ata6: hard resetting link
[2237537.903984] ata6: SATA link up 1.5 Gbps (SStatus 113 SControl 310)
[2237537.906438] ata6.00: ACPI cmd ef/10:06:00:00:00:00 (SET FEATURES) succeeded
[2237537.906445] ata6.00: ACPI cmd f5/00:00:00:00:00:00 (SECURITY FREEZE LOCK) filtered out
[2237537.906616] ata6.00: ACPI cmd b1/c1:00:00:00:00:00 (DEVICE CONFIGURATION OVERLAY) filtered out
[2237537.910938] ata6.00: ACPI cmd ef/10:06:00:00:00:00 (SET FEATURES) succeeded
[2237537.910946] ata6.00: ACPI cmd f5/00:00:00:00:00:00 (SECURITY FREEZE LOCK) filtered out
[2237537.911120] ata6.00: ACPI cmd b1/c1:00:00:00:00:00 (DEVICE CONFIGURATION OVERLAY) filtered out
[2237537.913036] ata6.00: configured for UDMA/33
[2237537.913193] ata6: EH complete
 

Nick2253

Wizard
Joined
Apr 21, 2014
Messages
1,633
Trying to see if i have a bad slot in the Icy dock MB998SP-B, a bad cable between the Icy dock and the LSI SAS3224, or just a string of bad disks.
Have you tried other slots or other cables?

As a general rule, if you've tried three drives on one set of slots/cables/whatever, and they all have the same errors, then it's probably the slot/cables/whatever that's at fault.
 

orddie

Contributor
Joined
Jun 11, 2016
Messages
104
i did not try and move the disks.
I did not try and move the cables.

new cables arrive tomorrow. ya know, cuz everyone loves shutting down an environment on a Saturday to replace a cable.
 
Top