Scrub Speeds?

Status
Not open for further replies.
O

orddie

Contributor
Joined
Jun 11, 2016
Messages
104
8 disks, 10k SAS. getting 62.5M/s in scrub.

what do you think?

(running scrub after replacing a disk to ensure everything is mkay).

System specs
32gb of ram
Intel Intel(R) Core(TM) i3-6100 CPU @ 3.70GHz
LSI Logic Controller Card MegaRAID SAS 9211-8i



Code:
[root@freenas] ~# zpool status -v
  pool: Vmware
state: ONLINE
  scan: scrub in progress since Wed Feb  1 15:14:18 2017
		170G scanned out of 344G at 62.5M/s, 0h47m to go
		0 repaired, 49.46% done
config:

		NAME											STATE	 READ WRITE CKSUM
		Vmware										  ONLINE	   0	 0	 0
		  raidz1-0									  ONLINE	   0	 0	 0
			gptid/e3a88f11-e895-11e6-9c6b-001b21a7c63c  ONLINE	   0	 0	 0
			gptid/a89e4ab3-ae8d-11e6-b089-001b21a7c63c  ONLINE	   0	 0	 0
			gptid/a90d594d-ae8d-11e6-b089-001b21a7c63c  ONLINE	   0	 0	 0
			gptid/a979fb28-ae8d-11e6-b089-001b21a7c63c  ONLINE	   0	 0	 0
		  raidz1-1									  ONLINE	   0	 0	 0
			gptid/a9e56fc8-ae8d-11e6-b089-001b21a7c63c  ONLINE	   0	 0	 0
			gptid/aa5673dc-ae8d-11e6-b089-001b21a7c63c  ONLINE	   0	 0	 0
			gptid/aac48004-ae8d-11e6-b089-001b21a7c63c  ONLINE	   0	 0	 0
			gptid/ab336f0d-ae8d-11e6-b089-001b21a7c63c  ONLINE	   0	 0	 0
 
Last edited:
Ericloewe

Ericloewe

Server Wrangler
Moderator
Joined
Feb 15, 2014
Messages
20,194
That's rather slow. How fragmented is the pool?
 
O

orddie

Contributor
Joined
Jun 11, 2016
Messages
104
O

orddie

Contributor
Joined
Jun 11, 2016
Messages
104
orddie said:
what command will show this?
Click to expand...
found my answer!

Ericloewe said:
That's rather slow. How fragmented is the pool?
Click to expand...
Code:
[root@freenas] ~# zpool list
NAME		   SIZE  ALLOC   FREE  EXPANDSZ   FRAG	CAP  DEDUP  HEALTH  ALTROOT
Vmware		3.25T   344G  2.91T		 -	19%	10%  1.00x  ONLINE  /mnt
freenas-boot  14.8G  2.37G  12.4G		 -	  -	16%  1.00x  ONLINE  -



running FreeNAS-9.10.1-U4 (ec9a7d3)
 
Ericloewe

Ericloewe

Server Wrangler
Moderator
Joined
Feb 15, 2014
Messages
20,194
zpool list
 
Ericloewe

Ericloewe

Server Wrangler
Moderator
Joined
Feb 15, 2014
Messages
20,194
orddie said:
found my answer!


Code:
[root@freenas] ~# zpool list
NAME		   SIZE  ALLOC   FREE  EXPANDSZ   FRAG	CAP  DEDUP  HEALTH  ALTROOT
Vmware		3.25T   344G  2.91T		 -	19%	10%  1.00x  ONLINE  /mnt
freenas-boot  14.8G  2.37G  12.4G		 -	  -	16%  1.00x  ONLINE  -



running FreeNAS-9.10.1-U4 (ec9a7d3)
Click to expand...
Ok, so there might be something nasty going on.

What's the FreeNAS version and the firmware you're using with the SAS HBA?
 
O

orddie

Contributor
Joined
Jun 11, 2016
Messages
104
Ericloewe said:
Ok, so there might be something nasty going on.

What's the FreeNAS version
Click to expand...

orddie said:
running FreeNAS-9.10.1-U4 (ec9a7d3)
Click to expand...
^^^^^

Ericloewe said:
and the firmware you're using with the SAS HBA?
Click to expand...

Code:
lspci
05:00.0 Serial Attached SCSI controller: LSI Logic / Symbios Logic SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon] (rev 03)
[root@freenas] /var/log# mpsutil show adapter
mps0 Adapter:
	   Board Name:
   Board Assembly:
		Chip Name: LSISAS2008
	Chip Revision:
	BIOS Revision: 7.39.02.00
Firmware Revision: 20.00.07.00
  Integrated RAID: no

PhyNum  CtlrHandle  DevHandle  Disabled  Speed   Min	Max	Device
0	   0001		0009	   N		 6.0	 1.5	6.0	SAS Initiator
1	   0003		000b	   N		 6.0	 1.5	6.0	SAS Initiator
2	   0004		000c	   N		 6.0	 1.5	6.0	SAS Initiator
3	   0005		000d	   N		 6.0	 1.5	6.0	SAS Initiator
4	   0002		000a	   N		 6.0	 1.5	6.0	SAS Initiator
5	   0006		000e	   N		 6.0	 1.5	6.0	SAS Initiator
6	   0008		0010	   N		 6.0	 1.5	6.0	SAS Initiator
7	   0007		000f	   N		 6.0	 1.5	6.0	SAS Initiator
 
Last edited:
Ericloewe

Ericloewe

Server Wrangler
Moderator
Joined
Feb 15, 2014
Messages
20,194
Nothing weird there, so let's move on to the drives. One of them may be close to falling, so let's see SMART info for all of them.
smartctl -x /dev/daX
 
Ericloewe

Ericloewe

Server Wrangler
Moderator
Joined
Feb 15, 2014
Messages
20,194
What's the workload, by the way?
 
O

orddie

Contributor
Joined
Jun 11, 2016
Messages
104
Ericloewe said:
Nothing weird there, so let's move on to the drives. One of them may be close to falling, so let's see SMART info for all of them.
smartctl -x /dev/daX
Click to expand...

Keep in mind I'm in the process of replacing smaller drives with larger ones to expand my pool. IM aware the first 600gb (da7) is having issues.

Code:
[root@freenas] ~# smartctl -x /dev/da7
smartctl 6.5 2016-05-07 r4318 [FreeBSD 10.3-STABLE amd64] (local build)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Vendor:			   SEAGATE
Product:			  ST600MM0026
Revision:			 0001
Compliance:		   SPC-4
User Capacity:		600,127,266,816 bytes [600 GB]
Logical block size:   512 bytes
LU is fully provisioned
Rotation Rate:		10500 rpm
Form Factor:		  2.5 inches
Logical Unit id:	  0x5000c500574fb65f
Serial number:		Z0M00TNW00009408915P
Device type:		  disk
Transport protocol:   SAS (SPL-3)
Local Time is:		Thu Feb  2 07:29:45 2017 EST
SMART support is:	 Available - device has SMART capability.
SMART support is:	 Enabled
Temperature Warning:  Enabled
Read Cache is:		Enabled
Writeback Cache is:   Enabled

=== START OF READ SMART DATA SECTION ===
SMART Health Status: OK

Current Drive Temperature:	 34 C
Drive Trip Temperature:		68 C

Manufactured in week  of year 20
Specified cycle count over device lifetime:  10000
Accumulated start-stop cycles:  13
Specified load-unload count over device lifetime:  300000
Accumulated load-unload cycles:  1019
Elements in grown defect list: 0

Vendor (Seagate) cache information
  Blocks sent to initiator = 620403142
  Blocks received from initiator = 1362613997
  Blocks read from cache and sent to initiator = 23094183
  Number of read and write commands whose size <= segment size = 5031318
  Number of read and write commands whose size > segment size = 9536

Vendor (Seagate/Hitachi) factory information
  number of hours powered up = 24208.08
  number of minutes until next internal SMART test = 37

Error counter log:
		   Errors Corrected by		   Total   Correction	 Gigabytes	Total
			   ECC		  rereads/	errors   algorithm	  processed	uncorrected
		   fast | delayed   rewrites  corrected  invocations   [10^9 bytes]  errors
read:   1027402564		0		 0  1027402564		  0		317.646		   0
write:		 0		0		 0		 0		  0		708.664		   0

Non-medium error count:		9


[GLTSD (Global Logging Target Save Disable) set. Enable Save with '-S on']
SMART Self-test log
Num  Test			  Status				 segment  LifeTime  LBA_first_err [SK ASC ASQ]
	 Description							  number   (hours)
# 1  Background long   Completed				   -   24195				 - [-   -	-]
# 2  Background long   Completed				   -   24185				 - [-   -	-]

Long (extended) Self Test duration: 3777 seconds [63.0 minutes]

Background scan results log
  Status: waiting until BMS interval timer expires
	Accumulated power on time, hours:minutes 24208:05 [1452485 minutes]
	Number of background scans performed: 334,  scan progress: 0.00%
	Number of background medium scans performed: 334

   #  when		lba(hex)	[sk,asc,ascq]	reassign_status
   1 10004:23  0000000000b3a51d  [1,17,1]   Recovered via rewrite in-place
   2 10436:19  00000000018a9c64  [1,17,1]   Recovered via rewrite in-place
   3 10580:19  00000000033343b6  [1,17,1]   Recovered via rewrite in-place
   4 10796:15  0000000000b3a516  [1,17,1]   Recovered via rewrite in-place
   5 10868:16  0000000002c9e9cc  [1,17,1]   Recovered via rewrite in-place
   6 11300:11  00000000032282f3  [1,17,1]   Recovered via rewrite in-place
   7 11444:08  00000000018a9c66  [1,17,1]   Recovered via rewrite in-place
   8 11444:08  00000000018a9c67  [1,17,1]   Recovered via rewrite in-place
   9 11660:06  00000000025a7709  [1,17,1]   Recovered via rewrite in-place
  10 12092:00  0000000000b3a51a  [1,17,1]   Recovered via rewrite in-place
  11 12092:00  0000000000b3a51b  [1,17,1]   Recovered via rewrite in-place
  12 12092:00  0000000000b3a51c  [1,17,1]   Recovered via rewrite in-place
  13 12379:58  0000000002c9e9cd  [1,17,1]   Recovered via rewrite in-place
  14 13387:47  0000000002c9e9cb  [1,17,1]   Recovered via rewrite in-place
  15 13459:45  0000000000b3a518  [1,17,1]   Recovered via rewrite in-place
  16 13459:48  0000000004e3d59a  [1,17,1]   Recovered via rewrite in-place
  17 14179:49  0000000010a42b19  [1,17,1]   Recovered via rewrite in-place
  18 14467:37  0000000004838db0  [1,17,1]   Recovered via rewrite in-place
  19 14539:33  0000000000b3a517  [1,17,1]   Recovered via rewrite in-place
  20 14611:46  0000000010a42b1c  [1,17,1]   Recovered via rewrite in-place
  21 14683:44  0000000010a42b20  [1,17,1]   Recovered via rewrite in-place
  22 15620:04  0000000030fd77f5  [1,17,1]   Recovered via rewrite in-place
  23 15763:30  000000000d3cbdef  [1,17,1]   Recovered via rewrite in-place
  24 17059:07  00000000018a9c65  [1,17,1]   Recovered via rewrite in-place
  25 17347:11  000000000b12b081  [1,17,1]   Recovered via rewrite in-place
  26 17347:16  0000000010a42b1b  [1,17,1]   Recovered via rewrite in-place
  27 17635:49  000000003765f0c6  [1,17,1]   Recovered via rewrite in-place
  28 18715:01  0000000010a42b1d  [1,17,1]   Recovered via rewrite in-place
  29 19938:47  0000000010a42b1e  [1,17,1]   Recovered via rewrite in-place
  30 20658:29  0000000002c9e9c8  [1,17,1]   Recovered via rewrite in-place
  31 21594:31  0000000010a42b1f  [1,17,1]   Recovered via rewrite in-place
  32 22386:10  0000000000b3a519  [1,17,1]   Recovered via rewrite in-place
  33 22386:11  00000000016bdf99  [1,17,1]   Recovered via rewrite in-place
  34 22890:07  00000000033343b7  [1,17,1]   Recovered via rewrite in-place
  35 23394:02  00000000033343b8  [1,17,1]   Recovered via rewrite in-place
  36 23753:59  0000000002c9e9ca  [1,17,1]   Recovered via rewrite in-place
  37 24185:34  00000000005b1196  [1,17,1]   Recovered via rewrite in-place

Protocol Specific port log page for SAS SSP
relative target port id = 1
  generation code = 0
  number of phys = 1
  phy identifier = 0
	attached device type: SAS or SATA device
	attached reason: unknown
	reason: unknown
	negotiated logical link rate: phy enabled; 6 Gbps
	attached initiator port: ssp=1 stp=1 smp=1
	attached target port: ssp=0 stp=0 smp=0
	SAS address = 0x5000c500574fb65d
	attached SAS address = 0x500605b003fafb90
	attached phy identifier = 4
	Invalid DWORD count = 10506457
	Running disparity error count = 10294920
	Loss of DWORD synchronization = 3179
	Phy reset problem = 0
	Phy event descriptors:
	 Invalid word count: 10506457
	 Running disparity error count: 10294920
	 Loss of dword synchronization count: 3179
	 Phy reset problem count: 0
relative target port id = 2
  generation code = 0
  number of phys = 1
  phy identifier = 1
	attached device type: no device attached
	attached reason: unknown
	reason: unknown
	negotiated logical link rate: phy enabled; unknown
	attached initiator port: ssp=0 stp=0 smp=0
	attached target port: ssp=0 stp=0 smp=0
	SAS address = 0x5000c500574fb65e
	attached SAS address = 0x0
	attached phy identifier = 0
	Invalid DWORD count = 0
	Running disparity error count = 0
	Loss of DWORD synchronization = 0
	Phy reset problem = 0
	Phy event descriptors:
	 Invalid word count: 0
	 Running disparity error count: 0
	 Loss of dword synchronization count: 0
	 Phy reset problem count: 0


Code:
[root@freenas] ~# smartctl -x /dev/da6
smartctl 6.5 2016-05-07 r4318 [FreeBSD 10.3-STABLE amd64] (local build)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Vendor:			   HITACHI
Product:			  HUC109045CSS600
Revision:			 A2B0
Compliance:		   SPC-4
User Capacity:		450,098,159,616 bytes [450 GB]
Logical block size:   512 bytes
Rotation Rate:		10020 rpm
Form Factor:		  2.5 inches
Logical Unit id:	  0x5000cca0162c6e5c
Serial number:		KMGTEHKF
Device type:		  disk
Transport protocol:   SAS (SPL-3)
Local Time is:		Thu Feb  2 07:34:13 2017 EST
SMART support is:	 Available - device has SMART capability.
SMART support is:	 Enabled
Temperature Warning:  Enabled
Read Cache is:		Enabled
Writeback Cache is:   Enabled

=== START OF READ SMART DATA SECTION ===
SMART Health Status: OK

Current Drive Temperature:	 31 C
Drive Trip Temperature:		85 C

Manufactured in week 50 of year 2012
Specified cycle count over device lifetime:  50000
Accumulated start-stop cycles:  14
Specified load-unload count over device lifetime:  600000
Accumulated load-unload cycles:  83
Elements in grown defect list: 0

Vendor (Seagate) cache information
  Blocks sent to initiator = 2042070420160512

Error counter log:
		   Errors Corrected by		   Total   Correction	 Gigabytes	Total
			   ECC		  rereads/	errors   algorithm	  processed	uncorrected
		   fast | delayed   rewrites  corrected  invocations   [10^9 bytes]  errors
read:		  0	60028		 0	 60028	 221061		637.638		   0
write:		 0   429324		 0	429324	 210462	   1262.412		   0
verify:		0		0		 0		 0	  77592		  0.000		   0

Non-medium error count:		0

SMART Self-test log
Num  Test			  Status				 segment  LifeTime  LBA_first_err [SK ASC ASQ]
	 Description							  number   (hours)
# 1  Background long   Completed				   -	1693				 - [-   -	-]
# 2  Background short  Completed				   -	1575				 - [-   -	-]
# 3  Background short  Completed				   -	1574				 - [-   -	-]
# 4  Background short  Completed				   -	1573				 - [-   -	-]
# 5  Background short  Completed				   -	1572				 - [-   -	-]
# 6  Background short  Completed				   -	1571				 - [-   -	-]
# 7  Background short  Completed				   -	1570				 - [-   -	-]
# 8  Background short  Completed				   -	1569				 - [-   -	-]
# 9  Background short  Completed				   -	1568				 - [-   -	-]
#10  Background short  Completed				   -	1567				 - [-   -	-]
#11  Background short  Completed				   -	1566				 - [-   -	-]
#12  Background short  Completed				   -	1565				 - [-   -	-]
#13  Background short  Completed				   -	1564				 - [-   -	-]
#14  Background short  Completed				   -	1563				 - [-   -	-]
#15  Background short  Completed				   -	1562				 - [-   -	-]
#16  Background short  Completed				   -	1561				 - [-   -	-]
#17  Background short  Completed				   -	1560				 - [-   -	-]
#18  Background short  Completed				   -	1559				 - [-   -	-]
#19  Background short  Completed				   -	1558				 - [-   -	-]
#20  Background short  Completed				   -	1557				 - [-   -	-]

Long (extended) Self Test duration: 3670 seconds [61.2 minutes]

Background scan results log
  Status: waiting until BMS interval timer expires
	Accumulated power on time, hours:minutes 1718:47 [103127 minutes]
	Number of background scans performed: 19,  scan progress: 0.00%
	Number of background medium scans performed: 19

Protocol Specific port log page for SAS SSP
relative target port id = 1
  generation code = 2
  number of phys = 1
  phy identifier = 0
	attached device type: SAS or SATA device
	attached reason: unknown
	reason: unknown
	negotiated logical link rate: phy enabled; 6 Gbps
	attached initiator port: ssp=1 stp=1 smp=1
	attached target port: ssp=0 stp=0 smp=0
	SAS address = 0x5000cca0162c6e5d
	attached SAS address = 0x500605b003fafb90
	attached phy identifier = 1
	Invalid DWORD count = 67
	Running disparity error count = 65
	Loss of DWORD synchronization = 17
	Phy reset problem = 0
	Phy event descriptors:
	 Invalid word count: 67
	 Running disparity error count: 65
	 Loss of dword synchronization count: 17
	 Phy reset problem count: 0
relative target port id = 2
  generation code = 2
  number of phys = 1
  phy identifier = 1
	attached device type: no device attached
	attached reason: unknown
	reason: power on
	negotiated logical link rate: phy enabled; unknown
	attached initiator port: ssp=0 stp=0 smp=0
	attached target port: ssp=0 stp=0 smp=0
	SAS address = 0x5000cca0162c6e5e
	attached SAS address = 0x0
	attached phy identifier = 0
	Invalid DWORD count = 0
	Running disparity error count = 0
	Loss of DWORD synchronization = 0
	Phy reset problem = 0
	Phy event descriptors:
	 Invalid word count: 0
	 Running disparity error count: 0
	 Loss of dword synchronization count: 0
	 Phy reset problem count: 0



Code:
smartctl 6.5 2016-05-07 r4318 [FreeBSD 10.3-STABLE amd64] (local build)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Vendor:			   HITACHI
Product:			  HUC109045CSS600
Revision:			 A2B0
Compliance:		   SPC-4
User Capacity:		450,098,159,616 bytes [450 GB]
Logical block size:   512 bytes
Rotation Rate:		10020 rpm
Form Factor:		  2.5 inches
Logical Unit id:	  0x5000cca0162c6b60
Serial number:		KMGTE9DF
Device type:		  disk
Transport protocol:   SAS (SPL-3)
Local Time is:		Thu Feb  2 07:34:43 2017 EST
SMART support is:	 Available - device has SMART capability.
SMART support is:	 Enabled
Temperature Warning:  Enabled
Read Cache is:		Enabled
Writeback Cache is:   Enabled

=== START OF READ SMART DATA SECTION ===
SMART Health Status: OK

Current Drive Temperature:	 33 C
Drive Trip Temperature:		85 C

Manufactured in week 50 of year 2012
Specified cycle count over device lifetime:  50000
Accumulated start-stop cycles:  15
Specified load-unload count over device lifetime:  600000
Accumulated load-unload cycles:  84
Elements in grown defect list: 0

Vendor (Seagate) cache information
  Blocks sent to initiator = 2089619063570432

Error counter log:
		   Errors Corrected by		   Total   Correction	 Gigabytes	Total
			   ECC		  rereads/	errors   algorithm	  processed	uncorrected
		   fast | delayed   rewrites  corrected  invocations   [10^9 bytes]  errors
read:		  0	89599		 0	 89599	 540398		651.119		   0
write:		 0   461868		 0	461868	 243969	   1274.029		   0
verify:		0		0		 0		 0	  51071		  0.000		   0

Non-medium error count:		0

SMART Self-test log
Num  Test			  Status				 segment  LifeTime  LBA_first_err [SK ASC ASQ]
	 Description							  number   (hours)
# 1  Background long   Completed				   -	1693				 - [-   -	-]
# 2  Background short  Completed				   -	1575				 - [-   -	-]
# 3  Background short  Completed				   -	1574				 - [-   -	-]
# 4  Background short  Completed				   -	1573				 - [-   -	-]
# 5  Background short  Completed				   -	1572				 - [-   -	-]
# 6  Background short  Completed				   -	1571				 - [-   -	-]
# 7  Background short  Completed				   -	1570				 - [-   -	-]
# 8  Background short  Completed				   -	1569				 - [-   -	-]
# 9  Background short  Completed				   -	1568				 - [-   -	-]
#10  Background short  Completed				   -	1567				 - [-   -	-]
#11  Background short  Completed				   -	1566				 - [-   -	-]
#12  Background short  Completed				   -	1565				 - [-   -	-]
#13  Background short  Completed				   -	1564				 - [-   -	-]
#14  Background short  Completed				   -	1563				 - [-   -	-]
#15  Background short  Completed				   -	1562				 - [-   -	-]
#16  Background short  Completed				   -	1561				 - [-   -	-]
#17  Background short  Completed				   -	1560				 - [-   -	-]
#18  Background short  Completed				   -	1559				 - [-   -	-]
#19  Background short  Completed				   -	1558				 - [-   -	-]
#20  Background short  Completed				   -	1557				 - [-   -	-]

Long (extended) Self Test duration: 3670 seconds [61.2 minutes]

Background scan results log
  Status: waiting until BMS interval timer expires
	Accumulated power on time, hours:minutes 1718:47 [103127 minutes]
	Number of background scans performed: 19,  scan progress: 0.00%
	Number of background medium scans performed: 19

Protocol Specific port log page for SAS SSP
relative target port id = 1
  generation code = 2
  number of phys = 1
  phy identifier = 0
	attached device type: SAS or SATA device
	attached reason: unknown
	reason: unknown
	negotiated logical link rate: phy enabled; 6 Gbps
	attached initiator port: ssp=1 stp=1 smp=1
	attached target port: ssp=0 stp=0 smp=0
	SAS address = 0x5000cca0162c6b61
	attached SAS address = 0x500605b003fafb90
	attached phy identifier = 6
	Invalid DWORD count = 2331757
	Running disparity error count = 2327900
	Loss of DWORD synchronization = 460
	Phy reset problem = 0
	Phy event descriptors:
	 Invalid word count: 2331757
	 Running disparity error count: 2327900
	 Loss of dword synchronization count: 460
	 Phy reset problem count: 0
relative target port id = 2
  generation code = 2
  number of phys = 1
  phy identifier = 1
	attached device type: no device attached
	attached reason: unknown
	reason: power on
	negotiated logical link rate: phy enabled; unknown
	attached initiator port: ssp=0 stp=0 smp=0
	attached target port: ssp=0 stp=0 smp=0
	SAS address = 0x5000cca0162c6b62
	attached SAS address = 0x0
	attached phy identifier = 0
	Invalid DWORD count = 0
	Running disparity error count = 0
	Loss of DWORD synchronization = 0
	Phy reset problem = 0
	Phy event descriptors:
	 Invalid word count: 0
	 Running disparity error count: 0
	 Loss of dword synchronization count: 0
	 Phy reset problem count: 0
 
O

orddie

Contributor
Joined
Jun 11, 2016
Messages
104
Code:
[root@freenas] ~# smartctl -x /dev/da4
smartctl 6.5 2016-05-07 r4318 [FreeBSD 10.3-STABLE amd64] (local build)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Vendor:			   HITACHI
Product:			  HUC109045CSS600
Revision:			 A2B0
Compliance:		   SPC-4
User Capacity:		450,098,159,616 bytes [450 GB]
Logical block size:   512 bytes
Rotation Rate:		10020 rpm
Form Factor:		  2.5 inches
Logical Unit id:	  0x5000cca0220cbe08
Serial number:		KMV707JF
Device type:		  disk
Transport protocol:   SAS (SPL-3)
Local Time is:		Thu Feb  2 07:35:05 2017 EST
SMART support is:	 Available - device has SMART capability.
SMART support is:	 Enabled
Temperature Warning:  Enabled
Read Cache is:		Enabled
Writeback Cache is:   Enabled

=== START OF READ SMART DATA SECTION ===
SMART Health Status: OK

Current Drive Temperature:	 32 C
Drive Trip Temperature:		85 C

Manufactured in week 46 of year 2012
Specified cycle count over device lifetime:  50000
Accumulated start-stop cycles:  14
Specified load-unload count over device lifetime:  600000
Accumulated load-unload cycles:  82
Elements in grown defect list: 0

Vendor (Seagate) cache information
  Blocks sent to initiator = 2047092126121984

Error counter log:
		   Errors Corrected by		   Total   Correction	 Gigabytes	Total
			   ECC		  rereads/	errors   algorithm	  processed	uncorrected
		   fast | delayed   rewrites  corrected  invocations   [10^9 bytes]  errors
read:		  0	75266		 0	 75266	 242757		648.798		   0
write:		 0   362857		 0	362857	 108274	   1275.039		   0
verify:		0		0		 0		 0	  48659		  0.000		   0

Non-medium error count:		0

SMART Self-test log
Num  Test			  Status				 segment  LifeTime  LBA_first_err [SK ASC ASQ]
	 Description							  number   (hours)
# 1  Background long   Completed				   -	1693				 - [-   -	-]
# 2  Background short  Completed				   -	1576				 - [-   -	-]
# 3  Background short  Completed				   -	1575				 - [-   -	-]
# 4  Background short  Completed				   -	1574				 - [-   -	-]
# 5  Background short  Completed				   -	1573				 - [-   -	-]
# 6  Background short  Completed				   -	1572				 - [-   -	-]
# 7  Background short  Completed				   -	1571				 - [-   -	-]
# 8  Background short  Completed				   -	1570				 - [-   -	-]
# 9  Background short  Completed				   -	1569				 - [-   -	-]
#10  Background short  Completed				   -	1568				 - [-   -	-]
#11  Background short  Completed				   -	1567				 - [-   -	-]
#12  Background short  Completed				   -	1566				 - [-   -	-]
#13  Background short  Completed				   -	1565				 - [-   -	-]
#14  Background short  Completed				   -	1564				 - [-   -	-]
#15  Background short  Completed				   -	1563				 - [-   -	-]
#16  Background short  Completed				   -	1561				 - [-   -	-]
#17  Background short  Completed				   -	1560				 - [-   -	-]
#18  Background short  Completed				   -	1559				 - [-   -	-]
#19  Background short  Completed				   -	1558				 - [-   -	-]
#20  Background short  Completed				   -	1557				 - [-   -	-]

Long (extended) Self Test duration: 3670 seconds [61.2 minutes]

Background scan results log
  Status: waiting until BMS interval timer expires
	Accumulated power on time, hours:minutes 1719:11 [103151 minutes]
	Number of background scans performed: 39,  scan progress: 0.00%
	Number of background medium scans performed: 39

Protocol Specific port log page for SAS SSP
relative target port id = 1
  generation code = 1
  number of phys = 1
  phy identifier = 0
	attached device type: SAS or SATA device
	attached reason: power on
	reason: unknown
	negotiated logical link rate: phy enabled; 6 Gbps
	attached initiator port: ssp=1 stp=1 smp=1
	attached target port: ssp=0 stp=0 smp=0
	SAS address = 0x5000cca0220cbe09
	attached SAS address = 0x500605b003fafb90
	attached phy identifier = 0
	Invalid DWORD count = 30
	Running disparity error count = 28
	Loss of DWORD synchronization = 8
	Phy reset problem = 0
	Phy event descriptors:
	 Invalid word count: 30
	 Running disparity error count: 28
	 Loss of dword synchronization count: 8
	 Phy reset problem count: 0
relative target port id = 2
  generation code = 1
  number of phys = 1
  phy identifier = 1
	attached device type: no device attached
	attached reason: unknown
	reason: power on
	negotiated logical link rate: phy enabled; unknown
	attached initiator port: ssp=0 stp=0 smp=0
	attached target port: ssp=0 stp=0 smp=0
	SAS address = 0x5000cca0220cbe0a
	attached SAS address = 0x0
	attached phy identifier = 0
	Invalid DWORD count = 0
	Running disparity error count = 0
	Loss of DWORD synchronization = 0
	Phy reset problem = 0
	Phy event descriptors:
	 Invalid word count: 0
	 Running disparity error count: 0
	 Loss of dword synchronization count: 0
	 Phy reset problem count: 0



Code:
[root@freenas] ~# smartctl -x /dev/da3
smartctl 6.5 2016-05-07 r4318 [FreeBSD 10.3-STABLE amd64] (local build)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Vendor:			   HITACHI
Product:			  HUC109045CSS600
Revision:			 A2B0
Compliance:		   SPC-4
User Capacity:		450,098,159,616 bytes [450 GB]
Logical block size:   512 bytes
Rotation Rate:		10020 rpm
Form Factor:		  2.5 inches
Logical Unit id:	  0x5000cca016040740
Serial number:		KMG26P1F
Device type:		  disk
Transport protocol:   SAS (SPL-3)
Local Time is:		Thu Feb  2 07:35:24 2017 EST
SMART support is:	 Available - device has SMART capability.
SMART support is:	 Enabled
Temperature Warning:  Enabled
Read Cache is:		Enabled
Writeback Cache is:   Enabled

=== START OF READ SMART DATA SECTION ===
SMART Health Status: OK

Current Drive Temperature:	 32 C
Drive Trip Temperature:		85 C

Manufactured in week 41 of year 2012
Specified cycle count over device lifetime:  50000
Accumulated start-stop cycles:  18
Specified load-unload count over device lifetime:  600000
Accumulated load-unload cycles:  85
Elements in grown defect list: 0

Vendor (Seagate) cache information
  Blocks sent to initiator = 2087706276397056

Error counter log:
		   Errors Corrected by		   Total   Correction	 Gigabytes	Total
			   ECC		  rereads/	errors   algorithm	  processed	uncorrected
		   fast | delayed   rewrites  corrected  invocations   [10^9 bytes]  errors
read:		  0	91663		 0	 91663	 301643		648.070		   0
write:		 0   369811		 0	369811	 156801	   1272.992		   0
verify:		0		0		 0		 0	  52096		  0.000		   0

Non-medium error count:		0

SMART Self-test log
Num  Test			  Status				 segment  LifeTime  LBA_first_err [SK ASC ASQ]
	 Description							  number   (hours)
# 1  Background long   Completed				   -	1697				 - [-   -	-]
# 2  Background short  Completed				   -	1579				 - [-   -	-]
# 3  Background short  Completed				   -	1578				 - [-   -	-]
# 4  Background short  Completed				   -	1577				 - [-   -	-]
# 5  Background short  Completed				   -	1576				 - [-   -	-]
# 6  Background short  Completed				   -	1575				 - [-   -	-]
# 7  Background short  Completed				   -	1574				 - [-   -	-]
# 8  Background short  Completed				   -	1573				 - [-   -	-]
# 9  Background short  Completed				   -	1572				 - [-   -	-]
#10  Background short  Completed				   -	1571				 - [-   -	-]
#11  Background short  Completed				   -	1570				 - [-   -	-]
#12  Background short  Completed				   -	1569				 - [-   -	-]
#13  Background short  Completed				   -	1568				 - [-   -	-]
#14  Background short  Completed				   -	1567				 - [-   -	-]
#15  Background short  Completed				   -	1566				 - [-   -	-]
#16  Background short  Completed				   -	1565				 - [-   -	-]
#17  Background short  Completed				   -	1564				 - [-   -	-]
#18  Background short  Completed				   -	1563				 - [-   -	-]
#19  Background short  Completed				   -	1562				 - [-   -	-]
#20  Background short  Completed				   -	1561				 - [-   -	-]

Long (extended) Self Test duration: 3670 seconds [61.2 minutes]

Background scan results log
  Status: waiting until BMS interval timer expires
	Accumulated power on time, hours:minutes 1722:33 [103353 minutes]
	Number of background scans performed: 22,  scan progress: 0.00%
	Number of background medium scans performed: 22

Protocol Specific port log page for SAS SSP
relative target port id = 1
  generation code = 2
  number of phys = 1
  phy identifier = 0
	attached device type: SAS or SATA device
	attached reason: unknown
	reason: unknown
	negotiated logical link rate: phy enabled; 6 Gbps
	attached initiator port: ssp=1 stp=1 smp=1
	attached target port: ssp=0 stp=0 smp=0
	SAS address = 0x5000cca016040741
	attached SAS address = 0x500605b003fafb90
	attached phy identifier = 5
	Invalid DWORD count = 72
	Running disparity error count = 70
	Loss of DWORD synchronization = 17
	Phy reset problem = 0
	Phy event descriptors:
	 Invalid word count: 72
	 Running disparity error count: 70
	 Loss of dword synchronization count: 17
	 Phy reset problem count: 0
relative target port id = 2
  generation code = 2
  number of phys = 1
  phy identifier = 1
	attached device type: no device attached
	attached reason: unknown
	reason: power on
	negotiated logical link rate: phy enabled; unknown
	attached initiator port: ssp=0 stp=0 smp=0
	attached target port: ssp=0 stp=0 smp=0
	SAS address = 0x5000cca016040742
	attached SAS address = 0x0
	attached phy identifier = 0
	Invalid DWORD count = 0
	Running disparity error count = 0
	Loss of DWORD synchronization = 0
	Phy reset problem = 0
	Phy event descriptors:
	 Invalid word count: 0
	 Running disparity error count: 0
	 Loss of dword synchronization count: 0
	 Phy reset problem count: 0




Code:
[root@freenas] ~# smartctl -x /dev/da2
smartctl 6.5 2016-05-07 r4318 [FreeBSD 10.3-STABLE amd64] (local build)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Vendor:			   HITACHI
Product:			  HUC109045CSS600
Revision:			 A2B0
Compliance:		   SPC-4
User Capacity:		450,098,159,616 bytes [450 GB]
Logical block size:   512 bytes
Rotation Rate:		10020 rpm
Form Factor:		  2.5 inches
Logical Unit id:	  0x5000cca0220155a4
Serial number:		KMV0RSAF
Device type:		  disk
Transport protocol:   SAS (SPL-3)
Local Time is:		Thu Feb  2 07:35:52 2017 EST
SMART support is:	 Available - device has SMART capability.
SMART support is:	 Enabled
Temperature Warning:  Enabled
Read Cache is:		Enabled
Writeback Cache is:   Enabled

=== START OF READ SMART DATA SECTION ===
SMART Health Status: OK

Current Drive Temperature:	 32 C
Drive Trip Temperature:		85 C

Manufactured in week 38 of year 2012
Specified cycle count over device lifetime:  50000
Accumulated start-stop cycles:  13
Specified load-unload count over device lifetime:  600000
Accumulated load-unload cycles:  79
Elements in grown defect list: 0

Vendor (Seagate) cache information
  Blocks sent to initiator = 2089288317534208

Error counter log:
		   Errors Corrected by		   Total   Correction	 Gigabytes	Total
			   ECC		  rereads/	errors   algorithm	  processed	uncorrected
		   fast | delayed   rewrites  corrected  invocations   [10^9 bytes]  errors
read:		  0	78152		 0	 78152	 375904		683.188		   0
write:		 0   259668		 0	259668	  82459	   1261.252		   0
verify:		0		0		 0		 0	  26394		  0.000		   0

Non-medium error count:		0

SMART Self-test log
Num  Test			  Status				 segment  LifeTime  LBA_first_err [SK ASC ASQ]
	 Description							  number   (hours)
# 1  Background long   Completed				   -	1693				 - [-   -	-]
# 2  Background short  Completed				   -	1575				 - [-   -	-]
# 3  Background short  Completed				   -	1574				 - [-   -	-]
# 4  Background short  Completed				   -	1573				 - [-   -	-]
# 5  Background short  Completed				   -	1572				 - [-   -	-]
# 6  Background short  Completed				   -	1571				 - [-   -	-]
# 7  Background short  Completed				   -	1570				 - [-   -	-]
# 8  Background short  Completed				   -	1569				 - [-   -	-]
# 9  Background short  Completed				   -	1568				 - [-   -	-]
#10  Background short  Completed				   -	1567				 - [-   -	-]
#11  Background short  Completed				   -	1566				 - [-   -	-]
#12  Background short  Completed				   -	1565				 - [-   -	-]
#13  Background short  Completed				   -	1564				 - [-   -	-]
#14  Background short  Completed				   -	1563				 - [-   -	-]
#15  Background short  Completed				   -	1562				 - [-   -	-]
#16  Background short  Completed				   -	1561				 - [-   -	-]
#17  Background short  Completed				   -	1560				 - [-   -	-]
#18  Background short  Completed				   -	1559				 - [-   -	-]
#19  Background short  Completed				   -	1558				 - [-   -	-]
#20  Background short  Completed				   -	1557				 - [-   -	-]

Long (extended) Self Test duration: 3670 seconds [61.2 minutes]

Background scan results log
  Status: waiting until BMS interval timer expires
	Accumulated power on time, hours:minutes 1719:12 [103152 minutes]
	Number of background scans performed: 21,  scan progress: 0.00%
	Number of background medium scans performed: 21

Protocol Specific port log page for SAS SSP
relative target port id = 1
  generation code = 2
  number of phys = 1
  phy identifier = 0
	attached device type: SAS or SATA device
	attached reason: unknown
	reason: unknown
	negotiated logical link rate: phy enabled; 6 Gbps
	attached initiator port: ssp=1 stp=1 smp=1
	attached target port: ssp=0 stp=0 smp=0
	SAS address = 0x5000cca0220155a5
	attached SAS address = 0x500605b003fafb90
	attached phy identifier = 3
	Invalid DWORD count = 58
	Running disparity error count = 57
	Loss of DWORD synchronization = 15
	Phy reset problem = 0
	Phy event descriptors:
	 Invalid word count: 58
	 Running disparity error count: 57
	 Loss of dword synchronization count: 15
	 Phy reset problem count: 0
relative target port id = 2
  generation code = 2
  number of phys = 1
  phy identifier = 1
	attached device type: no device attached
	attached reason: unknown
	reason: power on
	negotiated logical link rate: phy enabled; unknown
	attached initiator port: ssp=0 stp=0 smp=0
	attached target port: ssp=0 stp=0 smp=0
	SAS address = 0x5000cca0220155a6
	attached SAS address = 0x0
	attached phy identifier = 0
	Invalid DWORD count = 0
	Running disparity error count = 0
	Loss of DWORD synchronization = 0
	Phy reset problem = 0
	Phy event descriptors:
	 Invalid word count: 0
	 Running disparity error count: 0
	 Loss of dword synchronization count: 0
	 Phy reset problem count: 0




Code:
[root@freenas] ~# smartctl -x /dev/da1
smartctl 6.5 2016-05-07 r4318 [FreeBSD 10.3-STABLE amd64] (local build)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Vendor:			   HITACHI
Product:			  HUC109045CSS600
Revision:			 A2B0
Compliance:		   SPC-4
User Capacity:		450,098,159,616 bytes [450 GB]
Logical block size:   512 bytes
Rotation Rate:		10020 rpm
Form Factor:		  2.5 inches
Logical Unit id:	  0x5000cca0162b2e8c
Serial number:		KMGSS69F
Device type:		  disk
Transport protocol:   SAS (SPL-3)
Local Time is:		Thu Feb  2 07:36:08 2017 EST
SMART support is:	 Available - device has SMART capability.
SMART support is:	 Enabled
Temperature Warning:  Enabled
Read Cache is:		Enabled
Writeback Cache is:   Enabled

=== START OF READ SMART DATA SECTION ===
SMART Health Status: OK

Current Drive Temperature:	 33 C
Drive Trip Temperature:		85 C

Manufactured in week 50 of year 2012
Specified cycle count over device lifetime:  50000
Accumulated start-stop cycles:  13
Specified load-unload count over device lifetime:  600000
Accumulated load-unload cycles:  80
Elements in grown defect list: 0

Vendor (Seagate) cache information
  Blocks sent to initiator = 2135819842224128

Error counter log:
		   Errors Corrected by		   Total   Correction	 Gigabytes	Total
			   ECC		  rereads/	errors   algorithm	  processed	uncorrected
		   fast | delayed   rewrites  corrected  invocations   [10^9 bytes]  errors
read:		  0	92840		 0	 92840	 262425		698.879		   0
write:		 0   316678		 0	316678	  91981	   1272.575		   0
verify:		0		0		 0		 0	  76777		  0.000		   0

Non-medium error count:		0

SMART Self-test log
Num  Test			  Status				 segment  LifeTime  LBA_first_err [SK ASC ASQ]
	 Description							  number   (hours)
# 1  Background long   Completed				   -	1691				 - [-   -	-]
# 2  Background short  Completed				   -	1574				 - [-   -	-]
# 3  Background short  Completed				   -	1573				 - [-   -	-]
# 4  Background short  Completed				   -	1572				 - [-   -	-]
# 5  Background short  Completed				   -	1571				 - [-   -	-]
# 6  Background short  Completed				   -	1570				 - [-   -	-]
# 7  Background short  Completed				   -	1569				 - [-   -	-]
# 8  Background short  Completed				   -	1568				 - [-   -	-]
# 9  Background short  Completed				   -	1567				 - [-   -	-]
#10  Background short  Completed				   -	1566				 - [-   -	-]
#11  Background short  Completed				   -	1565				 - [-   -	-]
#12  Background short  Completed				   -	1564				 - [-   -	-]
#13  Background short  Completed				   -	1563				 - [-   -	-]
#14  Background short  Completed				   -	1562				 - [-   -	-]
#15  Background short  Completed				   -	1561				 - [-   -	-]
#16  Background short  Completed				   -	1560				 - [-   -	-]
#17  Background short  Completed				   -	1559				 - [-   -	-]
#18  Background short  Completed				   -	1558				 - [-   -	-]
#19  Background short  Completed				   -	1557				 - [-   -	-]
#20  Background short  Completed				   -	1556				 - [-   -	-]

Long (extended) Self Test duration: 3670 seconds [61.2 minutes]

Background scan results log
  Status: waiting until BMS interval timer expires
	Accumulated power on time, hours:minutes 1717:16 [103036 minutes]
	Number of background scans performed: 20,  scan progress: 0.00%
	Number of background medium scans performed: 20

Protocol Specific port log page for SAS SSP
relative target port id = 1
  generation code = 2
  number of phys = 1
  phy identifier = 0
	attached device type: SAS or SATA device
	attached reason: unknown
	reason: unknown
	negotiated logical link rate: phy enabled; 6 Gbps
	attached initiator port: ssp=1 stp=1 smp=1
	attached target port: ssp=0 stp=0 smp=0
	SAS address = 0x5000cca0162b2e8d
	attached SAS address = 0x500605b003fafb90
	attached phy identifier = 7
	Invalid DWORD count = 62
	Running disparity error count = 58
	Loss of DWORD synchronization = 16
	Phy reset problem = 0
	Phy event descriptors:
	 Invalid word count: 62
	 Running disparity error count: 58
	 Loss of dword synchronization count: 16
	 Phy reset problem count: 0
relative target port id = 2
  generation code = 2
  number of phys = 1
  phy identifier = 1
	attached device type: no device attached
	attached reason: unknown
	reason: power on
	negotiated logical link rate: phy enabled; unknown
	attached initiator port: ssp=0 stp=0 smp=0
	attached target port: ssp=0 stp=0 smp=0
	SAS address = 0x5000cca0162b2e8e
	attached SAS address = 0x0
	attached phy identifier = 0
	Invalid DWORD count = 0
	Running disparity error count = 0
	Loss of DWORD synchronization = 0
	Phy reset problem = 0
	Phy event descriptors:
	 Invalid word count: 0
	 Running disparity error count: 0
	 Loss of dword synchronization count: 0
	 Phy reset problem count: 0


Code:
[root@freenas] ~# smartctl -x /dev/da0
smartctl 6.5 2016-05-07 r4318 [FreeBSD 10.3-STABLE amd64] (local build)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Vendor:			   HITACHI
Product:			  HUC109045CSS600
Revision:			 A2B0
Compliance:		   SPC-4
User Capacity:		450,098,159,616 bytes [450 GB]
Logical block size:   512 bytes
Rotation Rate:		10020 rpm
Form Factor:		  2.5 inches
Logical Unit id:	  0x5000cca0160794a8
Serial number:		KMG457JF
Device type:		  disk
Transport protocol:   SAS (SPL-3)
Local Time is:		Thu Feb  2 07:36:31 2017 EST
SMART support is:	 Available - device has SMART capability.
SMART support is:	 Enabled
Temperature Warning:  Enabled
Read Cache is:		Enabled
Writeback Cache is:   Enabled

=== START OF READ SMART DATA SECTION ===
SMART Health Status: OK

Current Drive Temperature:	 32 C
Drive Trip Temperature:		85 C

Manufactured in week 50 of year 2012
Specified cycle count over device lifetime:  50000
Accumulated start-stop cycles:  13
Specified load-unload count over device lifetime:  600000
Accumulated load-unload cycles:  78
Elements in grown defect list: 0

Vendor (Seagate) cache information
  Blocks sent to initiator = 2089380508336128

Error counter log:
		   Errors Corrected by		   Total   Correction	 Gigabytes	Total
			   ECC		  rereads/	errors   algorithm	  processed	uncorrected
		   fast | delayed   rewrites  corrected  invocations   [10^9 bytes]  errors
read:		  0   163220		 0	163220	1136935		682.249		   0
write:		 0   317783		 0	317783	 109761	   1261.360		   0
verify:		0		0		 0		 0	 167656		  0.000		   0

Non-medium error count:		0

SMART Self-test log
Num  Test			  Status				 segment  LifeTime  LBA_first_err [SK ASC ASQ]
	 Description							  number   (hours)
# 1  Background long   Completed				   -	1691				 - [-   -	-]
# 2  Background long   Completed				   -	1600				 - [-   -	-]
# 3  Background short  Completed				   -	1573				 - [-   -	-]
# 4  Background short  Completed				   -	1572				 - [-   -	-]
# 5  Background short  Completed				   -	1571				 - [-   -	-]
# 6  Background short  Completed				   -	1570				 - [-   -	-]
# 7  Background short  Completed				   -	1569				 - [-   -	-]
# 8  Background short  Completed				   -	1568				 - [-   -	-]
# 9  Background short  Completed				   -	1567				 - [-   -	-]
#10  Background short  Completed				   -	1566				 - [-   -	-]
#11  Background short  Completed				   -	1565				 - [-   -	-]
#12  Background short  Completed				   -	1564				 - [-   -	-]
#13  Background short  Completed				   -	1563				 - [-   -	-]
#14  Background short  Completed				   -	1562				 - [-   -	-]
#15  Background short  Completed				   -	1561				 - [-   -	-]
#16  Background short  Completed				   -	1560				 - [-   -	-]
#17  Background short  Completed				   -	1559				 - [-   -	-]
#18  Background short  Completed				   -	1558				 - [-   -	-]
#19  Background short  Completed				   -	1557				 - [-   -	-]
#20  Background short  Completed				   -	1556				 - [-   -	-]

Long (extended) Self Test duration: 3670 seconds [61.2 minutes]

Background scan results log
  Status: waiting until BMS interval timer expires
	Accumulated power on time, hours:minutes 1716:56 [103016 minutes]
	Number of background scans performed: 20,  scan progress: 0.00%
	Number of background medium scans performed: 20

Protocol Specific port log page for SAS SSP
relative target port id = 1
  generation code = 2
  number of phys = 1
  phy identifier = 0
	attached device type: SAS or SATA device
	attached reason: unknown
	reason: unknown
	negotiated logical link rate: phy enabled; 6 Gbps
	attached initiator port: ssp=1 stp=1 smp=1
	attached target port: ssp=0 stp=0 smp=0
	SAS address = 0x5000cca0160794a9
	attached SAS address = 0x500605b003fafb90
	attached phy identifier = 2
	Invalid DWORD count = 59
	Running disparity error count = 55
	Loss of DWORD synchronization = 14
	Phy reset problem = 0
	Phy event descriptors:
	 Invalid word count: 59
	 Running disparity error count: 55
	 Loss of dword synchronization count: 14
	 Phy reset problem count: 0
relative target port id = 2
  generation code = 2
  number of phys = 1
  phy identifier = 1
	attached device type: no device attached
	attached reason: unknown
	reason: power on
	negotiated logical link rate: phy enabled; unknown
	attached initiator port: ssp=0 stp=0 smp=0
	attached target port: ssp=0 stp=0 smp=0
	SAS address = 0x5000cca0160794aa
	attached SAS address = 0x0
	attached phy identifier = 0
	Invalid DWORD count = 0
	Running disparity error count = 0
	Loss of DWORD synchronization = 0
	Phy reset problem = 0
	Phy event descriptors:
	 Invalid word count: 0
	 Running disparity error count: 0
	 Loss of dword synchronization count: 0
	 Phy reset problem count: 0
 
O

orddie

Contributor
Joined
Jun 11, 2016
Messages
104
Ericloewe said:
What's the workload, by the way?
Click to expand...

im not 100% sure how to answer your question honestly. is there a way to show iOPS? I looked at reporting and see ARC requesting hitting 1.5k but the disks never going beyond 1.5MB/s
 
Ericloewe

Ericloewe

Server Wrangler
Moderator
Joined
Feb 15, 2014
Messages
20,194
orddie said:
im not 100% sure how to answer your question honestly. is there a way to show iOPS? I looked at reporting and see ARC requesting hitting 1.5k but the disks never going beyond 1.5MB/s
Click to expand...
Well, what's the storage being used for? I'm trying to get a feeling for what kind of numbers you should be getting.
 
O

orddie

Contributor
Joined
Jun 11, 2016
Messages
104
Ericloewe said:
Well, what's the storage being used for? I'm trying to get a feeling for what kind of numbers you should be getting.
Click to expand...

it's an iSCSI target for two vmware hosts connected to 10gb links. As in each host has a dedicated 10gb link to this host.
 
Ericloewe

Ericloewe

Server Wrangler
Moderator
Joined
Feb 15, 2014
Messages
20,194
Ok, here's my take on the matter:
  • The failing drive could very well be slowing things down.
  • The drives seem to have a somewhat erratic SMART schedule. One long test twice a month is generally recommended, but one per week can't hurt (just overlap them with scrubs). Make sure that all drives (you will have to set the new ones to use the SMART schedule), are following it.
  • The workload isn't pretty for ZFS, as evidenced by the fragmentation number. Scrubs are very sensitive to fragmentation (beyond the number that is reported by ZFS, which is just a sort of reference indicator). Having to seek around is going to kill IOPS. This behavior is going to be improved upon in future openZFS updates, which will allow for scrubs to be less dependent on following block pointers around.
Definitely replace da7 ASAP. That alone might significantly improve performance.
 
O

orddie

Contributor
Joined
Jun 11, 2016
Messages
104
Ericloewe said:
Ok, here's my take on the matter:
  • The failing drive could very well be slowing things down.
  • The drives seem to have a somewhat erratic SMART schedule. One long test twice a month is generally recommended, but one per week can't hurt (just overlap them with scrubs). Make sure that all drives (you will have to set the new ones to use the SMART schedule), are following it.
  • The workload isn't pretty for ZFS, as evidenced by the fragmentation number. Scrubs are very sensitive to fragmentation (beyond the number that is reported by ZFS, which is just a sort of reference indicator). Having to seek around is going to kill IOPS. This behavior is going to be improved upon in future openZFS updates, which will allow for scrubs to be less dependent on following block pointers around.
Definitely replace da7 ASAP. That alone might significantly improve performance.
Click to expand...

anything i can do to remove the fragmentation?
 
maglin

maglin

Patron
Joined
Jun 20, 2015
Messages
299
You can move the dataset to another dataset. I would wait to see how things work after you replace the failing drive. It is working as fast as the slowest drive.


Sent from my iPhone using Tapatalk
 
O

orddie

Contributor
Joined
Jun 11, 2016
Messages
104
maglin said:
You can move the dataset to another dataset. I would wait to see how things work after you replace the failing drive. It is working as fast as the slowest drive.


Sent from my iPhone using Tapatalk
Click to expand...


all drives are 10k SAS, 6GBPS. Gigabit to MB would suggest 732MB/s. what speeds would you expect?
 
SweetAndLow

SweetAndLow

Sweet'NASty
Joined
Nov 6, 2013
Messages
6,421
I don't think you can deduce anything from your scrub speed. It's a point in time measurement, wait for it to finish and see what the speed was. Your drives have gotten way too hot at one point.
 
O

orddie

Contributor
Joined
Jun 11, 2016
Messages
104
SweetAndLow said:
I don't think you can deduce anything from your scrub speed. It's a point in time measurement, wait for it to finish and see what the speed was. Your drives have gotten way too hot at one point.
Click to expand...

what makes ya say that?
 
Status
Not open for further replies.

Important Announcement for the TrueNAS Community.

The TrueNAS Community has now been moved. This forum will now become READ-ONLY for historical purposes. Please feel free to join us on the new TrueNAS Community Forums.

Related topics on forums.truenas.com for thread: "Scrub Speeds?"

Similar threads

O
  • Locked
Whelp.. One or more devices error has finally hit me
Replies
15
Views
3K
Robert Trevellyan
R
E
  • Locked
Multipath not showing up 9.10
Replies
5
Views
3K
dlavigne
D
K
  • Locked
zpool status issues
Replies
6
Views
2K
Rattlebattle79
R
M
Multiple disks detaching and reattaching right away
Replies
6
Views
2K
maxxfi
M
L
  • Locked
SOLVED The Message ID: ZFS-8000-8A indicates corrupted data exists in the current pool
2
Replies
24
Views
9K
larencio88
L
Top