Also check the SMART data for the drives and post the results, for ada3 I would expect to see ID 199 to be incremented if there were a communications issue, but if some of the other values like ID 5, 197, 198, or even 200 are not zero then you could have a drive hardware failure.That looks like a physical disconnection... check your cabling/power to that disk.
Also check the SMART data for the drives and post the results, for ada3 I would expect to see ID 199 to be incremented if there were a communications issue, but if some of the other values like ID 5, 197, 198, or even 200 are not zero then you could have a drive hardware failure.
You are reporting two different failures in this thread, right? A boot pool issue and a data drive issue (ada3)
See the link in my signature for explanation of hard drive values.
Good Luck.
=== START OF INFORMATION SECTION === Model Family: Western Digital Caviar Blue Serial ATA Device Model: WDC WD3200AAJS-56M0A0 LU WWN Device Id: 5 0014ee 057b89d33 Firmware Version: 01.03E01 User Capacity: 320,071,851,520 bytes [320 GB] Sector Size: 512 bytes logical/physical Device is: In smartctl database [for details use: -P show] ATA Version is: ATA8-ACS (minor revision not indicated) SATA Version is: SATA 2.5, 3.0 Gb/s Local Time is: Mon Nov 2 20:27:29 2020 CET SMART support is: Available - device has SMART capability. SMART support is: Enabled === START OF READ SMART DATA SECTION === SMART overall-health self-assessment test result: PASSED General SMART Values: Offline data collection status: (0x84) Offline data collection activity was suspended by an interrupting command from host. Auto Offline Data Collection: Enabled. Self-test execution status: ( 0) The previous self-test routine completed without error or no self-test has ever been run. Total time to complete Offline data collection: ( 6180) seconds. Offline data collection capabilities: (0x7b) SMART execute Offline immediate. Auto Offline data collection on/off support. Suspend Offline collection upon new command. Offline surface scan supported. Self-test supported. Conveyance Self-test supported. Selective Self-test supported. SMART capabilities: (0x0003) Saves SMART data before entering power-saving mode. Supports SMART auto save timer. Error logging capability: (0x01) Error logging supported. General Purpose Logging supported. Short self-test routine recommended polling time: ( 2) minutes. Extended self-test routine recommended polling time: ( 75) minutes. Conveyance self-test routine recommended polling time: ( 5) minutes. SCT capabilities: (0x3037) SCT Status supported. SCT Feature Control supported. SCT Data Table supported. SMART Attributes Data Structure revision number: 16 Vendor Specific SMART Attributes with Thresholds: ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE 1 Raw_Read_Error_Rate 0x002f 200 200 051 Pre-fail Always - 0 3 Spin_Up_Time 0x0027 135 130 021 Pre-fail Always - 4241 4 Start_Stop_Count 0x0032 100 100 000 Old_age Always - 285 5 Reallocated_Sector_Ct 0x0033 200 200 140 Pre-fail Always - 0 7 Seek_Error_Rate 0x002e 200 200 000 Old_age Always - 0 9 Power_On_Hours 0x0032 093 093 000 Old_age Always - 5551 10 Spin_Retry_Count 0x0032 100 100 000 Old_age Always - 0 11 Calibration_Retry_Count 0x0032 100 100 000 Old_age Always - 0 12 Power_Cycle_Count 0x0032 100 100 000 Old_age Always - 285 192 Power-Off_Retract_Count 0x0032 200 200 000 Old_age Always - 71 193 Load_Cycle_Count 0x0032 200 200 000 Old_age Always - 285 194 Temperature_Celsius 0x0022 113 098 000 Old_age Always - 30 196 Reallocated_Event_Count 0x0032 200 200 000 Old_age Always - 0 197 Current_Pending_Sector 0x0032 200 200 000 Old_age Always - 0 198 Offline_Uncorrectable 0x0030 200 200 000 Old_age Offline - 0 199 UDMA_CRC_Error_Count 0x0032 200 200 000 Old_age Always - 0 200 Multi_Zone_Error_Rate 0x0008 200 200 000 Old_age Offline - 0 SMART Error Log Version: 1 No Errors Logged SMART Self-test log structure revision number 1 Num Test_Description Status Remaining LifeTime(hours) LBA_of_first_error # 1 Short offline Completed without error 00% 5508 - # 2 Short offline Completed without error 00% 5508 - # 3 Short offline Completed without error 00% 4683 - # 4 Extended offline Interrupted (host reset) 30% 4551 - # 5 Short offline Completed without error 00% 4519 - # 6 Short offline Completed without error 00% 4351 - # 7 Short offline Completed without error 00% 4183 - # 8 Short offline Completed without error 00% 4030 - # 9 Short offline Completed without error 00% 3862 - #10 Short offline Completed without error 00% 3694 - #11 Short offline Completed without error 00% 3529 - #12 Short offline Completed without error 00% 3362 - #13 Short offline Completed without error 00% 3194 - #14 Short offline Completed without error 00% 3026 - #15 Short offline Completed without error 00% 2858 - #16 Short offline Completed without error 00% 2690 - #17 Short offline Completed without error 00% 2523 - #18 Short offline Completed without error 00% 2355 - #19 Short offline Completed without error 00% 2197 - #20 Short offline Completed without error 00% 2029 - #21 Extended offline Completed without error 00% 1886 - SMART Selective self-test log data structure revision number 1 SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS 1 0 0 Not_testing 2 0 0 Not_testing 3 0 0 Not_testing 4 0 0 Not_testing 5 0 0 Not_testing Selective self-test flags (0x0): After scanning selected spans, do NOT read-scan remainder of disk. If Selective self-test is pending on power-up, resume after 0 minute delay.
=== START OF INFORMATION SECTION === Device Model: ExcelStor Technology J9250S LU WWN Device Id: 0 000000 000000000 Firmware Version: GM2OA52A User Capacity: 250,058,268,160 bytes [250 GB] Sector Size: 512 bytes logical/physical Rotation Rate: 7200 rpm Device is: Not in smartctl database [for details use: -P showall] ATA Version is: ATA8-ACS T13/1699-D revision 4 SATA Version is: SATA 2.6, 3.0 Gb/s Local Time is: Mon Nov 2 20:28:45 2020 CET SMART support is: Available - device has SMART capability. SMART support is: Enabled === START OF READ SMART DATA SECTION === SMART overall-health self-assessment test result: PASSED General SMART Values: Offline data collection status: (0x84) Offline data collection activity was suspended by an interrupting command from host. Auto Offline Data Collection: Enabled. Self-test execution status: ( 0) The previous self-test routine completed without error or no self-test has ever been run. Total time to complete Offline data collection: ( 3981) seconds. Offline data collection capabilities: (0x5b) SMART execute Offline immediate. Auto Offline data collection on/off support. Suspend Offline collection upon new command. Offline surface scan supported. Self-test supported. No Conveyance Self-test supported. Selective Self-test supported. SMART capabilities: (0x0003) Saves SMART data before entering power-saving mode. Supports SMART auto save timer. Error logging capability: (0x01) Error logging supported. General Purpose Logging supported. Short self-test routine recommended polling time: ( 1) minutes. Extended self-test routine recommended polling time: ( 66) minutes. SCT capabilities: (0x003d) SCT Status supported. SCT Error Recovery Control supported. SCT Feature Control supported. SCT Data Table supported. SMART Attributes Data Structure revision number: 16 Vendor Specific SMART Attributes with Thresholds: ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE 1 Raw_Read_Error_Rate 0x000b 100 100 016 Pre-fail Always - 0 2 Throughput_Performance 0x0005 133 133 054 Pre-fail Offline - 138 3 Spin_Up_Time 0x0007 109 109 024 Pre-fail Always - 187 (Average 189) 4 Start_Stop_Count 0x0012 100 100 000 Old_age Always - 1262 5 Reallocated_Sector_Ct 0x0033 100 100 005 Pre-fail Always - 0 7 Seek_Error_Rate 0x000b 100 100 067 Pre-fail Always - 0 8 Seek_Time_Performance 0x0005 134 134 020 Pre-fail Offline - 28 9 Power_On_Hours 0x0012 100 100 000 Old_age Always - 4999 10 Spin_Retry_Count 0x0013 100 100 060 Pre-fail Always - 0 12 Power_Cycle_Count 0x0032 100 100 000 Old_age Always - 1254 192 Power-Off_Retract_Count 0x0032 099 099 000 Old_age Always - 1293 193 Load_Cycle_Count 0x0012 099 099 000 Old_age Always - 1293 194 Temperature_Celsius 0x0002 214 214 000 Old_age Always - 28 (Min/Max 11/45) 196 Reallocated_Event_Count 0x0032 100 100 000 Old_age Always - 0 197 Current_Pending_Sector 0x0022 100 100 000 Old_age Always - 0 198 Offline_Uncorrectable 0x0008 100 100 000 Old_age Offline - 0 199 UDMA_CRC_Error_Count 0x000a 200 200 000 Old_age Always - 0 SMART Error Log Version: 1 ATA Error Count: 2090 (device log contains only the most recent five errors) CR = Command Register [HEX] FR = Features Register [HEX] SC = Sector Count Register [HEX] SN = Sector Number Register [HEX] CL = Cylinder Low Register [HEX] CH = Cylinder High Register [HEX] DH = Device/Head Register [HEX] DC = Device Command Register [HEX] ER = Error register [HEX] ST = Status register [HEX] Powered_Up_Time is measured from power on, and printed as DDd+hh:mm:SS.sss where DD=days, hh=hours, mm=minutes, SS=sec, and sss=millisec. It "wraps" after 49.710 days. Error 2090 occurred at disk power-on lifetime: 3606 hours (150 days + 6 hours) When the command that caused the error occurred, the device was active or idle. After command completion occurred, registers were: ER ST SC SN CL CH DH -- -- -- -- -- -- -- 40 51 e6 91 04 2f e0 Error: UNC 230 sectors at LBA = 0x002f0491 = 3081361 Commands leading to the command that caused the error were: CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name -- -- -- -- -- -- -- -- ---------------- -------------------- 25 00 00 77 04 2f e0 00 05:48:47.300 READ DMA EXT 25 00 00 77 03 2f e0 00 05:48:47.300 READ DMA EXT 25 00 00 77 02 2f e0 00 05:48:47.300 READ DMA EXT 25 00 00 77 01 2f e0 00 05:48:47.300 READ DMA EXT 25 00 00 77 00 2f e0 00 05:48:47.300 READ DMA EXT Error 2089 occurred at disk power-on lifetime: 3606 hours (150 days + 6 hours) When the command that caused the error occurred, the device was active or idle. After command completion occurred, registers were: ER ST SC SN CL CH DH -- -- -- -- -- -- -- 40 51 0e 91 04 2f e0 Error: UNC 14 sectors at LBA = 0x002f0491 = 3081361 Commands leading to the command that caused the error were: CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name -- -- -- -- -- -- -- -- ---------------- -------------------- 25 00 20 7f 04 2f e0 00 05:48:43.000 READ DMA EXT 35 00 20 5f ae 71 e0 00 05:48:43.000 WRITE DMA EXT 25 00 20 5f 04 2f e0 00 05:48:43.000 READ DMA EXT 35 00 20 3f ae 71 e0 00 05:48:43.000 WRITE DMA EXT 25 00 20 3f 04 2f e0 00 05:48:43.000 READ DMA EXT Error 2088 occurred at disk power-on lifetime: 3606 hours (150 days + 6 hours) When the command that caused the error occurred, the device was active or idle. After command completion occurred, registers were: ER ST SC SN CL CH DH -- -- -- -- -- -- -- 40 51 ff 98 cc 00 e0 Error: UNC 255 sectors at LBA = 0x0000cc98 = 52376 Commands leading to the command that caused the error were: CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name -- -- -- -- -- -- -- -- ---------------- -------------------- 25 00 00 97 cc 00 e0 00 05:48:38.400 READ DMA EXT 35 00 02 f7 6f 33 e0 00 05:48:38.300 WRITE DMA EXT 35 00 08 9f f9 fa e0 00 05:48:38.300 WRITE DMA EXT 25 00 08 97 cc 00 e0 00 05:48:34.100 READ DMA EXT 35 00 18 67 4d 17 e0 00 05:48:34.000 WRITE DMA EXT Error 2087 occurred at disk power-on lifetime: 3606 hours (150 days + 6 hours) When the command that caused the error occurred, the device was active or idle. After command completion occurred, registers were: ER ST SC SN CL CH DH -- -- -- -- -- -- -- 40 51 07 98 cc 00 e0 Error: UNC 7 sectors at LBA = 0x0000cc98 = 52376 Commands leading to the command that caused the error were: CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name -- -- -- -- -- -- -- -- ---------------- -------------------- 25 00 08 97 cc 00 e0 00 05:48:34.100 READ DMA EXT 35 00 18 67 4d 17 e0 00 05:48:34.000 WRITE DMA EXT 25 00 18 97 54 17 e0 00 05:48:33.900 READ DMA EXT 35 00 08 d7 17 61 e0 00 05:48:33.900 WRITE DMA EXT 35 00 20 df bf 33 e0 00 05:48:33.900 WRITE DMA EXT Error 2086 occurred at disk power-on lifetime: 3606 hours (150 days + 6 hours) When the command that caused the error occurred, the device was active or idle. After command completion occurred, registers were: ER ST SC SN CL CH DH -- -- -- -- -- -- -- 40 51 e6 91 04 2f e0 Error: UNC 230 sectors at LBA = 0x002f0491 = 3081361 Commands leading to the command that caused the error were: CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name -- -- -- -- -- -- -- -- ---------------- -------------------- 25 00 00 77 04 2f e0 00 05:48:27.200 READ DMA EXT 25 00 00 77 03 2f e0 00 05:48:27.200 READ DMA EXT 25 00 00 77 02 2f e0 00 05:48:27.200 READ DMA EXT 25 00 00 77 01 2f e0 00 05:48:27.200 READ DMA EXT 25 00 00 77 00 2f e0 00 05:48:27.200 READ DMA EXT SMART Self-test log structure revision number 1 Num Test_Description Status Remaining LifeTime(hours) LBA_of_first_error # 1 Short offline Completed without error 00% 4956 - # 2 Short offline Completed without error 00% 4955 - # 3 Short offline Completed without error 00% 4277 - # 4 Short offline Completed without error 00% 4109 - # 5 Extended offline Completed without error 00% 3954 - # 6 Short offline Completed without error 00% 3941 - # 7 Short offline Completed without error 00% 3773 - SMART Selective self-test log data structure revision number 1 SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS 1 0 0 Not_testing 2 0 0 Not_testing 3 0 0 Not_testing 4 0 0 Not_testing 5 0 0 Not_testing Selective self-test flags (0x0): After scanning selected spans, do NOT read-scan remainder of disk. If Selective self-test is pending on power-up, resume after 0 minute delay.
=== START OF INFORMATION SECTION === Model Family: Silicon Motion based SSDs Device Model: ADATA SU800 LU WWN Device Id: 5 707c18 100547dfe Firmware Version: Q0518BS User Capacity: 128,035,676,160 bytes [128 GB] Sector Size: 512 bytes logical/physical Rotation Rate: Solid State Device Form Factor: 2.5 inches Device is: In smartctl database [for details use: -P show] ATA Version is: ACS-3 (minor revision not indicated) SATA Version is: SATA 3.1, 6.0 Gb/s (current: 6.0 Gb/s) Local Time is: Mon Nov 2 20:29:43 2020 CET SMART support is: Available - device has SMART capability. SMART support is: Enabled === START OF READ SMART DATA SECTION === SMART overall-health self-assessment test result: PASSED General SMART Values: Offline data collection status: (0x02) Offline data collection activity was completed without error. Auto Offline Data Collection: Disabled. Self-test execution status: ( 0) The previous self-test routine completed without error or no self-test has ever been run. Total time to complete Offline data collection: ( 0) seconds. Offline data collection capabilities: (0x71) SMART execute Offline immediate. No Auto Offline data collection support. Suspend Offline collection upon new command. No Offline surface scan supported. Self-test supported. Conveyance Self-test supported. Selective Self-test supported. SMART capabilities: (0x0002) Does not save SMART data before entering power-saving mode. Supports SMART auto save timer. Error logging capability: (0x01) Error logging supported. General Purpose Logging supported. Short self-test routine recommended polling time: ( 2) minutes. Extended self-test routine recommended polling time: ( 10) minutes. Conveyance self-test routine recommended polling time: ( 2) minutes. SCT capabilities: (0x003d) SCT Status supported. SCT Error Recovery Control supported. SCT Feature Control supported. SCT Data Table supported. SMART Attributes Data Structure revision number: 1 Vendor Specific SMART Attributes with Thresholds: ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE 1 Raw_Read_Error_Rate 0x0000 100 100 000 Old_age Offline - 0 5 Reallocated_Sector_Ct 0x0000 100 100 000 Old_age Offline - 0 9 Power_On_Hours 0x0000 100 100 000 Old_age Offline - 5109 12 Power_Cycle_Count 0x0000 100 100 000 Old_age Offline - 1947 160 Uncorrectable_Error_Cnt 0x0000 100 100 000 Old_age Offline - 0 161 Valid_Spare_Block_Cnt 0x0000 100 100 000 Old_age Offline - 40 163 Initial_Bad_Block_Count 0x0000 100 100 000 Old_age Offline - 5 164 Total_Erase_Count 0x0000 100 100 000 Old_age Offline - 100323 165 Max_Erase_Count 0x0000 100 100 000 Old_age Offline - 229 166 Min_Erase_Count 0x0000 100 100 000 Old_age Offline - 143 167 Average_Erase_Count 0x0000 100 100 000 Old_age Offline - 198 148 Total_SLC_Erase_Ct 0x0000 100 100 000 Old_age Offline - 202248 149 Max_SLC_Erase_Ct 0x0000 100 100 000 Old_age Offline - 5965 150 Min_SLC_Erase_Ct 0x0000 100 100 000 Old_age Offline - 5821 151 Average_SLC_Erase_Ct 0x0000 100 100 000 Old_age Offline - 5948 159 Unkn_SiliconMotion_Attr 0x0000 100 100 000 Old_age Offline - 0 168 Max_Erase_Count_of_Spec 0x0000 100 100 000 Old_age Offline - 1500 169 Remaining_Lifetime_Perc 0x0000 100 100 000 Old_age Offline - 100 177 Wear_Leveling_Count 0x0000 100 100 050 Old_age Offline - 380 181 Program_Fail_Cnt_Total 0x0000 100 100 000 Old_age Offline - 0 182 Erase_Fail_Count_Total 0x0000 100 100 000 Old_age Offline - 0 192 Power-Off_Retract_Count 0x0000 100 100 000 Old_age Offline - 122 194 Temperature_Celsius 0x0000 100 100 000 Old_age Offline - 44 195 Hardware_ECC_Recovered 0x0000 100 100 000 Old_age Offline - 65563 196 Reallocated_Event_Count 0x0000 100 100 016 Old_age Offline - 0 199 UDMA_CRC_Error_Count 0x0000 100 100 050 Old_age Offline - 0 232 Available_Reservd_Space 0x0000 100 100 000 Old_age Offline - 100 241 Host_Writes_32MiB 0x0000 100 100 000 Old_age Offline - 443903 242 Host_Reads_32MiB 0x0000 100 100 000 Old_age Offline - 733558 245 TLC_Writes_32MiB 0x0000 100 100 000 Old_age Offline - 902907 SMART Error Log Version: 1 Warning: ATA error count 0 inconsistent with error log pointer 3 ATA Error Count: 0 CR = Command Register [HEX] FR = Features Register [HEX] SC = Sector Count Register [HEX] SN = Sector Number Register [HEX] CL = Cylinder Low Register [HEX] CH = Cylinder High Register [HEX] DH = Device/Head Register [HEX] DC = Device Command Register [HEX] ER = Error register [HEX] ST = Status register [HEX] Powered_Up_Time is measured from power on, and printed as DDd+hh:mm:SS.sss where DD=days, hh=hours, mm=minutes, SS=sec, and sss=millisec. It "wraps" after 49.710 days. Error -2 occurred at disk power-on lifetime: 0 hours (0 days + 0 hours) When the command that caused the error occurred, the device was in an unknown state. After command completion occurred, registers were: ER ST SC SN CL CH DH -- -- -- -- -- -- -- 00 ec 00 00 00 00 00 Commands leading to the command that caused the error were: CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name -- -- -- -- -- -- -- -- ---------------- -------------------- ec 00 00 00 00 00 00 00 00:00:00.000 IDENTIFY DEVICE ec 00 00 00 00 00 00 00 00:00:00.000 IDENTIFY DEVICE ec 00 00 00 00 00 00 00 00:00:00.000 IDENTIFY DEVICE ec 00 00 00 00 00 00 00 00:00:00.000 IDENTIFY DEVICE c8 00 00 00 00 00 00 00 00:00:00.000 READ DMA SMART Self-test log structure revision number 1 Num Test_Description Status Remaining LifeTime(hours) LBA_of_first_error # 1 Short offline Completed without error 00% 245 - # 2 Short offline Completed without error 00% 202 - # 3 Short offline Completed without error 00% 202 - SMART Selective self-test log data structure revision number 1 SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS 1 0 0 Not_testing 2 0 0 Not_testing 3 0 0 Not_testing 4 0 0 Not_testing 5 0 0 Not_testing 7 0 65535 Read_scanning was completed without error Selective self-test flags (0x0): After scanning selected spans, do NOT read-scan remainder of disk. If Selective self-test is pending on power-up, resume after 0 minute delay.
=== START OF INFORMATION SECTION === Model Family: Seagate IronWolf Device Model: ST4000VN008-2DR166 LU WWN Device Id: 5 000c50 0b4bbf03d Firmware Version: SC60 User Capacity: 4,000,787,030,016 bytes [4.00 TB] Sector Sizes: 512 bytes logical, 4096 bytes physical Rotation Rate: 5980 rpm Form Factor: 3.5 inches Device is: In smartctl database [for details use: -P show] ATA Version is: ACS-3 T13/2161-D revision 5 SATA Version is: SATA 3.1, 6.0 Gb/s (current: 6.0 Gb/s) Local Time is: Mon Nov 2 20:30:09 2020 CET SMART support is: Available - device has SMART capability. SMART support is: Enabled === START OF READ SMART DATA SECTION === SMART overall-health self-assessment test result: PASSED General SMART Values: Offline data collection status: (0x82) Offline data collection activity was completed without error. Auto Offline Data Collection: Enabled. Self-test execution status: ( 0) The previous self-test routine completed without error or no self-test has ever been run. Total time to complete Offline data collection: ( 591) seconds. Offline data collection capabilities: (0x7b) SMART execute Offline immediate. Auto Offline data collection on/off support. Suspend Offline collection upon new command. Offline surface scan supported. Self-test supported. Conveyance Self-test supported. Selective Self-test supported. SMART capabilities: (0x0003) Saves SMART data before entering power-saving mode. Supports SMART auto save timer. Error logging capability: (0x01) Error logging supported. General Purpose Logging supported. Short self-test routine recommended polling time: ( 1) minutes. Extended self-test routine recommended polling time: ( 612) minutes. Conveyance self-test routine recommended polling time: ( 2) minutes. SCT capabilities: (0x50bd) SCT Status supported. SCT Error Recovery Control supported. SCT Feature Control supported. SCT Data Table supported. SMART Attributes Data Structure revision number: 10 Vendor Specific SMART Attributes with Thresholds: ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE 1 Raw_Read_Error_Rate 0x000f 083 064 044 Pre-fail Always - 217935529 3 Spin_Up_Time 0x0003 095 093 000 Pre-fail Always - 0 4 Start_Stop_Count 0x0032 100 100 020 Old_age Always - 100 5 Reallocated_Sector_Ct 0x0033 100 100 010 Pre-fail Always - 0 7 Seek_Error_Rate 0x000f 083 060 045 Pre-fail Always - 219421243 9 Power_On_Hours 0x0032 085 085 000 Old_age Always - 13660 (55 99 0) 10 Spin_Retry_Count 0x0013 100 100 097 Pre-fail Always - 0 12 Power_Cycle_Count 0x0032 100 100 020 Old_age Always - 80 184 End-to-End_Error 0x0032 100 100 099 Old_age Always - 0 187 Reported_Uncorrect 0x0032 100 100 000 Old_age Always - 0 188 Command_Timeout 0x0032 100 100 000 Old_age Always - 0 189 High_Fly_Writes 0x003a 100 100 000 Old_age Always - 0 190 Airflow_Temperature_Cel 0x0022 075 060 040 Old_age Always - 25 (Min/Max 24/25) 191 G-Sense_Error_Rate 0x0032 100 100 000 Old_age Always - 0 192 Power-Off_Retract_Count 0x0032 100 100 000 Old_age Always - 62 193 Load_Cycle_Count 0x0032 100 100 000 Old_age Always - 297 194 Temperature_Celsius 0x0022 025 040 000 Old_age Always - 25 (0 19 0 0 0) 197 Current_Pending_Sector 0x0012 100 100 000 Old_age Always - 0 198 Offline_Uncorrectable 0x0010 100 100 000 Old_age Offline - 0 199 UDMA_CRC_Error_Count 0x003e 200 200 000 Old_age Always - 0 240 Head_Flying_Hours 0x0000 100 253 000 Old_age Offline - 13640 (99 49 0) 241 Total_LBAs_Written 0x0000 100 253 000 Old_age Offline - 25184578754 242 Total_LBAs_Read 0x0000 100 253 000 Old_age Offline - 47693272224 SMART Error Log Version: 1 No Errors Logged SMART Self-test log structure revision number 1 Num Test_Description Status Remaining LifeTime(hours) LBA_of_first_error # 1 Short offline Completed without error 00% 13617 - # 2 Short offline Interrupted (host reset) 00% 13617 - # 3 Short offline Completed without error 00% 12791 - # 4 Extended offline Interrupted (host reset) 90% 12659 - # 5 Extended offline Aborted by host 90% 12658 - # 6 Short offline Completed without error 00% 12627 - # 7 Short offline Completed without error 00% 12459 - # 8 Short offline Completed without error 00% 12291 - # 9 Short offline Completed without error 00% 12137 - #10 Short offline Completed without error 00% 11969 - #11 Short offline Completed without error 00% 11801 - #12 Short offline Completed without error 00% 11636 - #13 Short offline Completed without error 00% 11468 - #14 Short offline Completed without error 00% 11300 - #15 Short offline Completed without error 00% 11132 - #16 Short offline Completed without error 00% 10964 - #17 Short offline Completed without error 00% 10796 - #18 Short offline Completed without error 00% 10628 - #19 Short offline Completed without error 00% 10460 - #20 Short offline Completed without error 00% 10302 - #21 Short offline Completed without error 00% 10134 - SMART Selective self-test log data structure revision number 1 SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS 1 0 0 Not_testing 2 0 0 Not_testing 3 0 0 Not_testing 4 0 0 Not_testing 5 0 0 Not_testing Selective self-test flags (0x0): After scanning selected spans, do NOT read-scan remainder of disk. If Selective self-test is pending on power-up, resume after 0 minute delay.
=== START OF INFORMATION SECTION === Model Family: WD Blue and Green SSDs Device Model: WDC WDS240G2G0B-00EPW0 LU WWN Device Id: 5 001b44 8b87db1a1 Firmware Version: UJ510000 User Capacity: 240,065,183,744 bytes [240 GB] Sector Size: 512 bytes logical/physical Rotation Rate: Solid State Device Form Factor: M.2 Device is: In smartctl database [for details use: -P show] ATA Version is: ACS-2 T13/2015-D revision 3 SATA Version is: SATA 3.2, 6.0 Gb/s (current: 6.0 Gb/s) Local Time is: Mon Nov 2 20:30:25 2020 CET SMART support is: Available - device has SMART capability. SMART support is: Enabled === START OF READ SMART DATA SECTION === SMART overall-health self-assessment test result: PASSED General SMART Values: Offline data collection status: (0x00) Offline data collection activity was never started. Auto Offline Data Collection: Disabled. Self-test execution status: ( 32) The self-test routine was interrupted by the host with a hard or soft reset. Total time to complete Offline data collection: ( 120) seconds. Offline data collection capabilities: (0x15) SMART execute Offline immediate. No Auto Offline data collection support. Abort Offline collection upon new command. No Offline surface scan supported. Self-test supported. No Conveyance Self-test supported. No Selective Self-test supported. SMART capabilities: (0x0003) Saves SMART data before entering power-saving mode. Supports SMART auto save timer. Error logging capability: (0x01) Error logging supported. General Purpose Logging supported. Short self-test routine recommended polling time: ( 2) minutes. Extended self-test routine recommended polling time: ( 42) minutes. SMART Attributes Data Structure revision number: 1 Vendor Specific SMART Attributes with Thresholds: ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE 5 Reallocated_Sector_Ct 0x0032 100 100 000 Old_age Always - 0 9 Power_On_Hours 0x0032 100 100 000 Old_age Always - 6147 12 Power_Cycle_Count 0x0032 100 100 000 Old_age Always - 77 165 Block_Erase_Count 0x0032 100 100 000 Old_age Always - 13 166 Minimum_PE_Cycles_TLC 0x0032 100 100 --- Old_age Always - 0 167 Max_Bad_Blocks_per_Die 0x0032 100 100 --- Old_age Always - 0 168 Maximum_PE_Cycles_TLC 0x0032 100 100 --- Old_age Always - 2 169 Total_Bad_Blocks 0x0032 100 100 --- Old_age Always - 294 170 Grown_Bad_Blocks 0x0032 100 100 --- Old_age Always - 0 171 Program_Fail_Count 0x0032 100 100 000 Old_age Always - 0 172 Erase_Fail_Count 0x0032 100 100 000 Old_age Always - 0 173 Average_PE_Cycles_TLC 0x0032 100 100 000 Old_age Always - 0 174 Unexpected_Power_Loss 0x0032 100 100 000 Old_age Always - 35 184 End-to-End_Error 0x0032 100 100 --- Old_age Always - 0 187 Reported_Uncorrect 0x0032 100 100 000 Old_age Always - 0 188 Command_Timeout 0x0032 100 100 --- Old_age Always - 0 194 Temperature_Celsius 0x0022 070 035 000 Old_age Always - 30 (Min/Max 14/35) 199 UDMA_CRC_Error_Count 0x0032 100 100 --- Old_age Always - 0 230 Media_Wearout_Indicator 0x0032 100 100 000 Old_age Always - 0x000300000003 232 Available_Reservd_Space 0x0033 100 100 005 Pre-fail Always - 100 233 NAND_GB_Written_TLC 0x0032 100 100 --- Old_age Always - 17 234 NAND_GB_Written_SLC 0x0032 100 100 000 Old_age Always - 103 241 Host_Writes_GiB 0x0030 100 100 000 Old_age Offline - 38 242 Host_Reads_GiB 0x0030 100 100 000 Old_age Offline - 617 244 Temp_Throttle_Status 0x0032 000 100 --- Old_age Always - 0 SMART Error Log Version: 1 No Errors Logged SMART Self-test log structure revision number 1 Num Test_Description Status Remaining LifeTime(hours) LBA_of_first_error # 1 Short offline Completed without error 00% 6104 - # 2 Short offline Completed without error 00% 6104 - # 3 Short offline Completed without error 00% 5278 - # 4 Short offline Completed without error 00% 5114 - # 5 Short offline Completed without error 00% 4946 - # 6 Short offline Completed without error 00% 4779 - # 7 Short offline Completed without error 00% 4625 - # 8 Short offline Completed without error 00% 4457 - # 9 Short offline Completed without error 00% 4290 - #10 Short offline Completed without error 00% 4125 - #11 Short offline Completed without error 00% 3959 - #12 Short offline Completed without error 00% 3791 - #13 Short offline Completed without error 00% 3623 - #14 Short offline Completed without error 00% 3455 - #15 Short offline Completed without error 00% 3287 - #16 Short offline Completed without error 00% 3120 - #17 Short offline Completed without error 00% 2952 - #18 Short offline Completed without error 00% 2794 - #19 Short offline Completed without error 00% 2626 - #20 Extended offline Completed without error 00% 2482 - #21 Short offline Completed without error 00% 2457 - Selective Self-tests/Logging not supported
All of your drives look fine except the Ironwolf drive has not completed an extended test, and you have a really weird mix of drives.
The only problem I see is you not finishing the SMART Extended tests on Seagate IronWolf ST4000VN008-2DR166, they keep getting interrupted, you likely keep turning off your system in the middle of the test. The values from all these drives are so different that I feel you have just shoved a bunch of various drives together, and there is nothing really wrong with it however most people would not configure a system that way which would mean that there has been very little testing of FreeNAS in this configuration.
You had something happen on your ExcelStor Technology J9250S drive about 59 hours of run time ago, but you also have a very high power cycle count, very odd.
Summary: Run SMART Extended test to a pass conclusion on the Ironwolf drive, if it passes then all looks good. Also, read the Hard Drive Troubleshooting Guide I put together, it's very helpful and does point out the key things to look for.
=== START OF INFORMATION SECTION === Model Family: Seagate IronWolf Device Model: ST4000VN008-2DR166 LU WWN Device Id: 5 000c50 0b4bbf03d Firmware Version: SC60 User Capacity: 4,000,787,030,016 bytes [4.00 TB] Sector Sizes: 512 bytes logical, 4096 bytes physical Rotation Rate: 5980 rpm Form Factor: 3.5 inches Device is: In smartctl database [for details use: -P show] ATA Version is: ACS-3 T13/2161-D revision 5 SATA Version is: SATA 3.1, 6.0 Gb/s (current: 6.0 Gb/s) Local Time is: Wed Nov 4 20:46:37 2020 CET SMART support is: Available - device has SMART capability. SMART support is: Enabled === START OF READ SMART DATA SECTION === SMART overall-health self-assessment test result: PASSED General SMART Values: Offline data collection status: (0x82) Offline data collection activity was completed without error. Auto Offline Data Collection: Enabled. Self-test execution status: ( 0) The previous self-test routine completed without error or no self-test has ever been run. Total time to complete Offline data collection: ( 591) seconds. Offline data collection capabilities: (0x7b) SMART execute Offline immediate. Auto Offline data collection on/off support. Suspend Offline collection upon new command. Offline surface scan supported. Self-test supported. Conveyance Self-test supported. Selective Self-test supported. SMART capabilities: (0x0003) Saves SMART data before entering power-saving mode. Supports SMART auto save timer. Error logging capability: (0x01) Error logging supported. General Purpose Logging supported. Short self-test routine recommended polling time: ( 1) minutes. Extended self-test routine recommended polling time: ( 612) minutes. Conveyance self-test routine recommended polling time: ( 2) minutes. SCT capabilities: (0x50bd) SCT Status supported. SCT Error Recovery Control supported. SCT Feature Control supported. SCT Data Table supported. SMART Attributes Data Structure revision number: 10 Vendor Specific SMART Attributes with Thresholds: ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE 1 Raw_Read_Error_Rate 0x000f 084 064 044 Pre-fail Always - 233842553 3 Spin_Up_Time 0x0003 095 093 000 Pre-fail Always - 0 4 Start_Stop_Count 0x0032 100 100 020 Old_age Always - 100 5 Reallocated_Sector_Ct 0x0033 100 100 010 Pre-fail Always - 0 7 Seek_Error_Rate 0x000f 084 060 045 Pre-fail Always - 224128586 9 Power_On_Hours 0x0032 085 085 000 Old_age Always - 13709 (130 185 0) 10 Spin_Retry_Count 0x0013 100 100 097 Pre-fail Always - 0 12 Power_Cycle_Count 0x0032 100 100 020 Old_age Always - 80 184 End-to-End_Error 0x0032 100 100 099 Old_age Always - 0 187 Reported_Uncorrect 0x0032 100 100 000 Old_age Always - 0 188 Command_Timeout 0x0032 100 100 000 Old_age Always - 0 189 High_Fly_Writes 0x003a 100 100 000 Old_age Always - 0 190 Airflow_Temperature_Cel 0x0022 074 060 040 Old_age Always - 26 (Min/Max 24/28) 191 G-Sense_Error_Rate 0x0032 100 100 000 Old_age Always - 0 192 Power-Off_Retract_Count 0x0032 100 100 000 Old_age Always - 62 193 Load_Cycle_Count 0x0032 100 100 000 Old_age Always - 297 194 Temperature_Celsius 0x0022 026 040 000 Old_age Always - 26 (0 19 0 0 0) 197 Current_Pending_Sector 0x0012 100 100 000 Old_age Always - 0 198 Offline_Uncorrectable 0x0010 100 100 000 Old_age Offline - 0 199 UDMA_CRC_Error_Count 0x003e 200 200 000 Old_age Always - 0 240 Head_Flying_Hours 0x0000 100 253 000 Old_age Offline - 13689 (174 134 0) 241 Total_LBAs_Written 0x0000 100 253 000 Old_age Offline - 25200339434 242 Total_LBAs_Read 0x0000 100 253 000 Old_age Offline - 47693418568 SMART Error Log Version: 1 No Errors Logged SMART Self-test log structure revision number 1 Num Test_Description Status Remaining LifeTime(hours) LBA_of_first_error # 1 Extended offline Completed without error 00% 13704 - # 2 Extended offline Completed without error 00% 13680 - # 3 Short offline Completed without error 00% 13617 - # 4 Short offline Interrupted (host reset) 00% 13617 - # 5 Short offline Completed without error 00% 12791 - # 6 Extended offline Interrupted (host reset) 90% 12659 - # 7 Extended offline Aborted by host 90% 12658 - # 8 Short offline Completed without error 00% 12627 - # 9 Short offline Completed without error 00% 12459 - #10 Short offline Completed without error 00% 12291 - #11 Short offline Completed without error 00% 12137 - #12 Short offline Completed without error 00% 11969 - #13 Short offline Completed without error 00% 11801 - #14 Short offline Completed without error 00% 11636 - #15 Short offline Completed without error 00% 11468 - #16 Short offline Completed without error 00% 11300 - #17 Short offline Completed without error 00% 11132 - #18 Short offline Completed without error 00% 10964 - #19 Short offline Completed without error 00% 10796 - #20 Short offline Completed without error 00% 10628 - #21 Short offline Completed without error 00% 10460 - SMART Selective self-test log data structure revision number 1 SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS 1 0 0 Not_testing 2 0 0 Not_testing 3 0 0 Not_testing 4 0 0 Not_testing 5 0 0 Not_testing Selective self-test flags (0x0): After scanning selected spans, do NOT read-scan remainder of disk. If Selective self-test is pending on power-up, resume after 0 minute delay.
root@dom[~]# smartctl -a -v 1,raw48:54 -v 7,raw48:54 /dev/ada3 smartctl 7.1 2019-12-30 r5022 [FreeBSD 12.2-RC3 amd64] (local build) Copyright (C) 2002-19, Bruce Allen, Christian Franke, www.smartmontools.org === START OF INFORMATION SECTION === Model Family: Seagate IronWolf Device Model: ST4000VN008-2DR166 LU WWN Device Id: 5 000c50 0b4bbf03d Firmware Version: SC60 User Capacity: 4,000,787,030,016 bytes [4.00 TB] Sector Sizes: 512 bytes logical, 4096 bytes physical Rotation Rate: 5980 rpm Form Factor: 3.5 inches Device is: In smartctl database [for details use: -P show] ATA Version is: ACS-3 T13/2161-D revision 5 SATA Version is: SATA 3.1, 6.0 Gb/s (current: 6.0 Gb/s) Local Time is: Wed Nov 4 20:57:13 2020 CET SMART support is: Available - device has SMART capability. SMART support is: Enabled === START OF READ SMART DATA SECTION === SMART overall-health self-assessment test result: PASSED General SMART Values: Offline data collection status: (0x82) Offline data collection activity was completed without error. Auto Offline Data Collection: Enabled. Self-test execution status: ( 0) The previous self-test routine completed without error or no self-test has ever been run. Total time to complete Offline data collection: ( 591) seconds. Offline data collection capabilities: (0x7b) SMART execute Offline immediate. Auto Offline data collection on/off support. Suspend Offline collection upon new command. Offline surface scan supported. Self-test supported. Conveyance Self-test supported. Selective Self-test supported. SMART capabilities: (0x0003) Saves SMART data before entering power-saving mode. Supports SMART auto save timer. Error logging capability: (0x01) Error logging supported. General Purpose Logging supported. Short self-test routine recommended polling time: ( 1) minutes. Extended self-test routine recommended polling time: ( 612) minutes. Conveyance self-test routine recommended polling time: ( 2) minutes. SCT capabilities: (0x50bd) SCT Status supported. SCT Error Recovery Control supported. SCT Feature Control supported. SCT Data Table supported. SMART Attributes Data Structure revision number: 10 Vendor Specific SMART Attributes with Thresholds: ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE 1 Raw_Read_Error_Rate 0x000f 084 064 044 Pre-fail Always - 0 3 Spin_Up_Time 0x0003 095 093 000 Pre-fail Always - 0 4 Start_Stop_Count 0x0032 100 100 020 Old_age Always - 100 5 Reallocated_Sector_Ct 0x0033 100 100 010 Pre-fail Always - 0 7 Seek_Error_Rate 0x000f 084 060 045 Pre-fail Always - 0 9 Power_On_Hours 0x0032 085 085 000 Old_age Always - 13709 (54 144 0) 10 Spin_Retry_Count 0x0013 100 100 097 Pre-fail Always - 0 12 Power_Cycle_Count 0x0032 100 100 020 Old_age Always - 80 184 End-to-End_Error 0x0032 100 100 099 Old_age Always - 0 187 Reported_Uncorrect 0x0032 100 100 000 Old_age Always - 0 188 Command_Timeout 0x0032 100 100 000 Old_age Always - 0 189 High_Fly_Writes 0x003a 100 100 000 Old_age Always - 0 190 Airflow_Temperature_Cel 0x0022 074 060 040 Old_age Always - 26 (Min/Max 24/28) 191 G-Sense_Error_Rate 0x0032 100 100 000 Old_age Always - 0 192 Power-Off_Retract_Count 0x0032 100 100 000 Old_age Always - 62 193 Load_Cycle_Count 0x0032 100 100 000 Old_age Always - 297 194 Temperature_Celsius 0x0022 026 040 000 Old_age Always - 26 (0 19 0 0 0) 197 Current_Pending_Sector 0x0012 100 100 000 Old_age Always - 0 198 Offline_Uncorrectable 0x0010 100 100 000 Old_age Offline - 0 199 UDMA_CRC_Error_Count 0x003e 200 200 000 Old_age Always - 0 240 Head_Flying_Hours 0x0000 100 253 000 Old_age Offline - 13689 (98 93 0) 241 Total_LBAs_Written 0x0000 100 253 000 Old_age Offline - 25200339434 242 Total_LBAs_Read 0x0000 100 253 000 Old_age Offline - 47693418568 SMART Error Log Version: 1 No Errors Logged SMART Self-test log structure revision number 1 Num Test_Description Status Remaining LifeTime(hours) LBA_of_first_error # 1 Extended offline Completed without error 00% 13704 - # 2 Extended offline Completed without error 00% 13680 - # 3 Short offline Completed without error 00% 13617 - # 4 Short offline Interrupted (host reset) 00% 13617 - # 5 Short offline Completed without error 00% 12791 - # 6 Extended offline Interrupted (host reset) 90% 12659 - # 7 Extended offline Aborted by host 90% 12658 - # 8 Short offline Completed without error 00% 12627 - # 9 Short offline Completed without error 00% 12459 - #10 Short offline Completed without error 00% 12291 - #11 Short offline Completed without error 00% 12137 - #12 Short offline Completed without error 00% 11969 - #13 Short offline Completed without error 00% 11801 - #14 Short offline Completed without error 00% 11636 - #15 Short offline Completed without error 00% 11468 - #16 Short offline Completed without error 00% 11300 - #17 Short offline Completed without error 00% 11132 - #18 Short offline Completed without error 00% 10964 - #19 Short offline Completed without error 00% 10796 - #20 Short offline Completed without error 00% 10628 - #21 Short offline Completed without error 00% 10460 - SMART Selective self-test log data structure revision number 1 SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS 1 0 0 Not_testing 2 0 0 Not_testing 3 0 0 Not_testing 4 0 0 Not_testing 5 0 0 Not_testing Selective self-test flags (0x0): After scanning selected spans, do NOT read-scan remainder of disk. If Selective self-test is pending on power-up, resume after 0 minute delay. root@dom[~]#