Failed disk - unable to import

[jkstark]

So... On a Freenas Mini, had one of the WD Red 4tb drives fail - no biggie, this was a RaidZ1, so everything should be ok...

Realized that the UI was causing fits as well, and would not let me log in, SSH would not work, console was still accessible. Went to poweroff and/or reboot, and it would hang after trying to stop middleware. Eventually had to power off to get to doing anything with it.

I could not get the UI to display the volume at all, looked at the command line for help instead to at least get it to rebuilding the array after replacing the drive. Now am unable to import the pool:

Code:

root@freenasmini:~ # zpool list
NAME           SIZE  ALLOC   FREE  CKPOINT  EXPANDSZ   FRAG    CAP  DEDUP    HEALTH  ALTROOT
freenas-boot  14.9G  12.2G  2.66G        -         -      -    82%  1.00x    ONLINE  -

Code:

root@freenasmini:~ # zpool status
  pool: freenas-boot
 state: ONLINE
status: Some supported features are not enabled on the pool. The pool can
        still be used, but some features are unavailable.
action: Enable all features using 'zpool upgrade'. Once this is done,
        the pool may no longer be accessible by software that does not support
        the features. See zpool-features(5) for details.
  scan: scrub repaired 0B in 00:01:39 with 0 errors on Wed Nov 17 03:46:40 2021
config:

        NAME          STATE     READ WRITE CKSUM
        freenas-boot  ONLINE       0     0     0
          ada2p2      ONLINE       0     0     0

errors: No known data errors

Code:

root@freenasmini:~ # zpool import
   pool: tank
     id: 3526124432418963810
  state: UNAVAIL
status: The pool was last accessed by another system.
 action: The pool cannot be imported due to damaged devices or data.
   see: https://openzfs.github.io/openzfs-docs/msg/ZFS-8000-EY
 config:

        tank         UNAVAIL  insufficient replicas
          ada2       UNAVAIL  cannot open

   pool: tank
     id: 10071580758380284267
  state: FAULTED
status: One or more devices contains corrupted data.
 action: The pool cannot be imported due to damaged devices or data.
        The pool may be active on another system, but can be imported using
        the '-f' flag.
   see: https://openzfs.github.io/openzfs-docs/msg/ZFS-8000-5E
 config:

        tank                                            FAULTED  corrupted data
          raidz1-0                                      DEGRADED
            gptid/6d6fca8c-ce7b-11e4-8e25-d0509964aa6a  ONLINE
            gptid/6ddbeca8-ce7b-11e4-8e25-d0509964aa6a  ONLINE
            gptid/3ebabb4b-d03a-11ea-ac33-d05099d02791  FAULTED  corrupted data
            gptid/6eb7c0c7-ce7b-11e4-8e25-d0509964aa6a  ONLINE

Code:

root@freenasmini:~ # zpool import tank
cannot import 'tank': more than one matching pool
import by numeric ID instead
root@freenasmini:~ # zpool import 10071580758380284267
internal error: cannot import 'tank': Integrity check failed
Abort (core dumped)

Interestingly, I see two pools named TANK for some odd reason, so thus the attempt with the ID instead. ada2 is the boot drive (DOM)

Code:

+========+============================================+=================+
| Device | GPTID                                      | Serial          |
+========+============================================+=================+
| ada0   | gptid/6d6fca8c-ce7b-11e4-8e25-d0509964aa6a | WD-WCC4EPCPUTUC |
+--------+--------------------------------------------+-----------------+
| ada1   | gptid/6ddbeca8-ce7b-11e4-8e25-d0509964aa6a | WD-WCC4E0XF3A7H |
+--------+--------------------------------------------+-----------------+
glabel: No such geom: ada2p2.
| ada2   |                                            | B06150226010000000DA |
+--------+--------------------------------------------+-----------------+
| ada3   | gptid/3ebabb4b-d03a-11ea-ac33-d05099d02791 | WD-WX91D996YCH7 |
+--------+--------------------------------------------+-----------------+
| ada4   | gptid/6eb7c0c7-ce7b-11e4-8e25-d0509964aa6a | WD-WCC4EFFXU95J |
+--------+--------------------------------------------+-----------------+

TANK should be on ada0,1,3, and 4 only - why it is thinking of 2 I don't know.

TruenasTrueNAS-12.0-U6.1 w/32 GB RAM

Any ideas and recommendations would be welcome!

Thanks,

Kris

 

[sretalla]

It looks like ada2 used to be a single disk pool also called tank... strange.

It may be helpful to remove that disk.

zpool import -f tank (or the ID again if you don't remove ada2) may be enough

If not zpool import -F tank may be necessary, but may throw out some transactions, so file loss (should only be that most recently changed) is possible in order to work around the corruption to import.