zio read error

[Rosin0416]

Hello,

I installed truenas 13 yesterday and connected my disks today:
_ 1x SSD for the OS
_ 4x Raidz2 hard disks

At startup, I noticed these error lines.

Right after this step, Truenas starts normally :

Do you know what these errors mean
Once launched, truenas does not show me any error

I was going to go into production, but before copying the data to the data pool, I'm a bit worried about these lines.

I found very little literature, and what little I did find, I did not understand : https://www.tubsta.com/2021/03/freebsd-update-13-0-caveats/

 

[Alecmascot]

Please post the output of "zpool status" and "zpool list" in code tags

 

[Davvo]

It's a disk i/o error.
Do as @Alecmascot said.

 

[Rosin0416]

Hello,
I only got access to my server today

Code:

truenas% zpool status
pool: MYDATA
state: ONLINE
config:

        NAME                                            STATE     READ WRITE CKSUM
         MYDATA                                         ONLINE       0     0     0
          raidz2-0                                      ONLINE       0     0     0
            gptid/9f7b2abc-8aab-11ed-af68-002590f5a654  ONLINE       0     0     0
            gptid/9f9e555f-8aab-11ed-af68-002590f5a654  ONLINE       0     0     0
            gptid/9f955394-8aab-11ed-af68-002590f5a654  ONLINE       0     0     0
            gptid/9f8b4c03-8aab-11ed-af68-002590f5a654  ONLINE       0     0     0

errors: No known data errors

  pool: boot-pool
 state: ONLINE
  scan: scrub repaired 0B in 00:00:05 with 0 errors on Thu Jan  5 03:45:05 2023
config:

        NAME        STATE     READ WRITE CKSUM
        boot-pool   ONLINE       0     0     0
          ada0p2    ONLINE       0     0     0

errors: No known data errors
truenas%

Code:

truenas% zpool list
NAME        SIZE  ALLOC   FREE  CKPOINT  EXPANDSZ   FRAG    CAP  DEDUP    HEALTH  ALTROOT
MYDATA     10.9T  8.50M  10.9T        -         -     0%     0%  1.00x    ONLINE  /mnt
boot-pool   119G  1.30G   118G        -         -     0%     1%  1.00x    ONLINE  -
truenas%

 

[Alecmascot]

The command output format was lost by not using code tags....

However, as the system is not live and has no data :
If you have done any configuration then save your config.
then do :
zpool checkpoint --discard MYDATA

then reboot and see if the boot-loader reports the same error.

 

[Davvo]

Please run a long smart test on each disk and post the results using appropriate tags.

 

[Rosin0416]

Hello,

The command output format was lost by not using code tags....

Sorry, I didn't use the right tags. I fixed the problem

However, as the system is not live and has no data :

No data on the disks. The installation of Truenas 13 is very fresh.

If you have done any configuration then save your config.

I just saved the configuration I had done before I discovered the problem

zpool checkpoint --discard MYDATA

then reboot and see if the boot-loader reports the same error.

Code:

truenas% sudo zpool checkpoint --discard MYDATA
cannot discard checkpoint in 'MYDATA': checkpoint does not exist
truenas%

I could not go any further

 

[Alecmascot]

ok. Thanks for making that easier to read.
If you boot from the Install media do you see the same error ?

 

[Rosin0416]

I don't understand, I have to reinstall Truenas?

At the time of installation, my 4 data drives were not yet connected.
I plugged the disks in later (NAS turned off of course)

 

[Alecmascot]

I don't understand, I have to reinstall Truenas?

No. Just boot from the install media and see if you get the same error.
Do not install(yet)

 

[Rosin0416]

For information: I installed from ipmi and not from a media (usb key)

Ok I'll try.

 

[Alecmascot]

From what I read in the FreeBSD forums this is a bootloader issue.
If it were my NAS I would trash it and start again booting from a USB media !
Your ideas may vary !
Maybe an expert in this area will be along

 

[Rosin0416]

Yes, on installation I have the same thing, here is a screenshot

 

[Rosin0416]

You think it's the installation method ?

 

[Alecmascot]

You think it's the installation method ?

That would be my first thought.
Can you make a usb stick and try that ?
If that is the same then export/destroy the pool and try again.

 

[Rosin0416]

I come with news

I have followed your advice.

1] I reinstalled Truenas 13 (fresh install) from a usb key.
I had the same problem.

2] I deleted the pool completely. Then I reinstalled Truenas 13 (fresh installation) from a usb key.
Here is what I got:

here I was happy

3] Finally I recreated a blank pool

This time I got two pages

 

[Alecmascot]

Brain storm........
Uefi boot or not ?
Bios version ?
Disk controller in AHCI ?
When you create the pool is there anything odd in the log/dmesg ?

edit : when you exported the pool did you do a destroy to wipe the disks ?
edit: do a gpart list <drive> of one of the drives
edit: are the disks attached to the SATA ports or via the onboard SAS ?

 

[Rosin0416]

Uefi boot or not ?

This message appears when installing Truenas. It seems to be recommended to boot from the BIOS. This is the option I chose.

Bios version ?

3.4
Normally this is the latest version.

Disk controller in AHCI ?

How do I know this?

When you create the pool is there anything odd in the log/dmesg ?

where can I find this?
Or with which command?

edit : when you exported the pool did you do a destroy to wipe the disks ?

I completely destroyed the pool. I created a new one

maybe one thing that can help:
_ my SSD (OS) is connected to a SATA port
_ my 4 data drives are each connected to a SAS port

 

[Alecmascot]

_ my 4 data drives are each connected to a SAS port

How is the SAS controller configured ?
Just researching something else. back in a mo.....

 

[Alecmascot]

I think the bootloader changed in TN 13.0.
Grab a copy of 12-U8 from here as a test:

https://download.freenas.org/

Try the data drives connected to the SATA ports.
AHCI will be set in the BIOS setup

edit: that's me done for the night.....