[EFAULT] acltool [clone] on path /mnt/Vol5/Backups failed with error

[electricwildflower]

Morning everyone, have an annoying issue popped up and unsure how to solve it

I Installed a fresh Truenas install, dropped in my existing pools, user created, smb shares added and currently going through the various permissions for all the pools and have an issue. I created a dataset on Vol5 called Program_Data and inside this added datasets for each app i intent to install so i created a Syncthing Dataset. The apps user has been given permission to read and write so apps have control of their respective dataset to store configurations etc.

I then created a dataset on Vol5 called Backups and inside this a dataset called Program_Data, the apps user has been given full control. I then created a replication task which backs up the content of Program_Data to Backups/Program_Data. This worked fine and i ran it. In Syncthing i mounted the Backups dataset and it's synced with a Desktop so the Program_Data which replicates nightly will get a backup on the same volume plus backed up to a separate computer (i'll get it replicated to another location soon as well).

All worked amazing and fine, i then removed Syncthing (to re install to test if configs still work after install). Once i re installed it, i load Syncthing i get an error

Backupserror while traversing /Backups/Program_Data/Syncthing: permission denied

I then go into Backups/Program_Data and check the Dataset, all permissions are fine from what i can see but the Syncthing app doesn't let me work with the Backups dataset and also replication task now fails saying permission denied in writing to it. Here are a few screen shots of errors.

OS - TrueNAS-SCALE-22.12.2

 

[electricwildflower]

Nevermind i solved it

When installing click advance settings in security and untick the read only file system option and the error went away

 

[electricwildflower]

Scrap that last message it's still got the issue, it worked for a moment and then the issue has come back, i'm also having issues updating the permissions where it shows an error and fails but seems to set the permissions fine.

 

[sretalla]

what do you see from this:

zfs get all vol5/Backups​

 

[electricwildflower]

Short story i partly solved it i think but still have an issue

New install of Truenas Scale Latest, pools re added, Program_Data added and Datasets inside this for for each app like Syncthing, NetData, Jellyfin, Mymediaforalexa and so. Made sure in the advanced settings of Program_Data that read only was turned off and all permissions applied recursively with child datasets ticked.

This installed most apps fine

Created a Dataset called Backups and inside this we have Program_Data and Emby. At first i give Backups all the right permissions for root, apps and the user Derek and applied it all recursively with child datasets ticked, this still didn't work. I then gave both Emby and Program Data the right permissions for root, apps and user Derek and applied it all recursively with child datasets ticked. This then worked for Syncthing.

I then synced Backups dataset on the server with a folder called Backups on a secondary hard drive on the desktop and it seemed to start syncing with the weird thing, Backups Dataset both Emby & Program_Data show fine and also all of the datasets created for each app so Syncthing, NetData, Jellyfin, Mymediaforalexa and so on but with the issue all of the folders that syncthing syncs to the desktop are empty.

I went into replication tasks and i have a replication that copies Program_Data to Backups/Program_Data and it says success every time i run it but with the second photo it doesn't seem to do anything in terms of copying over any data other than the apps Datasets without any data inside IE the apps settings.

I tried zfs get all Vol5/Backups in shell and it says zsh: command not found :zfs

 

[sretalla]

I tried zfs get all Vol5/Backups in shell and it says zsh: command not found :zfs

Which shell are you running that in? it would be very concerning if your TrueNAS shell can't find the zfs command.

 

[electricwildflower]

I'm running it in the Truenas shell on a fresh install of Truenas, have just added my pools, changed a few permissions on some datasets installed a few apps and added a few smb shares. I even used su to log in as root and run command?

 

[sretalla]

I even used su to log in as root and run command?

That's how you broke it... the Shell in the GUI is already root.

 

[electricwildflower]

But when i just open shell and type the command

zfs get all vol5/Backups​

i just get zsh: command not found :zfs

 

[sretalla]

Well, something is very broken with your system... at very least, the path doesn't have core ZFS utilities in it.

what does this get you:

echo $PATH

 

[electricwildflower]

That command gets me

/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games

Could it be a broken installation or when downloading the Trunas iso something went wrong?

 

[sretalla]

Looks like it has been edited by someone/something... it should look like this: /root/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin

You're missing all the sbin references and some others too.

 

[electricwildflower]

I downloaded a fresh Truenas Iso and have created a boot drive on a SD card due to the fact i'm waiting for some new memory sticks. After installing i have made 0 changes, just a fresh install. No users added, no pools added, no apps nothing but a fresh install. I log into the Truenas gui, jump into shell and type echo $PATH with the same outcome as before.

usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games

I have recently upgraded my server, changing the motherboard, processor & ram and also upgrading Vol5 from 3TB hard drives to 6TB which on the second hard drive resilver it did get to 99% and then thrown an error (i forget what) re started the re silver and finished fine after with no issues since as far as i can tell.

Could it be a hardware issue or Truenas Iso issue or something else?

Just about to do a fresh install without the hard drives connected to see if that still throws an error

 

[electricwildflower]

After a Fresh install with no drives connected it still says

usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games

Just downloading 22.12.1 to see if that throws the same error and if it does then i got a hardware issue or something related?

 

[anodos]

The permissions backend failing with EROFS means that your dataset is read-only. You can't change a read-only dataset.

 

[electricwildflower]

Updates on this

1 - Removed all the hard drives and fresh install on the SSD and it still reports /usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
2 - Downloaded and installed 22.12.1 and still shows usr/games
3 - Updated the Bios in case that's the issue due to it being a MSI 990fxa gaming motherboard still shows usr/games unless that's the cause?
4 - Formatted the SSD in Linux Mint and then give it a re install with 22.12.2 still shows /usr/games

In terms of the Vol5 issue would i have to back up all of the data, format drives and re create the pool or would there be a way to make sure it ain't read only?

I'm currently stumped at what to do next?

 

[electricwildflower]

I have created a boot drive and installed Truenas on a spare SSD on my old server hardware which i was using before i made the switch and it ran completely fine and as soon as i run the command echo $PATH the exact same outcome happens.

/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games

Running zfs get all and again i am greeted with

zsh: command not found: zfs

That's a little weird that 2 different ssd's with different Truenas installs running on different hardware both show the same errors?

 

[sretalla]

If you keep restoring your config, the broken path will continue to return.

Also, SSD is the preferred boot pool media, not USB stick or SD card (which are likely to burn out relatively quickly.

 

[electricwildflower]

I don't restore the config though i have on both separate machines just created an install drive with the sd card and installed it to the empty SSD which was used to run Truenas in the first place, booted into truenas and ran the commands in shell and they both still get the same outcomes of

/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
zsh: command not found: zfs

I haven't restored any configs, added any pools, changed any settings, shared anything with Samba and have downloaded both Truenas 22.12.1 & 22.12.2 they are literally a stock Truenas install. I just install. log into Cli, jump into shell and ran commands.

 

[electricwildflower]

Literally as in the pics below

1 - create an install drive with the SD card (only thing i got to hand till the usb memory sticks come in the post)
2 - Boot both the desktop and server individually and use the install drive to install a stock Truenas install on a Sandisk 128GB Sata SSD
3 - Once installed restart and wait for it to boot and then on my laptop drop into the Cli
4 - Open the Shell and run the commands as shown
5 - Both desktop & server and Truenas 22.12.1 & 22.12.2 both have the same outcomes?

Thank you everyone for this help even if it's frustrating me it's appreciated :)