Slow copy between datasets?

[jolanda7150]

Hello,

I recently re-installed my TrueNAS server and re-configured it from scratch.
Now I'm in the process of copying my files from the old datasets to a new dataset structure.

While doing so the average speed is about 6,5MB/sec. This seems very slow.
When I try to access a SMB share in the meantime, even the process of navigating through folders is very slow.
Doing actions on files like renaming them is impossible. This is not a state that I want to accept any longer.

What would be the optimal speed to expect in my scenario?
In the past speed wasn't an issue but I never copied so many large files between datasets.
Where should I start to investigate how to improve speed?

Here are some facts about my setup. Please tell me if you need more.

• TrueNAS-13.0-U1.1
• 2 cores of Xeon E-2146G (16% utilization of those cores while copying)
• 32 GB RAM for the VM and 100% used due to caching.
• Installed as VM in Proxmox (Passthrough of HBA card flashed in IT mode)
• 1 pool with 1 vdev in RAIDZ2 (48% space used)
• 6x 6TB HDD drives (WD Red & Seagate IronWolf)
• Source and destination datasets are shared via SMB
• Both shares are mounted on a Debian stable PC. I copy files using Gnome's default file manager.
• Client is connected over GBit LAN (cable)

 

[mav@]

Please update to 13.0-U2. It is likely a known and already fixed issue.

 

[jolanda7150]

I've tried the update twice (yesterday and a week ago) and both times I had kernel panic afterwards.

 

[mav@]

... it would be really cool if I could diagnose kernel panics just based on "I had kernel panic"...

 

[jolanda7150]

This is not a bug report about upgrade issues, but about a completely different topic.

If you want to diagnose my upgrade issue I have absolutely no problem to share as many info as you may need. Just let me know what info is of interest and where to share it.

 

[mav@]

I just don't want it to fall on the floor, unless you think the problem is specific to you and won't affect anybody else. As I have told, the problem of server side copy you are asking here should be already fixed in U2.

 

[jolanda7150]

Okay, I will open another thread where I report my upgrade issues.
If it solves the issue, I will report back here.

Just a note, if anyone else encounters this:
I connected to TrueNAS via SSH and copied the same files with rsync -Pah.
This gives me reasonable speeds around 150 to 250MB/s.

 

[anodos]

Just as a side-note, Nautilus on Debian (via gvfs) doesn't perform server-side copies. Not all clients are equally good.

 

[jolanda7150]

Okay I upgraded to U2 but the issue isn't fixed for me.

 

[anodos]

Okay I upgraded to U2 but the issue isn't fixed for me.

Not surprising if your client isn't doing server-side copies. You can use the kernel SMB client: https://wiki.samba.org/index.php/Server-Side_Copy#Linux but the GUI file manager probably isn't going to cut it.

 

[Alecmascot]

Are the WD Reds SMR ?

 

[jolanda7150]

I got around 70 MB/s earlier so yes 7 MB/s is suprprising, no matter if server side copies or not. There is something wrong.

No, they are CMR, not SMR.

 

[jolanda7150]

Just for record: My temporary workaround is to use the Dolphin file manager.
Dolphin doesn't have this problem but Thunar and Nautilus both do.

So this doesn't seem to be a misconfiguration on my side.
Not sure if that's better or worse though.

 

[anodos]

Just for record: My temporary workaround is to use the Dolphin file manager.
Dolphin doesn't have this problem but Thunar and Nautilus both do.

So this doesn't seem to be a misconfiguration on my side.
Not sure if that's better or worse though.

Is dolphin using a kernel SMB client mount or libsmbclient? It might be doing ops server-side.

 

[anodos]

In case of cross-fs copy, Samba will still do server-side-copy (via async pread / pwrite internally) rather than copy_file_range().