multiple single disk vdevs and multiple disks in a single vdev performance comparison

Joined
Mar 11, 2023
Messages
27
How does the performance of reading and writing compare between a setup consisting of 5 vdevs with a single drive in each, versus a single vdev with 5 drives, and how is data distributed across both setups?
Specifically, if a single file is used, would it be split into blocks and distributed across all 5 separate vdevs in the same way as in the single vdev with 5 drives?
 

morganL

Captain Morgan
Administrator
Moderator
iXsystems
Joined
Mar 10, 2018
Messages
2,694
How does the performance of reading and writing compare between a setup consisting of 5 vdevs with a single drive in each, versus a single vdev with 5 drives, and how is data distributed across both setups?
Specifically, if a single file is used, would it be split into blocks and distributed across all 5 separate vdevs in the same way as in the single vdev with 5 drives?
Both spread data across multiple drives

5WZ1 is reliable
5xSingle is very unreliable.
 

danb35

Hall of Famer
Joined
Aug 16, 2011
Messages
15,504
a single vdev with 5 drives
The only way to have a single vdev with 5 drives would be either a five-way mirror (possible, but very rare) or with parity RAID (RAIDZ1, 2, or 3). And performance is going to be very different for any of those.
 
Joined
Mar 11, 2023
Messages
27
The only way to have a single vdev with 5 drives would be either a five-way mirror (possible, but very rare) or with parity RAID (RAIDZ1, 2, or 3). And performance is going to be very different for any of those.
I'm planning on using RAID0 so no parity. The way I see it going for individual vdevs single drives, is going to allow for different drive sizes or single drive pools would work too.
 

danb35

Hall of Famer
Joined
Aug 16, 2011
Messages
15,504
Joined
Mar 11, 2023
Messages
27
There's no such thing as a single vdev of five disks striped--those would be five vdevs.
never said this.
Anyways looks like I got my answer, I found a chart that showed performance for R/W increases with more vdevs in a pool and not the amount of drives in a single vdev.
 

danb35

Hall of Famer
Joined
Aug 16, 2011
Messages
15,504
never said this.
What, then? The only way to have more than one disk in a vdev is in some kind of redundancy arrangement. So if you're going to use what you call RAID0 (which doesn't exist in ZFS; it stripes vdevs, but it isn't RAID0), the only possible way to do it is with five (or however many disks you have) vdevs.
 
Joined
Mar 11, 2023
Messages
27
What, then? The only way to have more than one disk in a vdev is in some kind of redundancy arrangement. So if you're going to use what you call RAID0 (which doesn't exist in ZFS; it stripes vdevs, but it isn't RAID0), the only possible way to do it is with five (or however many disks you have) vdevs.
Well 5 disks in a single vdev stripped is similar to RAID0 in that they both stripe data and are limited to the smallest drive size.
Also I notice adding more drives to a vdev doesn't increase performance so I've decided to not do a stripe and go for as many vdevs I can allowing for mixed drives sizes.
 

Ericloewe

Server Wrangler
Moderator
Joined
Feb 15, 2014
Messages
20,194
Well 5 disks in a single vdev stripped is similar to RAID0
It is also a fantasy. There is no such thing. The only vdev types are single disks, n-way mirrors, RAIDZ and DRAID.
 

danb35

Hall of Famer
Joined
Aug 16, 2011
Messages
15,504
Joined
Mar 11, 2023
Messages
27
It is also a fantasy. There is no such thing. The only vdev types are single disks, n-way mirrors, RAIDZ and DRAID.
1678569485326.png

Did trueNAS remove the ability to stripe because I saw it in a video that you could stripe a vdev
 

Ericloewe

Server Wrangler
Moderator
Joined
Feb 15, 2014
Messages
20,194

Arwen

MVP
Joined
May 17, 2014
Messages
3,611
In ZFS terminology, a Stripe is across vDevs.

However, in other RAID schemes, they refer to RAID-5/6 as striping data across the disks in a RAID-5/6 set. While ZFS will stripe data in RAID-Z1/2/3 as a single vDev, it is NOT commonly referred to as a Striped vDev. It would properly be referred to as a RAID-Zx vDev.

With your insistence of no redundancy, their is exactly one ZFS option, 5 single disk vDevs, (aka Stripe).


We are not trying to be annoying, (okay, maybe one or 2 of us are), using precise wording maters in how to configure a NAS server in the manor desired. Here are 2 Resources that may be of help;
 
Top