Write throughput: 
write_throughput: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)

write_throughput: (groupid=0, jobs=8): err= 0: pid=2189941: Sun May 29 06:40:33 2022
  write: IOPS=1165, BW=1174MiB/s (1231MB/s)(68.8GiB/60048msec); 0 zone resets
    slat (usec): min=1535, max=701317, avg=6840.45, stdev=10832.48
    clat (usec): min=9, max=1503.1k, avg=430102.01, stdev=143592.55
     lat (msec): min=2, max=1508, avg=436.92, stdev=144.99
    clat percentiles (msec):
     |  1.00th=[  157],  5.00th=[  228], 10.00th=[  288], 20.00th=[  342],
     | 30.00th=[  359], 40.00th=[  393], 50.00th=[  439], 60.00th=[  464],
     | 70.00th=[  477], 80.00th=[  489], 90.00th=[  531], 95.00th=[  592],
     | 99.00th=[ 1062], 99.50th=[ 1250], 99.90th=[ 1418], 99.95th=[ 1452],
     | 99.99th=[ 1485]
   bw (  MiB/s): min=  179, max= 2515, per=99.73%, avg=1170.44, stdev=44.63, samples=950
   iops        : min=  179, max= 2515, avg=1169.65, stdev=44.64, samples=950
  lat (usec)   : 10=0.01%, 20=0.01%, 50=0.01%, 250=0.01%
  lat (msec)   : 4=0.01%, 10=0.01%, 20=0.01%, 50=0.04%, 100=0.06%
  lat (msec)   : 250=6.35%, 500=76.05%, 750=15.56%, 1000=1.27%, 2000=1.36%
  cpu          : usr=1.25%, sys=11.75%, ctx=694493, majf=0, minf=12892
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,69962,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=1174MiB/s (1231MB/s), 1174MiB/s-1174MiB/s (1231MB/s-1231MB/s), io=68.8GiB (73.9GB), run=60048-60048msec
Write IOPS: 
write_iops: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
write_iops: Laying out IO file (1 file / 10240MiB)

write_iops: (groupid=0, jobs=1): err= 0: pid=2452987: Sun May 29 06:41:36 2022
  write: IOPS=12.9k, BW=50.5MiB/s (52.0MB/s)(3030MiB/60001msec); 0 zone resets
    slat (usec): min=8, max=46780, avg=72.03, stdev=185.29
    clat (usec): min=4, max=119223, avg=4876.06, stdev=2643.57
     lat (usec): min=78, max=120650, avg=4948.69, stdev=2674.94
    clat percentiles (usec):
     |  1.00th=[ 3097],  5.00th=[ 3359], 10.00th=[ 3589], 20.00th=[ 3851],
     | 30.00th=[ 4015], 40.00th=[ 4146], 50.00th=[ 4228], 60.00th=[ 4359],
     | 70.00th=[ 4490], 80.00th=[ 5080], 90.00th=[ 7373], 95.00th=[ 8586],
     | 99.00th=[13042], 99.50th=[18220], 99.90th=[36963], 99.95th=[44303],
     | 99.99th=[70779]
   bw (  KiB/s): min=41632, max=68296, per=100.00%, avg=51793.19, stdev=5172.68, samples=119
   iops        : min=10408, max=17074, avg=12948.25, stdev=1293.15, samples=119
  lat (usec)   : 10=0.01%, 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%
  lat (usec)   : 1000=0.01%
  lat (msec)   : 2=0.01%, 4=28.72%, 10=69.24%, 20=1.64%, 50=0.37%
  lat (msec)   : 100=0.02%, 250=0.01%
  cpu          : usr=7.44%, sys=88.81%, ctx=4445, majf=0, minf=2059
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,775720,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=50.5MiB/s (52.0MB/s), 50.5MiB/s-50.5MiB/s (52.0MB/s-52.0MB/s), io=3030MiB (3178MB), run=60001-60001msec
Read throughput: 
read_throughput: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)

read_throughput: (groupid=0, jobs=8): err= 0: pid=3084978: Sun May 29 06:44:25 2022
  read: IOPS=1910, BW=1919MiB/s (2013MB/s)(112GiB/60006msec)
    slat (usec): min=488, max=50788, avg=4171.81, stdev=2195.03
    clat (usec): min=8, max=417301, avg=263037.97, stdev=59819.12
     lat (msec): min=3, max=421, avg=267.21, stdev=60.70
    clat percentiles (msec):
     |  1.00th=[   69],  5.00th=[  109], 10.00th=[  186], 20.00th=[  247],
     | 30.00th=[  262], 40.00th=[  271], 50.00th=[  275], 60.00th=[  279],
     | 70.00th=[  292], 80.00th=[  300], 90.00th=[  317], 95.00th=[  330],
     | 99.00th=[  355], 99.50th=[  359], 99.90th=[  380], 99.95th=[  397],
     | 99.99th=[  414]
   bw (  MiB/s): min= 1434, max= 3580, per=99.60%, avg=1911.83, stdev=75.51, samples=953
   iops        : min= 1434, max= 3580, avg=1911.34, stdev=75.51, samples=953
  lat (usec)   : 10=0.01%, 20=0.01%, 50=0.01%
  lat (msec)   : 4=0.01%, 10=0.01%, 20=0.01%, 50=0.10%, 100=3.95%
  lat (msec)   : 250=16.86%, 500=79.50%
  cpu          : usr=0.38%, sys=33.27%, ctx=109020, majf=0, minf=6660
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=114667,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=1919MiB/s (2013MB/s), 1919MiB/s-1919MiB/s (2013MB/s-2013MB/s), io=112GiB (121GB), run=60006-60006msec
Read IOPS: 
read_iops: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
read_iops: Laying out IO file (1 file / 10240MiB)

read_iops: (groupid=0, jobs=1): err= 0: pid=3611707: Sun May 29 06:45:52 2022
  read: IOPS=14.2k, BW=55.4MiB/s (58.1MB/s)(3322MiB/60001msec)
    slat (usec): min=4, max=10248, avg=66.66, stdev=110.38
    clat (usec): min=3, max=119584, avg=4446.35, stdev=3434.53
     lat (usec): min=44, max=122691, avg=4513.44, stdev=3486.57
    clat percentiles (usec):
     |  1.00th=[ 2638],  5.00th=[ 2704], 10.00th=[ 2769], 20.00th=[ 2802],
     | 30.00th=[ 2868], 40.00th=[ 2933], 50.00th=[ 3032], 60.00th=[ 3359],
     | 70.00th=[ 3851], 80.00th=[ 5080], 90.00th=[ 8586], 95.00th=[11994],
     | 99.00th=[16057], 99.50th=[17433], 99.90th=[20579], 99.95th=[23725],
     | 99.99th=[95945]
   bw (  KiB/s): min= 6968, max=89691, per=100.00%, avg=56719.24, stdev=28034.64, samples=120
   iops        : min= 1742, max=22424, avg=14179.73, stdev=7008.65, samples=120
  lat (usec)   : 4=0.01%, 50=0.01%, 100=0.01%, 250=0.01%, 500=0.01%
  lat (usec)   : 750=0.01%, 1000=0.01%
  lat (msec)   : 2=0.01%, 4=72.18%, 10=20.09%, 20=7.60%, 50=0.09%
  lat (msec)   : 100=0.03%, 250=0.01%
  cpu          : usr=5.72%, sys=67.27%, ctx=41960, majf=0, minf=565
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=850451,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=55.4MiB/s (58.1MB/s), 55.4MiB/s-55.4MiB/s (58.1MB/s-58.1MB/s), io=3322MiB (3484MB), run=60001-60001msec
