Write throughput: 
write_throughput: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)

write_throughput: (groupid=0, jobs=8): err= 0: pid=1569346: Sun May 29 00:22:21 2022
  write: IOPS=567, BW=576MiB/s (604MB/s)(33.8GiB/60012msec); 0 zone resets
    slat (msec): min=3, max=225, avg=14.08, stdev= 4.36
    clat (usec): min=8, max=1606.0k, avg=879881.55, stdev=96723.94
     lat (msec): min=3, max=1619, avg=893.91, stdev=97.37
    clat percentiles (msec):
     |  1.00th=[  567],  5.00th=[  793], 10.00th=[  835], 20.00th=[  860],
     | 30.00th=[  869], 40.00th=[  869], 50.00th=[  877], 60.00th=[  885],
     | 70.00th=[  902], 80.00th=[  911], 90.00th=[  936], 95.00th=[  969],
     | 99.00th=[ 1083], 99.50th=[ 1435], 99.90th=[ 1603], 99.95th=[ 1603],
     | 99.99th=[ 1603]
   bw (  KiB/s): min=358400, max=745472, per=98.55%, avg=581542.19, stdev=6089.96, samples=952
   iops        : min=  350, max=  728, avg=567.64, stdev= 5.94, samples=952
  lat (usec)   : 10=0.01%, 20=0.01%
  lat (msec)   : 4=0.01%, 10=0.01%, 20=0.03%, 50=0.07%, 100=0.09%
  lat (msec)   : 250=0.25%, 500=0.42%, 750=2.34%, 1000=95.50%, 2000=2.74%
  cpu          : usr=0.49%, sys=4.34%, ctx=282924, majf=0, minf=7453
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,34072,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=576MiB/s (604MB/s), 576MiB/s-576MiB/s (604MB/s-604MB/s), io=33.8GiB (36.3GB), run=60012-60012msec
Write IOPS: 
write_iops: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
write_iops: Laying out IO file (1 file / 10240MiB)

write_iops: (groupid=0, jobs=1): err= 0: pid=1577749: Sun May 29 00:23:24 2022
  write: IOPS=4396, BW=17.2MiB/s (18.0MB/s)(1031MiB/60001msec); 0 zone resets
    slat (usec): min=8, max=68484, avg=222.44, stdev=316.06
    clat (usec): min=5, max=210358, avg=14328.34, stdev=5839.49
     lat (usec): min=635, max=210792, avg=14551.32, stdev=5916.64
    clat percentiles (msec):
     |  1.00th=[    6],  5.00th=[    7], 10.00th=[    8], 20.00th=[   10],
     | 30.00th=[   12], 40.00th=[   13], 50.00th=[   15], 60.00th=[   16],
     | 70.00th=[   17], 80.00th=[   18], 90.00th=[   20], 95.00th=[   22],
     | 99.00th=[   28], 99.50th=[   32], 99.90th=[   62], 99.95th=[  115],
     | 99.99th=[  169]
   bw (  KiB/s): min= 9520, max=40288, per=100.00%, avg=17642.09, stdev=6054.42, samples=119
   iops        : min= 2380, max=10072, avg=4410.45, stdev=1513.58, samples=119
  lat (usec)   : 10=0.01%, 750=0.01%
  lat (msec)   : 2=0.01%, 4=0.11%, 10=21.77%, 20=69.59%, 50=8.43%
  lat (msec)   : 100=0.07%, 250=0.05%
  cpu          : usr=2.05%, sys=93.75%, ctx=13139, majf=0, minf=905
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,263816,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=17.2MiB/s (18.0MB/s), 17.2MiB/s-17.2MiB/s (18.0MB/s-18.0MB/s), io=1031MiB (1081MB), run=60001-60001msec
Read throughput: 
read_throughput: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)

read_throughput: (groupid=0, jobs=8): err= 0: pid=1614713: Sun May 29 00:26:53 2022
  read: IOPS=592, BW=601MiB/s (631MB/s)(35.3GiB/60019msec)
    slat (usec): min=502, max=68365, avg=13476.37, stdev=5151.26
    clat (usec): min=7, max=1941.6k, avg=844993.83, stdev=177089.49
     lat (msec): min=16, max=1970, avg=858.51, stdev=179.63
    clat percentiles (msec):
     |  1.00th=[  584],  5.00th=[  667], 10.00th=[  701], 20.00th=[  760],
     | 30.00th=[  785], 40.00th=[  818], 50.00th=[  835], 60.00th=[  852],
     | 70.00th=[  869], 80.00th=[  885], 90.00th=[  919], 95.00th=[  995],
     | 99.00th=[ 1670], 99.50th=[ 1737], 99.90th=[ 1871], 99.95th=[ 1905],
     | 99.99th=[ 1938]
   bw (  KiB/s): min=423936, max=813453, per=98.66%, avg=607666.89, stdev=10505.33, samples=952
   iops        : min=  414, max=  794, avg=593.23, stdev=10.26, samples=952
  lat (usec)   : 10=0.02%, 20=0.01%
  lat (msec)   : 20=0.01%, 50=0.06%, 100=0.08%, 250=0.24%, 500=0.42%
  lat (msec)   : 750=17.58%, 1000=78.10%, 2000=4.89%
  cpu          : usr=0.12%, sys=15.76%, ctx=37204, majf=0, minf=2634
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=35587,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=601MiB/s (631MB/s), 601MiB/s-601MiB/s (631MB/s-631MB/s), io=35.3GiB (37.9GB), run=60019-60019msec
Read IOPS: 
read_iops: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
read_iops: Laying out IO file (1 file / 10240MiB)

read_iops: (groupid=0, jobs=1): err= 0: pid=1628381: Sun May 29 00:28:33 2022
  read: IOPS=429, BW=1723KiB/s (1764kB/s)(101MiB/60002msec)
    slat (usec): min=6, max=23924, avg=2322.89, stdev=996.07
    clat (usec): min=4, max=179588, avg=146495.39, stdev=11452.81
     lat (msec): min=2, max=182, avg=148.82, stdev=11.56
    clat percentiles (msec):
     |  1.00th=[  125],  5.00th=[  130], 10.00th=[  133], 20.00th=[  138],
     | 30.00th=[  140], 40.00th=[  144], 50.00th=[  146], 60.00th=[  148],
     | 70.00th=[  153], 80.00th=[  157], 90.00th=[  163], 95.00th=[  165],
     | 99.00th=[  169], 99.50th=[  171], 99.90th=[  176], 99.95th=[  178],
     | 99.99th=[  180]
   bw (  KiB/s): min= 1539, max= 1928, per=99.73%, avg=1718.88, stdev=98.70, samples=120
   iops        : min=  384, max=  482, avg=429.60, stdev=24.66, samples=120
  lat (usec)   : 10=0.01%
  lat (msec)   : 4=0.01%, 10=0.01%, 20=0.01%, 50=0.05%, 100=0.07%
  lat (msec)   : 250=100.10%
  cpu          : usr=0.20%, sys=95.14%, ctx=917, majf=0, minf=73
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=25776,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=1723KiB/s (1764kB/s), 1723KiB/s-1723KiB/s (1764kB/s-1764kB/s), io=101MiB (106MB), run=60002-60002msec
