Write throughput: 
write_throughput: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)

write_throughput: (groupid=0, jobs=8): err= 0: pid=3261760: Sun May 29 05:35:41 2022
  write: IOPS=566, BW=575MiB/s (603MB/s)(33.7GiB/60012msec); 0 zone resets
    slat (msec): min=3, max=125, avg=14.11, stdev= 3.22
    clat (usec): min=6, max=1173.9k, avg=881769.92, stdev=81390.86
     lat (msec): min=3, max=1187, avg=895.83, stdev=81.84
    clat percentiles (msec):
     |  1.00th=[  575],  5.00th=[  802], 10.00th=[  835], 20.00th=[  860],
     | 30.00th=[  869], 40.00th=[  877], 50.00th=[  885], 60.00th=[  894],
     | 70.00th=[  911], 80.00th=[  919], 90.00th=[  944], 95.00th=[  961],
     | 99.00th=[ 1028], 99.50th=[ 1053], 99.90th=[ 1099], 99.95th=[ 1133],
     | 99.99th=[ 1167]
   bw (  KiB/s): min=452608, max=698368, per=98.56%, avg=580284.43, stdev=4496.59, samples=952
   iops        : min=  442, max=  682, avg=566.38, stdev= 4.40, samples=952
  lat (usec)   : 10=0.02%, 20=0.01%, 50=0.01%
  lat (msec)   : 4=0.01%, 10=0.01%, 20=0.03%, 50=0.08%, 100=0.09%
  lat (msec)   : 250=0.24%, 500=0.41%, 750=1.69%, 1000=96.84%, 2000=2.06%
  cpu          : usr=0.44%, sys=4.30%, ctx=298367, majf=0, minf=4938
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,33992,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=575MiB/s (603MB/s), 575MiB/s-575MiB/s (603MB/s-603MB/s), io=33.7GiB (36.2GB), run=60012-60012msec
Write IOPS: 
write_iops: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
write_iops: Laying out IO file (1 file / 10240MiB)

write_iops: (groupid=0, jobs=1): err= 0: pid=3300140: Sun May 29 05:36:43 2022
  write: IOPS=4428, BW=17.3MiB/s (18.1MB/s)(1038MiB/60001msec); 0 zone resets
    slat (usec): min=8, max=74621, avg=221.14, stdev=276.11
    clat (usec): min=4, max=116631, avg=14226.80, stdev=5482.73
     lat (usec): min=429, max=116889, avg=14448.49, stdev=5561.14
    clat percentiles (msec):
     |  1.00th=[    5],  5.00th=[    7], 10.00th=[    8], 20.00th=[   10],
     | 30.00th=[   12], 40.00th=[   13], 50.00th=[   15], 60.00th=[   16],
     | 70.00th=[   18], 80.00th=[   19], 90.00th=[   21], 95.00th=[   22],
     | 99.00th=[   28], 99.50th=[   31], 99.90th=[   55], 99.95th=[   69],
     | 99.99th=[  115]
   bw (  KiB/s): min=10733, max=45411, per=100.00%, avg=17762.01, stdev=6738.78, samples=119
   iops        : min= 2683, max=11352, avg=4440.45, stdev=1684.66, samples=119
  lat (usec)   : 10=0.01%, 500=0.01%, 1000=0.01%
  lat (msec)   : 2=0.01%, 4=0.12%, 10=22.18%, 20=67.61%, 50=9.99%
  lat (msec)   : 100=0.10%, 250=0.02%
  cpu          : usr=2.22%, sys=94.28%, ctx=14236, majf=0, minf=251
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,265694,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=17.3MiB/s (18.1MB/s), 17.3MiB/s-17.3MiB/s (18.1MB/s-18.1MB/s), io=1038MiB (1089MB), run=60001-60001msec
Read throughput: 
read_throughput: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)

read_throughput: (groupid=0, jobs=8): err= 0: pid=3395768: Sun May 29 05:40:18 2022
  read: IOPS=592, BW=601MiB/s (631MB/s)(35.2GiB/60014msec)
    slat (usec): min=847, max=67370, avg=13478.84, stdev=6681.74
    clat (usec): min=9, max=1850.1k, avg=844919.40, stdev=188637.51
     lat (msec): min=10, max=1879, avg=858.43, stdev=191.28
    clat percentiles (msec):
     |  1.00th=[  531],  5.00th=[  642], 10.00th=[  684], 20.00th=[  735],
     | 30.00th=[  768], 40.00th=[  802], 50.00th=[  827], 60.00th=[  860],
     | 70.00th=[  885], 80.00th=[  911], 90.00th=[  953], 95.00th=[ 1036],
     | 99.00th=[ 1620], 99.50th=[ 1653], 99.90th=[ 1770], 99.95th=[ 1804],
     | 99.99th=[ 1838]
   bw (  KiB/s): min=434176, max=904224, per=98.67%, avg=607612.80, stdev=12276.93, samples=952
   iops        : min=  424, max=  883, avg=593.20, stdev=11.98, samples=952
  lat (usec)   : 10=0.01%, 20=0.01%, 50=0.01%
  lat (msec)   : 20=0.03%, 50=0.06%, 100=0.07%, 250=0.24%, 500=0.42%
  lat (msec)   : 750=23.63%, 1000=71.19%, 2000=5.76%
  cpu          : usr=0.12%, sys=17.13%, ctx=34015, majf=0, minf=2481
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=35578,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=601MiB/s (631MB/s), 601MiB/s-601MiB/s (631MB/s-631MB/s), io=35.2GiB (37.8GB), run=60014-60014msec
Read IOPS: 
read_iops: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
read_iops: Laying out IO file (1 file / 10240MiB)

read_iops: (groupid=0, jobs=1): err= 0: pid=3417843: Sun May 29 05:41:59 2022
  read: IOPS=443, BW=1779KiB/s (1822kB/s)(104MiB/60001msec)
    slat (usec): min=5, max=16942, avg=2248.66, stdev=1003.07
    clat (usec): min=4, max=176003, avg=141828.72, stdev=10363.37
     lat (msec): min=2, max=178, avg=144.08, stdev=10.46
    clat percentiles (msec):
     |  1.00th=[  117],  5.00th=[  128], 10.00th=[  131], 20.00th=[  136],
     | 30.00th=[  138], 40.00th=[  140], 50.00th=[  142], 60.00th=[  144],
     | 70.00th=[  146], 80.00th=[  150], 90.00th=[  155], 95.00th=[  159],
     | 99.00th=[  165], 99.50th=[  167], 99.90th=[  174], 99.95th=[  176],
     | 99.99th=[  176]
   bw (  KiB/s): min= 1584, max= 1968, per=99.76%, avg=1775.59, stdev=80.85, samples=120
   iops        : min=  396, max=  492, avg=443.77, stdev=20.20, samples=120
  lat (usec)   : 10=0.01%
  lat (msec)   : 4=0.01%, 10=0.01%, 20=0.02%, 50=0.05%, 100=0.09%
  lat (msec)   : 250=100.06%
  cpu          : usr=0.20%, sys=96.87%, ctx=579, majf=0, minf=66
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=26626,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=1779KiB/s (1822kB/s), 1779KiB/s-1779KiB/s (1822kB/s-1822kB/s), io=104MiB (109MB), run=60001-60001msec
