Write throughput: 
write_throughput: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)

write_throughput: (groupid=0, jobs=8): err= 0: pid=3781733: Sun May 29 06:01:39 2022
  write: IOPS=556, BW=565MiB/s (593MB/s)(33.1GiB/60006msec); 0 zone resets
    slat (msec): min=2, max=372, avg=14.36, stdev= 4.60
    clat (usec): min=6, max=1349.7k, avg=897078.01, stdev=87374.93
     lat (msec): min=3, max=1364, avg=911.38, stdev=87.86
    clat percentiles (msec):
     |  1.00th=[  489],  5.00th=[  827], 10.00th=[  852], 20.00th=[  877],
     | 30.00th=[  885], 40.00th=[  894], 50.00th=[  902], 60.00th=[  911],
     | 70.00th=[  919], 80.00th=[  936], 90.00th=[  953], 95.00th=[  969],
     | 99.00th=[ 1070], 99.50th=[ 1116], 99.90th=[ 1318], 99.95th=[ 1334],
     | 99.99th=[ 1351]
   bw (  KiB/s): min=345793, max=743424, per=98.53%, avg=570187.81, stdev=5455.43, samples=952
   iops        : min=  336, max=  726, avg=556.38, stdev= 5.35, samples=952
  lat (usec)   : 10=0.02%, 20=0.01%
  lat (msec)   : 4=0.01%, 10=0.01%, 20=0.04%, 50=0.07%, 100=0.09%
  lat (msec)   : 250=0.24%, 500=0.56%, 750=1.46%, 1000=96.68%, 2000=2.33%
  cpu          : usr=0.48%, sys=4.22%, ctx=310608, majf=0, minf=5606
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,33398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=565MiB/s (593MB/s), 565MiB/s-565MiB/s (593MB/s-593MB/s), io=33.1GiB (35.6GB), run=60006-60006msec
Write IOPS: 
write_iops: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
write_iops: Laying out IO file (1 file / 10240MiB)

write_iops: (groupid=0, jobs=1): err= 0: pid=3870636: Sun May 29 06:02:42 2022
  write: IOPS=4494, BW=17.6MiB/s (18.4MB/s)(1054MiB/60001msec); 0 zone resets
    slat (usec): min=8, max=171882, avg=217.81, stdev=402.71
    clat (usec): min=4, max=192303, avg=14018.23, stdev=5741.57
     lat (usec): min=393, max=192603, avg=14236.61, stdev=5817.32
    clat percentiles (msec):
     |  1.00th=[    5],  5.00th=[    7], 10.00th=[    8], 20.00th=[   10],
     | 30.00th=[   12], 40.00th=[   13], 50.00th=[   14], 60.00th=[   16],
     | 70.00th=[   17], 80.00th=[   18], 90.00th=[   20], 95.00th=[   22],
     | 99.00th=[   27], 99.50th=[   30], 99.90th=[   41], 99.95th=[   63],
     | 99.99th=[  192]
   bw (  KiB/s): min= 9480, max=43062, per=100.00%, avg=18014.14, stdev=6427.95, samples=119
   iops        : min= 2370, max=10765, avg=4503.45, stdev=1606.96, samples=119
  lat (usec)   : 10=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
  lat (msec)   : 2=0.01%, 4=0.06%, 10=22.51%, 20=68.84%, 50=8.54%
  lat (msec)   : 100=0.04%, 250=0.02%
  cpu          : usr=2.49%, sys=93.60%, ctx=14650, majf=0, minf=445
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,269646,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=17.6MiB/s (18.4MB/s), 17.6MiB/s-17.6MiB/s (18.4MB/s-18.4MB/s), io=1054MiB (1105MB), run=60001-60001msec
Read throughput: 
read_throughput: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)

read_throughput: (groupid=0, jobs=8): err= 0: pid=4069726: Sun May 29 06:06:17 2022
  read: IOPS=461, BW=471MiB/s (493MB/s)(27.6GiB/60027msec)
    slat (usec): min=529, max=143413, avg=17300.41, stdev=9660.95
    clat (usec): min=7, max=1659.8k, avg=1080654.09, stdev=196019.85
     lat (msec): min=6, max=1685, avg=1097.95, stdev=198.26
    clat percentiles (msec):
     |  1.00th=[  617],  5.00th=[  818], 10.00th=[  869], 20.00th=[  936],
     | 30.00th=[  978], 40.00th=[ 1036], 50.00th=[ 1083], 60.00th=[ 1116],
     | 70.00th=[ 1150], 80.00th=[ 1200], 90.00th=[ 1301], 95.00th=[ 1502],
     | 99.00th=[ 1586], 99.50th=[ 1620], 99.90th=[ 1636], 99.95th=[ 1636],
     | 99.99th=[ 1653]
   bw (  KiB/s): min=264192, max=665772, per=98.31%, avg=473671.61, stdev=10249.01, samples=952
   iops        : min=  258, max=  650, avg=462.32, stdev=10.01, samples=952
  lat (usec)   : 10=0.01%, 20=0.01%
  lat (msec)   : 10=0.01%, 20=0.01%, 50=0.06%, 100=0.08%, 250=0.23%
  lat (msec)   : 500=0.41%, 750=1.10%, 1000=32.45%, 2000=67.45%
  cpu          : usr=0.11%, sys=16.20%, ctx=27664, majf=0, minf=2486
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=27732,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=471MiB/s (493MB/s), 471MiB/s-471MiB/s (493MB/s-493MB/s), io=27.6GiB (29.6GB), run=60027-60027msec
Read IOPS: 
read_iops: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
read_iops: Laying out IO file (1 file / 10240MiB)

read_iops: (groupid=0, jobs=1): err= 0: pid=4126071: Sun May 29 06:07:59 2022
  read: IOPS=429, BW=1721KiB/s (1762kB/s)(101MiB/60003msec)
    slat (usec): min=5, max=12722, avg=2325.11, stdev=967.80
    clat (usec): min=4, max=176761, avg=146636.41, stdev=11056.48
     lat (msec): min=2, max=177, avg=148.96, stdev=11.16
    clat percentiles (msec):
     |  1.00th=[  122],  5.00th=[  131], 10.00th=[  134], 20.00th=[  138],
     | 30.00th=[  142], 40.00th=[  144], 50.00th=[  146], 60.00th=[  150],
     | 70.00th=[  153], 80.00th=[  157], 90.00th=[  161], 95.00th=[  163],
     | 99.00th=[  169], 99.50th=[  169], 99.90th=[  174], 99.95th=[  174],
     | 99.99th=[  176]
   bw (  KiB/s): min= 1539, max= 1952, per=99.77%, avg=1717.25, stdev=91.79, samples=120
   iops        : min=  384, max=  488, avg=429.20, stdev=22.96, samples=120
  lat (usec)   : 10=0.01%
  lat (msec)   : 4=0.01%, 10=0.01%, 20=0.01%, 50=0.05%, 100=0.05%
  lat (msec)   : 250=100.12%
  cpu          : usr=0.29%, sys=96.50%, ctx=758, majf=0, minf=68
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=25752,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=1721KiB/s (1762kB/s), 1721KiB/s-1721KiB/s (1762kB/s-1762kB/s), io=101MiB (106MB), run=60003-60003msec
