Write throughput: 
write_throughput: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)

write_throughput: (groupid=0, jobs=8): err= 0: pid=329292: Sun May 29 06:17:24 2022
  write: IOPS=557, BW=566MiB/s (593MB/s)(33.1GiB/60010msec); 0 zone resets
    slat (msec): min=3, max=124, avg=14.34, stdev= 2.45
    clat (usec): min=7, max=1078.9k, avg=896325.31, stdev=76663.69
     lat (msec): min=7, max=1093, avg=910.61, stdev=77.01
    clat percentiles (msec):
     |  1.00th=[  592],  5.00th=[  835], 10.00th=[  860], 20.00th=[  877],
     | 30.00th=[  885], 40.00th=[  894], 50.00th=[  902], 60.00th=[  911],
     | 70.00th=[  919], 80.00th=[  936], 90.00th=[  944], 95.00th=[  961],
     | 99.00th=[ 1003], 99.50th=[ 1020], 99.90th=[ 1062], 99.95th=[ 1083],
     | 99.99th=[ 1083]
   bw (  KiB/s): min=466944, max=672236, per=98.54%, avg=570724.97, stdev=3611.55, samples=952
   iops        : min=  456, max=  656, avg=557.18, stdev= 3.53, samples=952
  lat (usec)   : 10=0.02%, 20=0.01%
  lat (msec)   : 10=0.01%, 20=0.02%, 50=0.07%, 100=0.09%, 250=0.24%
  lat (msec)   : 500=0.41%, 750=1.03%, 1000=98.58%, 2000=1.03%
  cpu          : usr=0.46%, sys=4.34%, ctx=307732, majf=0, minf=7579
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,33431,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=566MiB/s (593MB/s), 566MiB/s-566MiB/s (593MB/s-593MB/s), io=33.1GiB (35.6GB), run=60010-60010msec
Write IOPS: 
write_iops: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
write_iops: Laying out IO file (1 file / 10240MiB)

write_iops: (groupid=0, jobs=1): err= 0: pid=424336: Sun May 29 06:18:27 2022
  write: IOPS=4449, BW=17.4MiB/s (18.2MB/s)(1043MiB/60001msec); 0 zone resets
    slat (usec): min=8, max=60297, avg=220.05, stdev=247.26
    clat (usec): min=4, max=96680, avg=14159.18, stdev=5282.86
     lat (usec): min=526, max=97081, avg=14379.77, stdev=5359.03
    clat percentiles (usec):
     |  1.00th=[ 4948],  5.00th=[ 6456], 10.00th=[ 7570], 20.00th=[ 9503],
     | 30.00th=[11338], 40.00th=[12649], 50.00th=[13829], 60.00th=[15270],
     | 70.00th=[16909], 80.00th=[18482], 90.00th=[20317], 95.00th=[21890],
     | 99.00th=[27132], 99.50th=[29754], 99.90th=[49546], 99.95th=[58983],
     | 99.99th=[95945]
   bw (  KiB/s): min=10914, max=41752, per=100.00%, avg=17838.52, stdev=6401.98, samples=119
   iops        : min= 2728, max=10438, avg=4459.53, stdev=1600.39, samples=119
  lat (usec)   : 10=0.01%, 750=0.01%, 1000=0.01%
  lat (msec)   : 2=0.01%, 4=0.08%, 10=22.09%, 20=66.26%, 50=11.49%
  lat (msec)   : 100=0.10%
  cpu          : usr=2.44%, sys=93.94%, ctx=14602, majf=0, minf=730
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,266961,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=17.4MiB/s (18.2MB/s), 17.4MiB/s-17.4MiB/s (18.2MB/s-18.2MB/s), io=1043MiB (1094MB), run=60001-60001msec
Read throughput: 
read_throughput: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)

read_throughput: (groupid=0, jobs=8): err= 0: pid=635178: Sun May 29 06:22:17 2022
  read: IOPS=467, BW=476MiB/s (499MB/s)(27.9GiB/60019msec)
    slat (usec): min=526, max=116376, avg=17090.06, stdev=9375.91
    clat (usec): min=8, max=1728.9k, avg=1068301.09, stdev=201802.27
     lat (msec): min=14, max=1756, avg=1085.42, stdev=204.08
    clat percentiles (msec):
     |  1.00th=[  709],  5.00th=[  802], 10.00th=[  844], 20.00th=[  919],
     | 30.00th=[  961], 40.00th=[ 1003], 50.00th=[ 1062], 60.00th=[ 1099],
     | 70.00th=[ 1150], 80.00th=[ 1200], 90.00th=[ 1318], 95.00th=[ 1485],
     | 99.00th=[ 1586], 99.50th=[ 1603], 99.90th=[ 1687], 99.95th=[ 1703],
     | 99.99th=[ 1720]
   bw (  KiB/s): min=258048, max=675840, per=98.38%, avg=479730.86, stdev=10006.25, samples=952
   iops        : min=  252, max=  660, avg=468.41, stdev= 9.77, samples=952
  lat (usec)   : 10=0.01%, 20=0.01%
  lat (msec)   : 20=0.03%, 50=0.04%, 100=0.09%, 250=0.21%, 500=0.38%
  lat (msec)   : 750=0.88%, 1000=38.06%, 2000=62.07%
  cpu          : usr=0.09%, sys=16.97%, ctx=27204, majf=0, minf=2253
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=28070,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=476MiB/s (499MB/s), 476MiB/s-476MiB/s (499MB/s-499MB/s), io=27.9GiB (29.0GB), run=60019-60019msec
Read IOPS: 
read_iops: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
read_iops: Laying out IO file (1 file / 10240MiB)

read_iops: (groupid=0, jobs=1): err= 0: pid=688284: Sun May 29 06:23:57 2022
  read: IOPS=438, BW=1759KiB/s (1801kB/s)(103MiB/60002msec)
    slat (usec): min=6, max=16433, avg=2274.42, stdev=963.64
    clat (usec): min=4, max=171341, avg=143426.07, stdev=10790.74
     lat (msec): min=2, max=173, avg=145.70, stdev=10.89
    clat percentiles (msec):
     |  1.00th=[  120],  5.00th=[  129], 10.00th=[  132], 20.00th=[  136],
     | 30.00th=[  138], 40.00th=[  140], 50.00th=[  144], 60.00th=[  146],
     | 70.00th=[  148], 80.00th=[  153], 90.00th=[  159], 95.00th=[  161],
     | 99.00th=[  167], 99.50th=[  167], 99.90th=[  169], 99.95th=[  171],
     | 99.99th=[  171]
   bw (  KiB/s): min= 1539, max= 1952, per=99.76%, avg=1755.41, stdev=86.69, samples=120
   iops        : min=  384, max=  488, avg=438.73, stdev=21.66, samples=120
  lat (usec)   : 10=0.01%
  lat (msec)   : 4=0.01%, 10=0.01%, 20=0.03%, 50=0.05%, 100=0.09%
  lat (msec)   : 250=100.06%
  cpu          : usr=0.27%, sys=96.56%, ctx=743, majf=0, minf=68
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=26324,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=1759KiB/s (1801kB/s), 1759KiB/s-1759KiB/s (1801kB/s-1801kB/s), io=103MiB (108MB), run=60002-60002msec
