Write throughput: 
write_throughput: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)

write_throughput: (groupid=0, jobs=8): err= 0: pid=734017: Sun May 29 06:32:18 2022
  write: IOPS=1279, BW=1288MiB/s (1351MB/s)(75.5GiB/60006msec); 0 zone resets
    slat (usec): min=651, max=1090.3k, avg=6228.00, stdev=14278.95
    clat (usec): min=6, max=1499.2k, avg=391912.15, stdev=164917.78
     lat (msec): min=2, max=1504, avg=398.12, stdev=166.46
    clat percentiles (msec):
     |  1.00th=[  171],  5.00th=[  218], 10.00th=[  251], 20.00th=[  296],
     | 30.00th=[  330], 40.00th=[  347], 50.00th=[  355], 60.00th=[  368],
     | 70.00th=[  409], 80.00th=[  485], 90.00th=[  514], 95.00th=[  609],
     | 99.00th=[ 1334], 99.50th=[ 1418], 99.90th=[ 1469], 99.95th=[ 1469],
     | 99.99th=[ 1485]
   bw (  MiB/s): min=  143, max= 2490, per=100.00%, avg=1292.08, stdev=50.23, samples=937
   iops        : min=  140, max= 2489, avg=1290.76, stdev=50.26, samples=937
  lat (usec)   : 10=0.01%, 20=0.01%
  lat (msec)   : 4=0.01%, 10=0.01%, 20=0.02%, 50=0.06%, 100=0.07%
  lat (msec)   : 250=9.59%, 500=73.72%, 750=14.06%, 1000=1.67%, 2000=1.43%
  cpu          : usr=1.39%, sys=13.71%, ctx=757635, majf=0, minf=15637
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,76782,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=1288MiB/s (1351MB/s), 1288MiB/s-1288MiB/s (1351MB/s-1351MB/s), io=75.5GiB (81.0GB), run=60006-60006msec
Write IOPS: 
write_iops: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
write_iops: Laying out IO file (1 file / 10240MiB)

write_iops: (groupid=0, jobs=1): err= 0: pid=1018531: Sun May 29 06:33:20 2022
  write: IOPS=13.0k, BW=50.0MiB/s (53.4MB/s)(3058MiB/60001msec); 0 zone resets
    slat (usec): min=8, max=51240, avg=71.40, stdev=183.45
    clat (usec): min=5, max=114940, avg=4830.98, stdev=2565.57
     lat (usec): min=99, max=115032, avg=4903.00, stdev=2595.71
    clat percentiles (usec):
     |  1.00th=[ 3163],  5.00th=[ 3458], 10.00th=[ 3621], 20.00th=[ 3785],
     | 30.00th=[ 3916], 40.00th=[ 4015], 50.00th=[ 4146], 60.00th=[ 4293],
     | 70.00th=[ 4424], 80.00th=[ 5080], 90.00th=[ 7373], 95.00th=[ 8586],
     | 99.00th=[13042], 99.50th=[17695], 99.90th=[32900], 99.95th=[40109],
     | 99.99th=[84411]
   bw (  KiB/s): min=40406, max=66144, per=100.00%, avg=52263.53, stdev=4393.57, samples=119
   iops        : min=10101, max=16536, avg=13065.83, stdev=1098.37, samples=119
  lat (usec)   : 10=0.01%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
  lat (msec)   : 2=0.01%, 4=37.53%, 10=60.47%, 20=1.62%, 50=0.36%
  lat (msec)   : 100=0.02%, 250=0.01%
  cpu          : usr=7.51%, sys=88.58%, ctx=5677, majf=0, minf=3185
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,782729,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=50.0MiB/s (53.4MB/s), 50.0MiB/s-50.0MiB/s (53.4MB/s-53.4MB/s), io=3058MiB (3206MB), run=60001-60001msec
Read throughput: 
read_throughput: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)

read_throughput: (groupid=0, jobs=8): err= 0: pid=1649298: Sun May 29 06:36:08 2022
  read: IOPS=1798, BW=1807MiB/s (1895MB/s)(106GiB/60008msec)
    slat (usec): min=522, max=81334, avg=4434.44, stdev=2888.20
    clat (usec): min=7, max=481115, avg=279532.45, stdev=64262.98
     lat (msec): min=2, max=484, avg=283.97, stdev=65.20
    clat percentiles (msec):
     |  1.00th=[   73],  5.00th=[  118], 10.00th=[  209], 20.00th=[  251],
     | 30.00th=[  271], 40.00th=[  284], 50.00th=[  296], 60.00th=[  305],
     | 70.00th=[  317], 80.00th=[  326], 90.00th=[  338], 95.00th=[  351],
     | 99.00th=[  376], 99.50th=[  388], 99.90th=[  456], 99.95th=[  464],
     | 99.99th=[  472]
   bw (  MiB/s): min= 1295, max= 3250, per=99.60%, avg=1799.55, stdev=68.45, samples=954
   iops        : min= 1294, max= 3250, avg=1799.01, stdev=68.45, samples=954
  lat (usec)   : 10=0.01%, 20=0.01%
  lat (msec)   : 4=0.01%, 10=0.01%, 20=0.01%, 50=0.05%, 100=2.56%
  lat (msec)   : 250=17.10%, 500=80.72%
  cpu          : usr=0.36%, sys=30.74%, ctx=103602, majf=0, minf=33858
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=107909,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=1807MiB/s (1895MB/s), 1807MiB/s-1807MiB/s (1895MB/s-1895MB/s), io=106GiB (114GB), run=60008-60008msec
Read IOPS: 
read_iops: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
read_iops: Laying out IO file (1 file / 10240MiB)

read_iops: (groupid=0, jobs=1): err= 0: pid=2169680: Sun May 29 06:37:35 2022
  read: IOPS=16.1k, BW=62.0MiB/s (66.0MB/s)(3778MiB/60001msec)
    slat (usec): min=4, max=7022, avg=58.21, stdev=87.38
    clat (usec): min=3, max=81787, avg=3910.30, stdev=2206.76
     lat (usec): min=51, max=81894, avg=3968.95, stdev=2239.74
    clat percentiles (usec):
     |  1.00th=[ 2737],  5.00th=[ 2835], 10.00th=[ 2900], 20.00th=[ 2966],
     | 30.00th=[ 2999], 40.00th=[ 3064], 50.00th=[ 3097], 60.00th=[ 3195],
     | 70.00th=[ 3556], 80.00th=[ 4178], 90.00th=[ 6128], 95.00th=[ 8291],
     | 99.00th=[11731], 99.50th=[12780], 99.90th=[15008], 99.95th=[33817],
     | 99.99th=[66847]
   bw (  KiB/s): min=12816, max=87576, per=100.00%, avg=64489.16, stdev=22144.31, samples=120
   iops        : min= 3204, max=21894, avg=16122.24, stdev=5536.11, samples=120
  lat (usec)   : 4=0.01%, 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%
  lat (usec)   : 1000=0.01%
  lat (msec)   : 2=0.01%, 4=77.98%, 10=19.42%, 20=2.55%, 50=0.03%
  lat (msec)   : 100=0.03%
  cpu          : usr=6.72%, sys=75.86%, ctx=25225, majf=0, minf=262
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=967049,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=62.0MiB/s (66.0MB/s), 62.0MiB/s-62.0MiB/s (66.0MB/s-66.0MB/s), io=3778MiB (3961MB), run=60001-60001msec
