Write throughput: 
write_throughput: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)

write_throughput: (groupid=0, jobs=8): err= 0: pid=1204773: Sun May 29 08:03:32 2022
  write: IOPS=368, BW=377MiB/s (395MB/s)(22.1GiB/60011msec); 0 zone resets
    slat (msec): min=5, max=173, avg=21.70, stdev= 4.21
    clat (usec): min=7, max=1922.6k, avg=1346380.81, stdev=192802.50
     lat (msec): min=6, max=1951, avg=1367.85, stdev=194.54
    clat percentiles (msec):
     |  1.00th=[  575],  5.00th=[ 1183], 10.00th=[ 1217], 20.00th=[ 1250],
     | 30.00th=[ 1284], 40.00th=[ 1301], 50.00th=[ 1334], 60.00th=[ 1351],
     | 70.00th=[ 1385], 80.00th=[ 1435], 90.00th=[ 1569], 95.00th=[ 1670],
     | 99.00th=[ 1838], 99.50th=[ 1854], 99.90th=[ 1905], 99.95th=[ 1905],
     | 99.99th=[ 1921]
   bw (  KiB/s): min=223232, max=460800, per=97.77%, avg=377288.13, stdev=5725.89, samples=952
   iops        : min=  218, max=  450, avg=368.29, stdev= 5.61, samples=952
  lat (usec)   : 10=0.02%, 20=0.01%
  lat (msec)   : 10=0.01%, 20=0.02%, 50=0.07%, 100=0.09%, 250=0.25%
  lat (msec)   : 500=0.43%, 750=0.64%, 1000=1.28%, 2000=99.45%
  cpu          : usr=0.35%, sys=3.26%, ctx=181941, majf=0, minf=7574
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,22102,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=377MiB/s (395MB/s), 377MiB/s-377MiB/s (395MB/s-395MB/s), io=22.1GiB (23.7GB), run=60011-60011msec
Write IOPS: 
write_iops: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
write_iops: Laying out IO file (1 file / 10240MiB)

write_iops: (groupid=0, jobs=1): err= 0: pid=1335856: Sun May 29 08:04:35 2022
  write: IOPS=9000, BW=35.2MiB/s (36.9MB/s)(2110MiB/60001msec); 0 zone resets
    slat (usec): min=8, max=56084, avg=105.60, stdev=251.17
    clat (usec): min=4, max=238558, avg=7001.46, stdev=5298.14
     lat (usec): min=76, max=238834, avg=7107.72, stdev=5373.04
    clat percentiles (msec):
     |  1.00th=[    4],  5.00th=[    4], 10.00th=[    4], 20.00th=[    4],
     | 30.00th=[    5], 40.00th=[    5], 50.00th=[    6], 60.00th=[    7],
     | 70.00th=[    7], 80.00th=[    9], 90.00th=[   14], 95.00th=[   18],
     | 99.00th=[   23], 99.50th=[   31], 99.90th=[   51], 99.95th=[   56],
     | 99.99th=[  133]
   bw (  KiB/s): min= 7046, max=67824, per=99.63%, avg=35873.07, stdev=15001.40, samples=119
   iops        : min= 1761, max=16956, avg=8968.22, stdev=3750.36, samples=119
  lat (usec)   : 10=0.01%, 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%
  lat (usec)   : 1000=0.01%
  lat (msec)   : 2=0.01%, 4=22.20%, 10=61.93%, 20=13.68%, 50=2.10%
  lat (msec)   : 100=0.08%, 250=0.01%
  cpu          : usr=5.25%, sys=60.41%, ctx=121108, majf=0, minf=737
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,540063,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=35.2MiB/s (36.9MB/s), 35.2MiB/s-35.2MiB/s (36.9MB/s-36.9MB/s), io=2110MiB (2212MB), run=60001-60001msec
Read throughput: 
read_throughput: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)

read_throughput: (groupid=0, jobs=8): err= 0: pid=1867444: Sun May 29 08:11:08 2022
  read: IOPS=1176, BW=1185MiB/s (1242MB/s)(69.6GiB/60138msec)
    slat (usec): min=421, max=703287, avg=6787.43, stdev=28894.90
    clat (usec): min=8, max=3511.0k, avg=428199.71, stdev=586358.84
     lat (msec): min=28, max=3517, avg=435.05, stdev=595.31
    clat percentiles (msec):
     |  1.00th=[   31],  5.00th=[   33], 10.00th=[   35], 20.00th=[   36],
     | 30.00th=[   39], 40.00th=[   41], 50.00th=[   45], 60.00th=[   61],
     | 70.00th=[  726], 80.00th=[ 1116], 90.00th=[ 1401], 95.00th=[ 1552],
     | 99.00th=[ 1905], 99.50th=[ 2056], 99.90th=[ 2433], 99.95th=[ 2735],
     | 99.99th=[ 3440]
   bw (  MiB/s): min=  110, max= 4334, per=99.56%, avg=1179.50, stdev=275.09, samples=953
   iops        : min=  110, max= 4334, avg=1179.44, stdev=275.09, samples=953
  lat (usec)   : 10=0.01%, 20=0.01%
  lat (msec)   : 50=54.37%, 100=9.67%, 250=4.09%, 500=0.41%, 750=2.51%
  lat (msec)   : 1000=5.83%, 2000=23.18%, >=2000=0.63%
  cpu          : usr=0.12%, sys=11.93%, ctx=7266, majf=0, minf=1827
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=70731,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=1185MiB/s (1242MB/s), 1185MiB/s-1185MiB/s (1242MB/s-1242MB/s), io=69.6GiB (74.7GB), run=60138-60138msec
Read IOPS: 
read_iops: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
read_iops: Laying out IO file (1 file / 10240MiB)

read_iops: (groupid=0, jobs=1): err= 0: pid=2063768: Sun May 29 08:12:50 2022
  read: IOPS=21.6k, BW=84.4MiB/s (88.5MB/s)(5063MiB/60001msec)
    slat (usec): min=4, max=3883, avg=43.02, stdev=13.48
    clat (usec): min=3, max=17506, avg=2917.63, stdev=217.37
     lat (usec): min=44, max=17551, avg=2960.99, stdev=219.75
    clat percentiles (usec):
     |  1.00th=[ 2606],  5.00th=[ 2671], 10.00th=[ 2737], 20.00th=[ 2769],
     | 30.00th=[ 2835], 40.00th=[ 2868], 50.00th=[ 2900], 60.00th=[ 2933],
     | 70.00th=[ 2966], 80.00th=[ 3032], 90.00th=[ 3130], 95.00th=[ 3228],
     | 99.00th=[ 3523], 99.50th=[ 3720], 99.90th=[ 4621], 99.95th=[ 5276],
     | 99.99th=[ 6259]
   bw (  KiB/s): min=77563, max=89328, per=100.00%, avg=86435.88, stdev=2377.00, samples=120
   iops        : min=19390, max=22332, avg=21608.92, stdev=594.27, samples=120
  lat (usec)   : 4=0.01%, 50=0.01%, 100=0.01%, 250=0.01%, 500=0.01%
  lat (usec)   : 750=0.01%, 1000=0.01%
  lat (msec)   : 2=0.01%, 4=99.72%, 10=0.28%, 20=0.01%
  cpu          : usr=7.34%, sys=92.65%, ctx=186, majf=0, minf=239
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=1296072,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=84.4MiB/s (88.5MB/s), 84.4MiB/s-84.4MiB/s (88.5MB/s-88.5MB/s), io=5063MiB (5309MB), run=60001-60001msec
