Write throughput: 
write_throughput: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)

write_throughput: (groupid=0, jobs=8): err= 0: pid=208339: Sat May 28 23:48:40 2022
  write: IOPS=367, BW=376MiB/s (395MB/s)(22.1GiB/60025msec); 0 zone resets
    slat (msec): min=3, max=358, avg=21.73, stdev= 8.12
    clat (usec): min=5, max=2421.4k, avg=1349007.86, stdev=210806.45
     lat (msec): min=9, max=2448, avg=1370.52, stdev=212.65
    clat percentiles (msec):
     |  1.00th=[  592],  5.00th=[ 1133], 10.00th=[ 1183], 20.00th=[ 1234],
     | 30.00th=[ 1267], 40.00th=[ 1284], 50.00th=[ 1318], 60.00th=[ 1368],
     | 70.00th=[ 1418], 80.00th=[ 1485], 90.00th=[ 1586], 95.00th=[ 1703],
     | 99.00th=[ 1921], 99.50th=[ 2022], 99.90th=[ 2140], 99.95th=[ 2232],
     | 99.99th=[ 2366]
   bw (  KiB/s): min=186216, max=520196, per=97.93%, avg=377370.56, stdev=7520.71, samples=951
   iops        : min=  181, max=  507, avg=367.74, stdev= 7.36, samples=951
  lat (usec)   : 10=0.02%, 20=0.01%
  lat (msec)   : 10=0.01%, 20=0.01%, 50=0.05%, 100=0.07%, 250=0.22%
  lat (msec)   : 500=0.45%, 750=0.56%, 1000=1.22%, 2000=99.11%, >=2000=0.55%
  cpu          : usr=0.31%, sys=3.06%, ctx=198508, majf=1, minf=5221
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,22076,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=376MiB/s (395MB/s), 376MiB/s-376MiB/s (395MB/s-395MB/s), io=22.1GiB (23.7GB), run=60025-60025msec
Write IOPS: 
write_iops: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
write_iops: Laying out IO file (1 file / 10240MiB)

write_iops: (groupid=0, jobs=1): err= 0: pid=268926: Sat May 28 23:49:43 2022
  write: IOPS=4351, BW=17.0MiB/s (17.8MB/s)(1020MiB/60001msec); 0 zone resets
    slat (usec): min=8, max=68395, avg=224.94, stdev=326.95
    clat (usec): min=4, max=128216, avg=14479.63, stdev=5793.05
     lat (usec): min=234, max=128654, avg=14705.18, stdev=5873.41
    clat percentiles (msec):
     |  1.00th=[    5],  5.00th=[    6], 10.00th=[    8], 20.00th=[   10],
     | 30.00th=[   12], 40.00th=[   14], 50.00th=[   15], 60.00th=[   17],
     | 70.00th=[   18], 80.00th=[   19], 90.00th=[   21], 95.00th=[   22],
     | 99.00th=[   28], 99.50th=[   34], 99.90th=[   73], 99.95th=[   87],
     | 99.99th=[  112]
   bw (  KiB/s): min= 9704, max=51350, per=100.00%, avg=17445.12, stdev=6835.75, samples=119
   iops        : min= 2426, max=12837, avg=4361.21, stdev=1708.90, samples=119
  lat (usec)   : 10=0.01%, 250=0.01%, 500=0.01%, 1000=0.01%
  lat (msec)   : 2=0.01%, 4=0.73%, 10=20.19%, 20=69.18%, 50=9.76%
  lat (msec)   : 100=0.14%, 250=0.03%
  cpu          : usr=2.28%, sys=88.75%, ctx=25550, majf=0, minf=725
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,261073,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=17.0MiB/s (17.8MB/s), 17.0MiB/s-17.0MiB/s (17.8MB/s-17.8MB/s), io=1020MiB (1070MB), run=60001-60001msec
Read throughput: 
read_throughput: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)

read_throughput: (groupid=0, jobs=8): err= 0: pid=729498: Sat May 28 23:56:08 2022
  read: IOPS=381, BW=390MiB/s (409MB/s)(22.9GiB/60067msec)
    slat (usec): min=500, max=422322, avg=20987.15, stdev=40845.92
    clat (usec): min=7, max=3156.4k, avg=1308306.23, stdev=304010.71
     lat (usec): min=1007, max=3178.8k, avg=1329347.33, stdev=307307.17
    clat percentiles (msec):
     |  1.00th=[  456],  5.00th=[  860], 10.00th=[  953], 20.00th=[ 1070],
     | 30.00th=[ 1167], 40.00th=[ 1250], 50.00th=[ 1334], 60.00th=[ 1401],
     | 70.00th=[ 1435], 80.00th=[ 1502], 90.00th=[ 1620], 95.00th=[ 1737],
     | 99.00th=[ 2265], 99.50th=[ 2567], 99.90th=[ 3004], 99.95th=[ 3037],
     | 99.99th=[ 3138]
   bw (  KiB/s): min=155648, max=658900, per=97.89%, avg=390521.09, stdev=13240.88, samples=954
   iops        : min=  152, max=  643, avg=381.18, stdev=12.93, samples=954
  lat (usec)   : 10=0.01%, 20=0.02%
  lat (msec)   : 2=0.01%, 10=0.01%, 50=0.05%, 100=0.10%, 250=0.33%
  lat (msec)   : 500=0.50%, 750=1.03%, 1000=11.68%, 2000=86.69%, >=2000=1.73%
  cpu          : usr=0.06%, sys=21.43%, ctx=8339, majf=0, minf=11261
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.1%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=22895,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=390MiB/s (409MB/s), 390MiB/s-390MiB/s (409MB/s-409MB/s), io=22.9GiB (24.5GB), run=60067-60067msec
Read IOPS: 
read_iops: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
read_iops: Laying out IO file (1 file / 10240MiB)

read_iops: (groupid=0, jobs=1): err= 0: pid=829258: Sat May 28 23:58:03 2022
  read: IOPS=377, BW=1513KiB/s (1550kB/s)(88.7MiB/60001msec)
    slat (usec): min=5, max=172415, avg=2645.53, stdev=3024.16
    clat (usec): min=4, max=489552, avg=166746.67, stdev=31259.23
     lat (msec): min=2, max=492, avg=169.39, stdev=31.58
    clat percentiles (msec):
     |  1.00th=[  126],  5.00th=[  136], 10.00th=[  140], 20.00th=[  148],
     | 30.00th=[  153], 40.00th=[  157], 50.00th=[  161], 60.00th=[  165],
     | 70.00th=[  171], 80.00th=[  182], 90.00th=[  199], 95.00th=[  218],
     | 99.00th=[  279], 99.50th=[  330], 99.90th=[  464], 99.95th=[  481],
     | 99.99th=[  481]
   bw (  KiB/s): min=  768, max= 1928, per=99.91%, avg=1512.24, stdev=186.22, samples=119
   iops        : min=  192, max=  482, avg=377.95, stdev=46.54, samples=119
  lat (usec)   : 10=0.01%
  lat (msec)   : 4=0.01%, 10=0.01%, 20=0.03%, 50=0.03%, 100=0.06%
  lat (msec)   : 250=98.21%, 500=1.93%
  cpu          : usr=0.22%, sys=85.70%, ctx=702, majf=0, minf=68
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=22636,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=1513KiB/s (1550kB/s), 1513KiB/s-1513KiB/s (1550kB/s-1550kB/s), io=88.7MiB (92.0MB), run=60001-60001msec
