Write throughput: 
write_throughput: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)

write_throughput: (groupid=0, jobs=8): err= 0: pid=3830766: Sun May 29 11:48:16 2022
  write: IOPS=302, BW=311MiB/s (326MB/s)(18.2GiB/60022msec); 0 zone resets
    slat (msec): min=6, max=136, avg=26.41, stdev= 4.44
    clat (usec): min=6, max=2348.9k, avg=1633109.77, stdev=243446.75
     lat (msec): min=12, max=2373, avg=1659.17, stdev=245.52
    clat percentiles (msec):
     |  1.00th=[  600],  5.00th=[ 1401], 10.00th=[ 1452], 20.00th=[ 1519],
     | 30.00th=[ 1552], 40.00th=[ 1586], 50.00th=[ 1620], 60.00th=[ 1653],
     | 70.00th=[ 1687], 80.00th=[ 1804], 90.00th=[ 1921], 95.00th=[ 2005],
     | 99.00th=[ 2165], 99.50th=[ 2198], 99.90th=[ 2299], 99.95th=[ 2333],
     | 99.99th=[ 2333]
   bw (  KiB/s): min=194470, max=393510, per=97.38%, avg=310314.05, stdev=4901.05, samples=952
   iops        : min=  189, max=  384, avg=302.88, stdev= 4.81, samples=952
  lat (usec)   : 10=0.03%, 20=0.01%
  lat (msec)   : 20=0.01%, 50=0.07%, 100=0.08%, 250=0.23%, 500=0.44%
  lat (msec)   : 750=0.45%, 1000=1.00%, 2000=94.94%, >=2000=5.52%
  cpu          : usr=0.29%, sys=2.60%, ctx=147128, majf=0, minf=2569
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,18167,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=311MiB/s (326MB/s), 311MiB/s-311MiB/s (326MB/s-326MB/s), io=18.2GiB (19.6GB), run=60022-60022msec
Write IOPS: 
write_iops: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
write_iops: Laying out IO file (1 file / 10240MiB)

write_iops: (groupid=0, jobs=1): err= 0: pid=3858096: Sun May 29 11:49:18 2022
  write: IOPS=9581, BW=37.4MiB/s (39.3MB/s)(2246MiB/60001msec); 0 zone resets
    slat (usec): min=8, max=84131, avg=98.96, stdev=323.53
    clat (usec): min=6, max=163974, avg=6577.41, stdev=5566.62
     lat (usec): min=229, max=164162, avg=6677.01, stdev=5643.03
    clat percentiles (msec):
     |  1.00th=[    3],  5.00th=[    4], 10.00th=[    4], 20.00th=[    4],
     | 30.00th=[    4], 40.00th=[    5], 50.00th=[    5], 60.00th=[    6],
     | 70.00th=[    7], 80.00th=[    8], 90.00th=[   13], 95.00th=[   17],
     | 99.00th=[   26], 99.50th=[   33], 99.90th=[   59], 99.95th=[   91],
     | 99.99th=[  130]
   bw (  KiB/s): min= 7272, max=68944, per=99.89%, avg=38288.13, stdev=16701.85, samples=119
   iops        : min= 1818, max=17236, avg=9571.94, stdev=4175.49, samples=119
  lat (usec)   : 10=0.01%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
  lat (msec)   : 2=0.01%, 4=34.55%, 10=51.11%, 20=11.72%, 50=2.47%
  lat (msec)   : 100=0.13%, 250=0.03%
  cpu          : usr=5.54%, sys=62.17%, ctx=109137, majf=0, minf=405
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,574915,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=37.4MiB/s (39.3MB/s), 37.4MiB/s-37.4MiB/s (39.3MB/s-39.3MB/s), io=2246MiB (2355MB), run=60001-60001msec
Read throughput: 
read_throughput: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)

read_throughput: (groupid=0, jobs=8): err= 0: pid=195288: Sun May 29 11:55:30 2022
  read: IOPS=534, BW=543MiB/s (569MB/s)(31.9GiB/60214msec)
    slat (usec): min=249, max=640502, avg=14947.88, stdev=41679.37
    clat (usec): min=7, max=3894.4k, avg=934915.46, stdev=717557.34
     lat (msec): min=28, max=3928, avg=949.84, stdev=728.41
    clat percentiles (msec):
     |  1.00th=[   33],  5.00th=[   37], 10.00th=[   44], 20.00th=[   56],
     | 30.00th=[   67], 40.00th=[  835], 50.00th=[ 1083], 60.00th=[ 1284],
     | 70.00th=[ 1418], 80.00th=[ 1552], 90.00th=[ 1737], 95.00th=[ 1905],
     | 99.00th=[ 2702], 99.50th=[ 3071], 99.90th=[ 3507], 99.95th=[ 3675],
     | 99.99th=[ 3809]
   bw (  KiB/s): min=114704, max=3399934, per=98.83%, avg=549124.99, stdev=157581.96, samples=958
   iops        : min=  112, max= 3320, avg=536.21, stdev=153.89, samples=958
  lat (usec)   : 10=0.01%, 20=0.01%
  lat (msec)   : 50=13.76%, 100=19.11%, 250=0.94%, 500=0.39%, 750=3.64%
  lat (msec)   : 1000=8.82%, 2000=51.27%, >=2000=3.62%
  cpu          : usr=0.06%, sys=7.15%, ctx=7340, majf=0, minf=1718
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=32159,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=543MiB/s (569MB/s), 543MiB/s-543MiB/s (569MB/s-569MB/s), io=31.9GiB (34.3GB), run=60214-60214msec
Read IOPS: 
read_iops: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
read_iops: Laying out IO file (1 file / 10240MiB)

read_iops: (groupid=0, jobs=1): err= 0: pid=382814: Sun May 29 11:57:14 2022
  read: IOPS=21.8k, BW=85.3MiB/s (89.4MB/s)(5118MiB/60001msec)
    slat (usec): min=4, max=6217, avg=42.50, stdev=14.97
    clat (usec): min=3, max=21905, avg=2886.35, stdev=260.62
     lat (usec): min=49, max=21964, avg=2929.22, stdev=263.56
    clat percentiles (usec):
     |  1.00th=[ 2573],  5.00th=[ 2638], 10.00th=[ 2671], 20.00th=[ 2737],
     | 30.00th=[ 2769], 40.00th=[ 2802], 50.00th=[ 2835], 60.00th=[ 2900],
     | 70.00th=[ 2933], 80.00th=[ 2999], 90.00th=[ 3097], 95.00th=[ 3228],
     | 99.00th=[ 3720], 99.50th=[ 3982], 99.90th=[ 4948], 99.95th=[ 5407],
     | 99.99th=[ 6980]
   bw (  KiB/s): min=73402, max=91632, per=100.00%, avg=87372.82, stdev=3532.03, samples=120
   iops        : min=18350, max=22908, avg=21843.14, stdev=883.02, samples=120
  lat (usec)   : 4=0.01%, 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%
  lat (usec)   : 1000=0.01%
  lat (msec)   : 2=0.01%, 4=99.52%, 10=0.48%, 20=0.01%, 50=0.01%
  cpu          : usr=7.54%, sys=92.44%, ctx=238, majf=0, minf=71
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=1310162,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=85.3MiB/s (89.4MB/s), 85.3MiB/s-85.3MiB/s (89.4MB/s-89.4MB/s), io=5118MiB (5367MB), run=60001-60001msec
