Write throughput: 
write_throughput: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)

write_throughput: (groupid=0, jobs=8): err= 0: pid=2826609: Sun May 29 12:55:34 2022
  write: IOPS=1746, BW=1755MiB/s (1840MB/s)(103GiB/60016msec); 0 zone resets
    slat (usec): min=505, max=575209, avg=4557.59, stdev=7099.91
    clat (usec): min=10, max=1300.8k, avg=287968.60, stdev=108449.13
     lat (usec): min=1697, max=1303.2k, avg=292527.87, stdev=109473.00
    clat percentiles (msec):
     |  1.00th=[   89],  5.00th=[  142], 10.00th=[  174], 20.00th=[  207],
     | 30.00th=[  239], 40.00th=[  264], 50.00th=[  288], 60.00th=[  309],
     | 70.00th=[  330], 80.00th=[  347], 90.00th=[  384], 95.00th=[  439],
     | 99.00th=[  617], 99.50th=[  676], 99.90th=[ 1267], 99.95th=[ 1267],
     | 99.99th=[ 1284]
   bw (  MiB/s): min=  408, max= 3623, per=99.68%, avg=1749.02, stdev=65.75, samples=952
   iops        : min=  405, max= 3622, avg=1747.90, stdev=65.74, samples=952
  lat (usec)   : 20=0.01%
  lat (msec)   : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%, 50=0.02%
  lat (msec)   : 100=1.59%, 250=33.59%, 500=62.49%, 750=2.40%, 1000=0.02%
  lat (msec)   : 2000=0.35%
  cpu          : usr=2.24%, sys=20.64%, ctx=818108, majf=0, minf=19003
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,104799,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=1755MiB/s (1840MB/s), 1755MiB/s-1755MiB/s (1840MB/s-1840MB/s), io=103GiB (110GB), run=60016-60016msec
Write IOPS: 
write_iops: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
write_iops: Laying out IO file (1 file / 10240MiB)

write_iops: (groupid=0, jobs=1): err= 0: pid=2889474: Sun May 29 12:56:37 2022
  write: IOPS=13.1k, BW=51.1MiB/s (53.6MB/s)(3065MiB/60001msec); 0 zone resets
    slat (usec): min=8, max=57816, avg=71.30, stdev=204.22
    clat (usec): min=4, max=116737, avg=4819.77, stdev=2621.62
     lat (usec): min=78, max=116858, avg=4891.69, stdev=2652.26
    clat percentiles (usec):
     |  1.00th=[ 3261],  5.00th=[ 3556], 10.00th=[ 3752], 20.00th=[ 3949],
     | 30.00th=[ 4080], 40.00th=[ 4178], 50.00th=[ 4228], 60.00th=[ 4359],
     | 70.00th=[ 4424], 80.00th=[ 4555], 90.00th=[ 7046], 95.00th=[ 8979],
     | 99.00th=[12518], 99.50th=[17433], 99.90th=[35914], 99.95th=[51119],
     | 99.99th=[64750]
   bw (  KiB/s): min=44048, max=66388, per=100.00%, avg=52417.09, stdev=3877.83, samples=119
   iops        : min=11012, max=16597, avg=13104.21, stdev=969.46, samples=119
  lat (usec)   : 10=0.01%, 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%
  lat (usec)   : 1000=0.01%
  lat (msec)   : 2=0.01%, 4=23.44%, 10=74.67%, 20=1.52%, 50=0.32%
  lat (msec)   : 100=0.05%, 250=0.01%
  cpu          : usr=7.02%, sys=89.30%, ctx=4365, majf=0, minf=1884
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,784522,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=51.1MiB/s (53.6MB/s), 51.1MiB/s-51.1MiB/s (53.6MB/s-53.6MB/s), io=3065MiB (3214MB), run=60001-60001msec
Read throughput: 
read_throughput: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)

read_throughput: (groupid=0, jobs=8): err= 0: pid=3097832: Sun May 29 12:58:52 2022
  read: IOPS=2042, BW=2051MiB/s (2151MB/s)(120GiB/60006msec)
    slat (usec): min=506, max=336299, avg=3900.62, stdev=1659.30
    clat (usec): min=6, max=596915, avg=246213.13, stdev=48596.74
     lat (msec): min=3, max=600, avg=250.12, stdev=49.31
    clat percentiles (msec):
     |  1.00th=[   48],  5.00th=[  146], 10.00th=[  209], 20.00th=[  251],
     | 30.00th=[  253], 40.00th=[  255], 50.00th=[  257], 60.00th=[  259],
     | 70.00th=[  262], 80.00th=[  264], 90.00th=[  271], 95.00th=[  279],
     | 99.00th=[  317], 99.50th=[  321], 99.90th=[  468], 99.95th=[  592],
     | 99.99th=[  592]
   bw (  MiB/s): min= 1500, max= 3714, per=99.67%, avg=2044.42, stdev=89.55, samples=957
   iops        : min= 1500, max= 3714, avg=2043.63, stdev=89.56, samples=957
  lat (usec)   : 10=0.01%, 20=0.01%
  lat (msec)   : 4=0.01%, 10=0.01%, 20=0.01%, 50=2.24%, 100=2.12%
  lat (msec)   : 250=15.91%, 500=80.05%, 750=0.05%
  cpu          : usr=0.46%, sys=43.71%, ctx=107956, majf=0, minf=45774
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=122567,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=2051MiB/s (2151MB/s), 2051MiB/s-2051MiB/s (2151MB/s-2151MB/s), io=120GiB (129GB), run=60006-60006msec
Read IOPS: 
read_iops: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
read_iops: Laying out IO file (1 file / 10240MiB)

read_iops: (groupid=0, jobs=1): err= 0: pid=3322089: Sun May 29 13:00:18 2022
  read: IOPS=21.6k, BW=84.3MiB/s (88.4MB/s)(5056MiB/60001msec)
    slat (usec): min=4, max=9071, avg=42.89, stdev=45.15
    clat (usec): min=3, max=21723, avg=2922.04, stdev=503.35
     lat (usec): min=47, max=21874, avg=2965.31, stdev=508.96
    clat percentiles (usec):
     |  1.00th=[ 2507],  5.00th=[ 2606], 10.00th=[ 2638], 20.00th=[ 2704],
     | 30.00th=[ 2737], 40.00th=[ 2769], 50.00th=[ 2835], 60.00th=[ 2868],
     | 70.00th=[ 2933], 80.00th=[ 2999], 90.00th=[ 3163], 95.00th=[ 3654],
     | 99.00th=[ 4621], 99.50th=[ 5407], 99.90th=[ 7570], 99.95th=[10683],
     | 99.99th=[15795]
   bw (  KiB/s): min=49176, max=93280, per=100.00%, avg=86310.56, stdev=7098.11, samples=120
   iops        : min=12294, max=23320, avg=21577.61, stdev=1774.54, samples=120
  lat (usec)   : 4=0.01%, 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%
  lat (usec)   : 1000=0.01%
  lat (msec)   : 2=0.01%, 4=97.46%, 10=2.48%, 20=0.05%, 50=0.01%
  cpu          : usr=7.75%, sys=89.77%, ctx=2221, majf=0, minf=70
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=1294172,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=84.3MiB/s (88.4MB/s), 84.3MiB/s-84.3MiB/s (88.4MB/s-88.4MB/s), io=5056MiB (5301MB), run=60001-60001msec
