Write throughput: 
write_throughput: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)

write_throughput: (groupid=0, jobs=8): err= 0: pid=1504361: Sun May 29 00:14:50 2022
  write: IOPS=564, BW=573MiB/s (601MB/s)(33.6GiB/60008msec); 0 zone resets
    slat (usec): min=3001, max=82257, avg=14161.88, stdev=2211.48
    clat (usec): min=7, max=999314, avg=885325.34, stdev=73935.80
     lat (msec): min=4, max=1015, avg=899.44, stdev=74.25
    clat percentiles (msec):
     |  1.00th=[  575],  5.00th=[  818], 10.00th=[  844], 20.00th=[  869],
     | 30.00th=[  877], 40.00th=[  885], 50.00th=[  894], 60.00th=[  902],
     | 70.00th=[  911], 80.00th=[  919], 90.00th=[  927], 95.00th=[  944],
     | 99.00th=[  961], 99.50th=[  969], 99.90th=[  995], 99.95th=[  995],
     | 99.99th=[ 1003]
   bw (  KiB/s): min=507904, max=655675, per=98.53%, avg=577976.34, stdev=3225.96, samples=952
   iops        : min=  496, max=  640, avg=564.25, stdev= 3.13, samples=952
  lat (usec)   : 10=0.02%, 20=0.01%
  lat (msec)   : 10=0.01%, 20=0.03%, 50=0.06%, 100=0.10%, 250=0.25%
  lat (msec)   : 500=0.43%, 750=0.86%, 1000=99.73%
  cpu          : usr=0.48%, sys=4.28%, ctx=284591, majf=0, minf=8090
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,33864,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=573MiB/s (601MB/s), 573MiB/s-573MiB/s (601MB/s-601MB/s), io=33.6GiB (36.0GB), run=60008-60008msec
Write IOPS: 
write_iops: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
write_iops: Laying out IO file (1 file / 10240MiB)

write_iops: (groupid=0, jobs=1): err= 0: pid=1510983: Sun May 29 00:15:52 2022
  write: IOPS=4474, BW=17.5MiB/s (18.3MB/s)(1049MiB/60001msec); 0 zone resets
    slat (usec): min=8, max=60474, avg=218.83, stdev=231.26
    clat (usec): min=4, max=97035, avg=14080.24, stdev=5316.86
     lat (usec): min=340, max=97132, avg=14299.63, stdev=5395.26
    clat percentiles (usec):
     |  1.00th=[ 4490],  5.00th=[ 6194], 10.00th=[ 7242], 20.00th=[ 9110],
     | 30.00th=[11207], 40.00th=[12649], 50.00th=[14222], 60.00th=[15533],
     | 70.00th=[16712], 80.00th=[18220], 90.00th=[20055], 95.00th=[22152],
     | 99.00th=[27657], 99.50th=[30278], 99.90th=[41681], 99.95th=[52691],
     | 99.99th=[93848]
   bw (  KiB/s): min=10024, max=44352, per=100.00%, avg=17964.38, stdev=6787.02, samples=119
   iops        : min= 2506, max=11088, avg=4491.07, stdev=1696.73, samples=119
  lat (usec)   : 10=0.01%, 500=0.01%, 750=0.01%
  lat (msec)   : 2=0.01%, 4=0.48%, 10=23.91%, 20=65.07%, 50=10.49%
  lat (msec)   : 100=0.07%
  cpu          : usr=2.31%, sys=94.51%, ctx=12109, majf=0, minf=568
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,268456,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=17.5MiB/s (18.3MB/s), 17.5MiB/s-17.5MiB/s (18.3MB/s-18.3MB/s), io=1049MiB (1100MB), run=60001-60001msec
Read throughput: 
read_throughput: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)

read_throughput: (groupid=0, jobs=8): err= 0: pid=1550306: Sun May 29 00:19:23 2022
  read: IOPS=594, BW=603MiB/s (632MB/s)(35.3GiB/60015msec)
    slat (usec): min=533, max=63088, avg=13442.12, stdev=5213.48
    clat (usec): min=7, max=1819.3k, avg=842644.69, stdev=175226.31
     lat (msec): min=6, max=1848, avg=856.12, stdev=177.70
    clat percentiles (msec):
     |  1.00th=[  600],  5.00th=[  676], 10.00th=[  709], 20.00th=[  751],
     | 30.00th=[  776], 40.00th=[  810], 50.00th=[  835], 60.00th=[  852],
     | 70.00th=[  869], 80.00th=[  894], 90.00th=[  927], 95.00th=[  969],
     | 99.00th=[ 1636], 99.50th=[ 1653], 99.90th=[ 1770], 99.95th=[ 1787],
     | 99.99th=[ 1804]
   bw (  KiB/s): min=436035, max=796881, per=98.67%, avg=609267.76, stdev=10456.81, samples=952
   iops        : min=  424, max=  778, avg=594.91, stdev=10.21, samples=952
  lat (usec)   : 10=0.01%, 20=0.01%
  lat (msec)   : 10=0.01%, 20=0.02%, 50=0.06%, 100=0.09%, 250=0.24%
  lat (msec)   : 500=0.41%, 750=20.23%, 1000=76.04%, 2000=4.31%
  cpu          : usr=0.12%, sys=15.76%, ctx=36948, majf=0, minf=2611
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=35676,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=603MiB/s (632MB/s), 603MiB/s-603MiB/s (632MB/s-632MB/s), io=35.3GiB (37.9GB), run=60015-60015msec
Read IOPS: 
read_iops: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
read_iops: Laying out IO file (1 file / 10240MiB)

read_iops: (groupid=0, jobs=1): err= 0: pid=1561338: Sun May 29 00:21:03 2022
  read: IOPS=427, BW=1716KiB/s (1757kB/s)(101MiB/60001msec)
    slat (usec): min=6, max=21839, avg=2332.44, stdev=1009.23
    clat (usec): min=8, max=187624, avg=147070.52, stdev=10644.06
     lat (msec): min=3, max=190, avg=149.40, stdev=10.74
    clat percentiles (msec):
     |  1.00th=[  126],  5.00th=[  132], 10.00th=[  136], 20.00th=[  140],
     | 30.00th=[  142], 40.00th=[  144], 50.00th=[  146], 60.00th=[  150],
     | 70.00th=[  153], 80.00th=[  157], 90.00th=[  161], 95.00th=[  163],
     | 99.00th=[  169], 99.50th=[  171], 99.90th=[  178], 99.95th=[  180],
     | 99.99th=[  184]
   bw (  KiB/s): min= 1552, max= 1912, per=99.74%, avg=1711.74, stdev=82.18, samples=120
   iops        : min=  388, max=  478, avg=427.82, stdev=20.53, samples=120
  lat (usec)   : 10=0.01%
  lat (msec)   : 4=0.01%, 10=0.01%, 20=0.01%, 50=0.06%, 100=0.09%
  lat (msec)   : 250=100.07%
  cpu          : usr=0.26%, sys=95.22%, ctx=816, majf=0, minf=236
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=25669,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=1716KiB/s (1757kB/s), 1716KiB/s-1716KiB/s (1757kB/s-1757kB/s), io=101MiB (105MB), run=60001-60001msec
