Write throughput: 
write_throughput: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)

write_throughput: (groupid=0, jobs=8): err= 0: pid=3424220: Sun May 29 05:43:07 2022
  write: IOPS=562, BW=571MiB/s (599MB/s)(33.5GiB/60007msec); 0 zone resets
    slat (msec): min=2, max=212, avg=14.20, stdev= 3.73
    clat (usec): min=7, max=2024.3k, avg=886891.98, stdev=97694.25
     lat (msec): min=3, max=2039, avg=901.02, stdev=98.40
    clat percentiles (msec):
     |  1.00th=[  506],  5.00th=[  793], 10.00th=[  827], 20.00th=[  860],
     | 30.00th=[  877], 40.00th=[  885], 50.00th=[  894], 60.00th=[  902],
     | 70.00th=[  919], 80.00th=[  927], 90.00th=[  944], 95.00th=[  961],
     | 99.00th=[ 1028], 99.50th=[ 1099], 99.90th=[ 1972], 99.95th=[ 1972],
     | 99.99th=[ 2022]
   bw (  KiB/s): min=425984, max=727224, per=98.51%, avg=576268.24, stdev=5765.14, samples=952
   iops        : min=  416, max=  710, avg=562.45, stdev= 5.64, samples=952
  lat (usec)   : 10=0.01%, 20=0.01%, 50=0.01%
  lat (msec)   : 4=0.01%, 10=0.01%, 20=0.03%, 50=0.08%, 100=0.12%
  lat (msec)   : 250=0.25%, 500=0.48%, 750=2.19%, 1000=96.75%, 2000=1.53%
  lat (msec)   : >=2000=0.04%
  cpu          : usr=0.45%, sys=4.32%, ctx=297176, majf=0, minf=4316
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,33770,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=571MiB/s (599MB/s), 571MiB/s-571MiB/s (599MB/s-599MB/s), io=33.5GiB (35.9GB), run=60007-60007msec
Write IOPS: 
write_iops: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
write_iops: Laying out IO file (1 file / 10240MiB)

write_iops: (groupid=0, jobs=1): err= 0: pid=3460966: Sun May 29 05:44:10 2022
  write: IOPS=4475, BW=17.5MiB/s (18.3MB/s)(1049MiB/60001msec); 0 zone resets
    slat (usec): min=8, max=71477, avg=218.73, stdev=276.13
    clat (usec): min=4, max=98139, avg=14076.95, stdev=5495.82
     lat (usec): min=419, max=98398, avg=14296.23, stdev=5573.96
    clat percentiles (usec):
     |  1.00th=[ 4817],  5.00th=[ 5866], 10.00th=[ 6915], 20.00th=[ 9241],
     | 30.00th=[11207], 40.00th=[12780], 50.00th=[14222], 60.00th=[15533],
     | 70.00th=[16909], 80.00th=[17957], 90.00th=[20055], 95.00th=[21890],
     | 99.00th=[27919], 99.50th=[33424], 99.90th=[52167], 99.95th=[60556],
     | 99.99th=[96994]
   bw (  KiB/s): min= 9202, max=42144, per=100.00%, avg=17959.44, stdev=6615.60, samples=119
   iops        : min= 2300, max=10536, avg=4489.80, stdev=1653.86, samples=119
  lat (usec)   : 10=0.01%, 500=0.01%, 1000=0.01%
  lat (msec)   : 2=0.01%, 4=0.09%, 10=23.46%, 20=66.65%, 50=9.70%
  lat (msec)   : 100=0.12%
  cpu          : usr=2.05%, sys=93.65%, ctx=15287, majf=0, minf=250
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,268520,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=17.5MiB/s (18.3MB/s), 17.5MiB/s-17.5MiB/s (18.3MB/s-18.3MB/s), io=1049MiB (1100MB), run=60001-60001msec
Read throughput: 
read_throughput: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)

read_throughput: (groupid=0, jobs=8): err= 0: pid=3563300: Sun May 29 05:47:50 2022
  read: IOPS=598, BW=607MiB/s (637MB/s)(35.6GiB/60011msec)
    slat (usec): min=862, max=51591, avg=13346.38, stdev=6632.78
    clat (usec): min=9, max=1800.7k, avg=836810.59, stdev=198982.69
     lat (msec): min=8, max=1827, avg=850.19, stdev=201.78
    clat percentiles (msec):
     |  1.00th=[  542],  5.00th=[  625], 10.00th=[  667], 20.00th=[  718],
     | 30.00th=[  751], 40.00th=[  793], 50.00th=[  818], 60.00th=[  844],
     | 70.00th=[  869], 80.00th=[  902], 90.00th=[  953], 95.00th=[ 1099],
     | 99.00th=[ 1636], 99.50th=[ 1687], 99.90th=[ 1754], 99.95th=[ 1787],
     | 99.99th=[ 1804]
   bw (  KiB/s): min=425378, max=894976, per=98.81%, avg=614495.01, stdev=12867.51, samples=952
   iops        : min=  414, max=  874, avg=599.85, stdev=12.57, samples=952
  lat (usec)   : 10=0.01%, 20=0.02%
  lat (msec)   : 10=0.01%, 20=0.02%, 50=0.05%, 100=0.06%, 250=0.18%
  lat (msec)   : 500=0.38%, 750=28.56%, 1000=65.92%, 2000=6.21%
  cpu          : usr=0.14%, sys=17.99%, ctx=33642, majf=0, minf=10036
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=35934,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=607MiB/s (637MB/s), 607MiB/s-607MiB/s (637MB/s-637MB/s), io=35.6GiB (38.2GB), run=60011-60011msec
Read IOPS: 
read_iops: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
read_iops: Laying out IO file (1 file / 10240MiB)

read_iops: (groupid=0, jobs=1): err= 0: pid=3584702: Sun May 29 05:49:31 2022
  read: IOPS=439, BW=1760KiB/s (1803kB/s)(103MiB/60002msec)
    slat (usec): min=5, max=18285, avg=2273.03, stdev=1013.21
    clat (usec): min=4, max=179621, avg=143358.25, stdev=10896.30
     lat (msec): min=2, max=182, avg=145.63, stdev=11.00
    clat percentiles (msec):
     |  1.00th=[  120],  5.00th=[  128], 10.00th=[  132], 20.00th=[  136],
     | 30.00th=[  138], 40.00th=[  140], 50.00th=[  142], 60.00th=[  146],
     | 70.00th=[  148], 80.00th=[  153], 90.00th=[  159], 95.00th=[  161],
     | 99.00th=[  169], 99.50th=[  171], 99.90th=[  174], 99.95th=[  176],
     | 99.99th=[  178]
   bw (  KiB/s): min= 1584, max= 1952, per=99.76%, avg=1756.59, stdev=87.83, samples=120
   iops        : min=  396, max=  488, avg=439.02, stdev=21.95, samples=120
  lat (usec)   : 10=0.01%
  lat (msec)   : 4=0.01%, 10=0.02%, 20=0.02%, 50=0.06%, 100=0.09%
  lat (msec)   : 250=100.05%
  cpu          : usr=0.16%, sys=96.39%, ctx=655, majf=0, minf=75
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=26341,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=1760KiB/s (1803kB/s), 1760KiB/s-1760KiB/s (1803kB/s-1803kB/s), io=103MiB (108MB), run=60002-60002msec
