Write throughput: 
write_throughput: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)

write_throughput: (groupid=0, jobs=8): err= 0: pid=3591227: Sun May 29 05:50:46 2022
  write: IOPS=559, BW=568MiB/s (595MB/s)(33.3GiB/60013msec); 0 zone resets
    slat (msec): min=3, max=255, avg=14.29, stdev= 4.46
    clat (usec): min=7, max=2023.4k, avg=893392.94, stdev=104840.85
     lat (msec): min=3, max=2037, avg=907.63, stdev=105.54
    clat percentiles (msec):
     |  1.00th=[  567],  5.00th=[  793], 10.00th=[  827], 20.00th=[  860],
     | 30.00th=[  877], 40.00th=[  885], 50.00th=[  902], 60.00th=[  911],
     | 70.00th=[  919], 80.00th=[  936], 90.00th=[  961], 95.00th=[  986],
     | 99.00th=[ 1045], 99.50th=[ 1167], 99.90th=[ 1955], 99.95th=[ 1989],
     | 99.99th=[ 2022]
   bw (  KiB/s): min=361992, max=735232, per=98.52%, avg=572705.76, stdev=6509.15, samples=952
   iops        : min=  353, max=  718, avg=559.07, stdev= 6.36, samples=952
  lat (usec)   : 10=0.01%, 20=0.01%, 50=0.01%
  lat (msec)   : 4=0.01%, 10=0.01%, 20=0.03%, 50=0.07%, 100=0.10%
  lat (msec)   : 250=0.25%, 500=0.41%, 750=2.52%, 1000=94.37%, 2000=3.67%
  lat (msec)   : >=2000=0.04%
  cpu          : usr=0.49%, sys=4.33%, ctx=300272, majf=0, minf=8839
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,33555,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=568MiB/s (595MB/s), 568MiB/s-568MiB/s (595MB/s-595MB/s), io=33.3GiB (35.7GB), run=60013-60013msec
Write IOPS: 
write_iops: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
write_iops: Laying out IO file (1 file / 10240MiB)

write_iops: (groupid=0, jobs=1): err= 0: pid=3628238: Sun May 29 05:51:49 2022
  write: IOPS=4508, BW=17.6MiB/s (18.5MB/s)(1057MiB/60001msec); 0 zone resets
    slat (usec): min=7, max=112215, avg=217.23, stdev=288.54
    clat (usec): min=4, max=143771, avg=13972.74, stdev=5416.27
     lat (usec): min=338, max=144210, avg=14190.50, stdev=5494.05
    clat percentiles (msec):
     |  1.00th=[    5],  5.00th=[    6], 10.00th=[    7], 20.00th=[   10],
     | 30.00th=[   12], 40.00th=[   13], 50.00th=[   15], 60.00th=[   16],
     | 70.00th=[   17], 80.00th=[   18], 90.00th=[   20], 95.00th=[   22],
     | 99.00th=[   27], 99.50th=[   30], 99.90th=[   42], 99.95th=[   49],
     | 99.99th=[  136]
   bw (  KiB/s): min= 9928, max=46600, per=100.00%, avg=18096.08, stdev=7000.05, samples=119
   iops        : min= 2482, max=11650, avg=4523.92, stdev=1750.01, samples=119
  lat (usec)   : 10=0.01%, 500=0.01%, 1000=0.01%
  lat (msec)   : 2=0.01%, 4=0.44%, 10=22.75%, 20=67.61%, 50=9.18%
  lat (msec)   : 100=0.01%, 250=0.02%
  cpu          : usr=2.25%, sys=94.44%, ctx=13014, majf=0, minf=409
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,270523,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=17.6MiB/s (18.5MB/s), 17.6MiB/s-17.6MiB/s (18.5MB/s-18.5MB/s), io=1057MiB (1108MB), run=60001-60001msec
Read throughput: 
read_throughput: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)

read_throughput: (groupid=0, jobs=8): err= 0: pid=3734470: Sun May 29 05:55:25 2022
  read: IOPS=591, BW=600MiB/s (630MB/s)(35.2GiB/60011msec)
    slat (usec): min=872, max=48022, avg=13501.53, stdev=6243.43
    clat (usec): min=7, max=1781.6k, avg=846201.37, stdev=189451.57
     lat (msec): min=11, max=1811, avg=859.73, stdev=192.10
    clat percentiles (msec):
     |  1.00th=[  523],  5.00th=[  651], 10.00th=[  693], 20.00th=[  735],
     | 30.00th=[  776], 40.00th=[  802], 50.00th=[  835], 60.00th=[  860],
     | 70.00th=[  885], 80.00th=[  911], 90.00th=[  944], 95.00th=[ 1020],
     | 99.00th=[ 1653], 99.50th=[ 1670], 99.90th=[ 1687], 99.95th=[ 1754],
     | 99.99th=[ 1770]
   bw (  KiB/s): min=427739, max=892867, per=98.69%, avg=606807.38, stdev=11811.30, samples=952
   iops        : min=  417, max=  871, avg=592.36, stdev=11.53, samples=952
  lat (usec)   : 10=0.01%, 20=0.01%
  lat (msec)   : 20=0.03%, 50=0.06%, 100=0.08%, 250=0.23%, 500=0.46%
  lat (msec)   : 750=23.14%, 1000=72.02%, 2000=5.38%
  cpu          : usr=0.12%, sys=17.04%, ctx=35573, majf=0, minf=10192
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=35521,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=600MiB/s (630MB/s), 600MiB/s-600MiB/s (630MB/s-630MB/s), io=35.2GiB (37.8GB), run=60011-60011msec
Read IOPS: 
read_iops: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
read_iops: Laying out IO file (1 file / 10240MiB)

read_iops: (groupid=0, jobs=1): err= 0: pid=3756190: Sun May 29 05:57:06 2022
  read: IOPS=443, BW=1777KiB/s (1819kB/s)(104MiB/60002msec)
    slat (usec): min=5, max=19983, avg=2251.76, stdev=1012.89
    clat (usec): min=5, max=174640, avg=141987.12, stdev=10938.47
     lat (msec): min=2, max=177, avg=144.24, stdev=11.04
    clat percentiles (msec):
     |  1.00th=[  121],  5.00th=[  128], 10.00th=[  130], 20.00th=[  134],
     | 30.00th=[  138], 40.00th=[  140], 50.00th=[  142], 60.00th=[  144],
     | 70.00th=[  146], 80.00th=[  153], 90.00th=[  157], 95.00th=[  161],
     | 99.00th=[  167], 99.50th=[  169], 99.90th=[  171], 99.95th=[  176],
     | 99.99th=[  176]
   bw (  KiB/s): min= 1512, max= 1968, per=99.79%, avg=1773.03, stdev=88.25, samples=120
   iops        : min=  378, max=  492, avg=443.13, stdev=22.04, samples=120
  lat (usec)   : 10=0.01%
  lat (msec)   : 4=0.01%, 10=0.01%, 20=0.02%, 50=0.05%, 100=0.09%
  lat (msec)   : 250=100.06%
  cpu          : usr=0.22%, sys=96.63%, ctx=577, majf=0, minf=66
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=26588,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=1777KiB/s (1819kB/s), 1777KiB/s-1777KiB/s (1819kB/s-1819kB/s), io=104MiB (109MB), run=60002-60002msec
