Write throughput: 
write_throughput: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)

write_throughput: (groupid=0, jobs=8): err= 0: pid=845972: Sun May 29 00:01:00 2022
  write: IOPS=258, BW=267MiB/s (280MB/s)(15.7GiB/60022msec); 0 zone resets
    slat (msec): min=4, max=166, avg=30.91, stdev=11.86
    clat (usec): min=9, max=3916.4k, avg=1898977.73, stdev=647395.45
     lat (msec): min=11, max=3968, avg=1929.25, stdev=655.81
    clat percentiles (msec):
     |  1.00th=[  472],  5.00th=[ 1200], 10.00th=[ 1351], 20.00th=[ 1418],
     | 30.00th=[ 1485], 40.00th=[ 1569], 50.00th=[ 1770], 60.00th=[ 1955],
     | 70.00th=[ 2106], 80.00th=[ 2333], 90.00th=[ 2735], 95.00th=[ 3406],
     | 99.00th=[ 3809], 99.50th=[ 3876], 99.90th=[ 3910], 99.95th=[ 3910],
     | 99.99th=[ 3910]
   bw (  KiB/s): min=81940, max=452718, per=96.74%, avg=264622.19, stdev=10178.24, samples=952
   iops        : min=   80, max=  442, avg=257.93, stdev= 9.92, samples=952
  lat (usec)   : 10=0.03%, 20=0.03%
  lat (msec)   : 20=0.02%, 50=0.06%, 100=0.10%, 250=0.30%, 500=0.55%
  lat (msec)   : 750=1.06%, 1000=1.65%, 2000=61.16%, >=2000=38.29%
  cpu          : usr=0.23%, sys=2.14%, ctx=132364, majf=0, minf=1857
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,15522,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=267MiB/s (280MB/s), 267MiB/s-267MiB/s (280MB/s-280MB/s), io=15.7GiB (16.8GB), run=60022-60022msec
Write IOPS: 
write_iops: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
write_iops: Laying out IO file (1 file / 10240MiB)

write_iops: (groupid=0, jobs=1): err= 0: pid=886702: Sun May 29 00:02:03 2022
  write: IOPS=3958, BW=15.5MiB/s (16.2MB/s)(928MiB/60001msec); 0 zone resets
    slat (usec): min=8, max=41445, avg=247.63, stdev=263.92
    clat (usec): min=4, max=112741, avg=15918.21, stdev=8102.06
     lat (usec): min=340, max=112995, avg=16166.49, stdev=8225.83
    clat percentiles (msec):
     |  1.00th=[    5],  5.00th=[    6], 10.00th=[    7], 20.00th=[   11],
     | 30.00th=[   13], 40.00th=[   14], 50.00th=[   16], 60.00th=[   17],
     | 70.00th=[   18], 80.00th=[   20], 90.00th=[   24], 95.00th=[   32],
     | 99.00th=[   46], 99.50th=[   54], 99.90th=[   68], 99.95th=[   77],
     | 99.99th=[  103]
   bw (  KiB/s): min= 4984, max=44184, per=100.00%, avg=15871.63, stdev=7504.36, samples=119
   iops        : min= 1246, max=11046, avg=3967.87, stdev=1876.12, samples=119
  lat (usec)   : 10=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
  lat (msec)   : 2=0.01%, 4=0.14%, 10=18.93%, 20=62.17%, 50=18.17%
  lat (msec)   : 100=0.61%, 250=0.02%
  cpu          : usr=2.15%, sys=77.14%, ctx=36475, majf=0, minf=570
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,237486,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=15.5MiB/s (16.2MB/s), 15.5MiB/s-15.5MiB/s (16.2MB/s-16.2MB/s), io=928MiB (973MB), run=60001-60001msec
Read throughput: 
read_throughput: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)

read_throughput: (groupid=0, jobs=8): err= 0: pid=1355810: Sun May 29 00:08:30 2022
  read: IOPS=364, BW=373MiB/s (391MB/s)(21.9GiB/60076msec)
    slat (usec): min=446, max=620929, avg=21937.01, stdev=45158.08
    clat (usec): min=6, max=4752.0k, avg=1366695.49, stdev=381228.82
     lat (usec): min=1153, max=4781.6k, avg=1388670.12, stdev=385709.03
    clat percentiles (msec):
     |  1.00th=[  527],  5.00th=[  869], 10.00th=[  978], 20.00th=[ 1099],
     | 30.00th=[ 1183], 40.00th=[ 1267], 50.00th=[ 1368], 60.00th=[ 1418],
     | 70.00th=[ 1469], 80.00th=[ 1586], 90.00th=[ 1787], 95.00th=[ 1989],
     | 99.00th=[ 2467], 99.50th=[ 3205], 99.90th=[ 3977], 99.95th=[ 4178],
     | 99.99th=[ 4597]
   bw (  KiB/s): min=94208, max=677374, per=97.88%, avg=373900.78, stdev=14985.73, samples=952
   iops        : min=   92, max=  661, avg=364.92, stdev=14.64, samples=952
  lat (usec)   : 10=0.01%, 20=0.02%
  lat (msec)   : 2=0.01%, 10=0.01%, 20=0.01%, 50=0.07%, 100=0.11%
  lat (msec)   : 250=0.33%, 500=0.39%, 750=0.97%, 1000=10.38%, 2000=85.20%
  lat (msec)   : >=2000=4.80%
  cpu          : usr=0.06%, sys=22.03%, ctx=7710, majf=0, minf=2223
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=21899,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=373MiB/s (391MB/s), 373MiB/s-373MiB/s (391MB/s-391MB/s), io=21.9GiB (23.5GB), run=60076-60076msec
Read IOPS: 
read_iops: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
read_iops: Laying out IO file (1 file / 10240MiB)

read_iops: (groupid=0, jobs=1): err= 0: pid=1477768: Sun May 29 00:10:42 2022
  read: IOPS=413, BW=1659KiB/s (1699kB/s)(97.2MiB/60002msec)
    slat (usec): min=6, max=129516, avg=2412.16, stdev=2344.40
    clat (usec): min=4, max=369064, avg=152078.15, stdev=22626.05
     lat (msec): min=2, max=371, avg=154.49, stdev=22.83
    clat percentiles (msec):
     |  1.00th=[  123],  5.00th=[  130], 10.00th=[  134], 20.00th=[  138],
     | 30.00th=[  142], 40.00th=[  144], 50.00th=[  148], 60.00th=[  153],
     | 70.00th=[  157], 80.00th=[  163], 90.00th=[  174], 95.00th=[  188],
     | 99.00th=[  239], 99.50th=[  288], 99.90th=[  359], 99.95th=[  363],
     | 99.99th=[  368]
   bw (  KiB/s): min= 1096, max= 1960, per=99.75%, avg=1655.37, stdev=149.84, samples=120
   iops        : min=  274, max=  490, avg=413.73, stdev=37.46, samples=120
  lat (usec)   : 10=0.01%
  lat (msec)   : 4=0.01%, 10=0.01%, 20=0.02%, 50=0.07%, 100=0.09%
  lat (msec)   : 250=99.20%, 500=0.85%
  cpu          : usr=0.18%, sys=91.94%, ctx=495, majf=0, minf=237
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=24824,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=1659KiB/s (1699kB/s), 1659KiB/s-1659KiB/s (1699kB/s-1699kB/s), io=97.2MiB (102MB), run=60002-60002msec
