Write throughput: 
write_throughput: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)

write_throughput: (groupid=0, jobs=8): err= 0: pid=3328873: Sun May 29 13:01:26 2022
  write: IOPS=1438, BW=1447MiB/s (1518MB/s)(84.8GiB/60002msec); 0 zone resets
    slat (usec): min=505, max=316679, avg=5543.24, stdev=3435.63
    clat (usec): min=5, max=1233.6k, avg=349093.38, stdev=64315.73
     lat (msec): min=2, max=1237, avg=354.63, stdev=65.02
    clat percentiles (msec):
     |  1.00th=[  148],  5.00th=[  220], 10.00th=[  271], 20.00th=[  334],
     | 30.00th=[  347], 40.00th=[  351], 50.00th=[  355], 60.00th=[  359],
     | 70.00th=[  368], 80.00th=[  380], 90.00th=[  405], 95.00th=[  430],
     | 99.00th=[  493], 99.50th=[  518], 99.90th=[  642], 99.95th=[ 1150],
     | 99.99th=[ 1217]
   bw (  MiB/s): min=  817, max= 2762, per=99.45%, avg=1439.50, stdev=32.48, samples=952
   iops        : min=  816, max= 2761, avg=1439.06, stdev=32.47, samples=952
  lat (usec)   : 10=0.01%
  lat (msec)   : 4=0.01%, 10=0.02%, 20=0.03%, 50=0.07%, 100=0.22%
  lat (msec)   : 250=7.47%, 500=91.90%, 750=0.79%, 1000=0.01%, 2000=0.07%
  cpu          : usr=1.56%, sys=15.01%, ctx=753922, majf=0, minf=12045
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,86336,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=1447MiB/s (1518MB/s), 1447MiB/s-1447MiB/s (1518MB/s-1518MB/s), io=84.8GiB (91.1GB), run=60002-60002msec
Write IOPS: 
write_iops: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
write_iops: Laying out IO file (1 file / 10240MiB)

write_iops: (groupid=0, jobs=1): err= 0: pid=3420774: Sun May 29 13:02:28 2022
  write: IOPS=13.1k, BW=51.4MiB/s (53.8MB/s)(3081MiB/60001msec); 0 zone resets
    slat (usec): min=8, max=100033, avg=70.97, stdev=278.83
    clat (usec): min=4, max=108059, avg=4794.19, stdev=2957.13
     lat (usec): min=81, max=108198, avg=4865.73, stdev=2989.62
    clat percentiles (msec):
     |  1.00th=[    4],  5.00th=[    4], 10.00th=[    4], 20.00th=[    4],
     | 30.00th=[    4], 40.00th=[    5], 50.00th=[    5], 60.00th=[    5],
     | 70.00th=[    5], 80.00th=[    5], 90.00th=[    7], 95.00th=[    9],
     | 99.00th=[   12], 99.50th=[   17], 99.90th=[   39], 99.95th=[   68],
     | 99.99th=[  104]
   bw (  KiB/s): min=42845, max=66506, per=100.00%, avg=52603.39, stdev=4558.33, samples=119
   iops        : min=10711, max=16626, avg=13150.76, stdev=1139.58, samples=119
  lat (usec)   : 10=0.01%, 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%
  lat (usec)   : 1000=0.01%
  lat (msec)   : 2=0.01%, 4=30.41%, 10=67.66%, 20=1.57%, 50=0.29%
  lat (msec)   : 100=0.06%, 250=0.01%
  cpu          : usr=7.31%, sys=88.81%, ctx=4033, majf=0, minf=908
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,788707,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=51.4MiB/s (53.8MB/s), 51.4MiB/s-51.4MiB/s (53.8MB/s-53.8MB/s), io=3081MiB (3231MB), run=60001-60001msec
Read throughput: 
read_throughput: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)

read_throughput: (groupid=0, jobs=8): err= 0: pid=3624846: Sun May 29 13:04:38 2022
  read: IOPS=2019, BW=2028MiB/s (2126MB/s)(119GiB/60004msec)
    slat (usec): min=520, max=615655, avg=3945.68, stdev=2346.45
    clat (usec): min=6, max=863061, avg=249078.84, stdev=36183.17
     lat (msec): min=2, max=867, avg=253.03, stdev=36.64
    clat percentiles (msec):
     |  1.00th=[   87],  5.00th=[  194], 10.00th=[  230], 20.00th=[  249],
     | 30.00th=[  251], 40.00th=[  253], 50.00th=[  255], 60.00th=[  257],
     | 70.00th=[  259], 80.00th=[  262], 90.00th=[  266], 95.00th=[  271],
     | 99.00th=[  296], 99.50th=[  305], 99.90th=[  575], 99.95th=[  835],
     | 99.99th=[  852]
   bw (  MiB/s): min= 1424, max= 3351, per=99.71%, avg=2021.71, stdev=43.91, samples=953
   iops        : min= 1424, max= 3350, avg=2021.03, stdev=43.91, samples=953
  lat (usec)   : 10=0.01%, 20=0.01%, 50=0.01%
  lat (msec)   : 4=0.01%, 10=0.01%, 20=0.01%, 50=0.05%, 100=1.12%
  lat (msec)   : 250=22.82%, 500=76.29%, 750=0.05%, 1000=0.05%
  cpu          : usr=0.47%, sys=43.48%, ctx=115404, majf=0, minf=33643
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=121156,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=2028MiB/s (2126MB/s), 2028MiB/s-2028MiB/s (2126MB/s-2126MB/s), io=119GiB (128GB), run=60004-60004msec
Read IOPS: 
read_iops: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
read_iops: Laying out IO file (1 file / 10240MiB)

read_iops: (groupid=0, jobs=1): err= 0: pid=3853282: Sun May 29 13:06:04 2022
  read: IOPS=21.7k, BW=84.9MiB/s (89.0MB/s)(5095MiB/60001msec)
    slat (usec): min=4, max=7624, avg=42.60, stdev=14.14
    clat (usec): min=3, max=19126, avg=2899.39, stdev=258.78
     lat (usec): min=50, max=19215, avg=2942.34, stdev=262.06
    clat percentiles (usec):
     |  1.00th=[ 2573],  5.00th=[ 2671], 10.00th=[ 2704], 20.00th=[ 2769],
     | 30.00th=[ 2802], 40.00th=[ 2835], 50.00th=[ 2868], 60.00th=[ 2900],
     | 70.00th=[ 2933], 80.00th=[ 2999], 90.00th=[ 3097], 95.00th=[ 3195],
     | 99.00th=[ 3687], 99.50th=[ 4047], 99.90th=[ 4883], 99.95th=[ 6128],
     | 99.99th=[10552]
   bw (  KiB/s): min=70100, max=92304, per=100.00%, avg=86967.35, stdev=3108.88, samples=119
   iops        : min=17525, max=23076, avg=21741.78, stdev=777.20, samples=119
  lat (usec)   : 4=0.01%, 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%
  lat (usec)   : 1000=0.01%
  lat (msec)   : 2=0.01%, 4=99.46%, 10=0.52%, 20=0.02%
  cpu          : usr=8.15%, sys=91.76%, ctx=286, majf=0, minf=68
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=1304255,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=84.9MiB/s (89.0MB/s), 84.9MiB/s-84.9MiB/s (89.0MB/s-89.0MB/s), io=5095MiB (5342MB), run=60001-60001msec
