Write throughput: 
write_throughput: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)

write_throughput: (groupid=0, jobs=8): err= 0: pid=3885102: Sun May 29 13:11:40 2022
  write: IOPS=1757, BW=1766MiB/s (1851MB/s)(103GiB/60005msec); 0 zone resets
    slat (usec): min=487, max=582170, avg=4528.08, stdev=7141.60
    clat (usec): min=5, max=1294.0k, avg=286055.41, stdev=114975.53
     lat (msec): min=2, max=1299, avg=290.59, stdev=116.22
    clat percentiles (msec):
     |  1.00th=[   72],  5.00th=[  122], 10.00th=[  159], 20.00th=[  197],
     | 30.00th=[  224], 40.00th=[  249], 50.00th=[  275], 60.00th=[  305],
     | 70.00th=[  342], 80.00th=[  368], 90.00th=[  414], 95.00th=[  464],
     | 99.00th=[  625], 99.50th=[  760], 99.90th=[ 1217], 99.95th=[ 1267],
     | 99.99th=[ 1284]
   bw (  MiB/s): min=  365, max= 4157, per=99.59%, avg=1758.41, stdev=74.36, samples=952
   iops        : min=  365, max= 4156, avg=1757.25, stdev=74.34, samples=952
  lat (usec)   : 10=0.01%, 20=0.01%
  lat (msec)   : 4=0.01%, 10=0.01%, 20=0.02%, 50=0.04%, 100=2.94%
  lat (msec)   : 250=37.57%, 500=56.70%, 750=2.65%, 1000=0.38%, 2000=0.15%
  cpu          : usr=2.17%, sys=20.82%, ctx=785211, majf=0, minf=24630
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,105435,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=1766MiB/s (1851MB/s), 1766MiB/s-1766MiB/s (1851MB/s-1851MB/s), io=103GiB (111GB), run=60005-60005msec
Write IOPS: 
write_iops: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
write_iops: Laying out IO file (1 file / 10240MiB)

write_iops: (groupid=0, jobs=1): err= 0: pid=3942412: Sun May 29 13:12:42 2022
  write: IOPS=13.1k, BW=51.4MiB/s (53.9MB/s)(3082MiB/60001msec); 0 zone resets
    slat (usec): min=8, max=79804, avg=70.80, stdev=220.49
    clat (usec): min=4, max=118671, avg=4792.99, stdev=2716.14
     lat (usec): min=75, max=118802, avg=4864.41, stdev=2746.84
    clat percentiles (usec):
     |  1.00th=[ 3163],  5.00th=[ 3523], 10.00th=[ 3720], 20.00th=[ 3916],
     | 30.00th=[ 4047], 40.00th=[ 4146], 50.00th=[ 4228], 60.00th=[ 4359],
     | 70.00th=[ 4424], 80.00th=[ 4555], 90.00th=[ 7177], 95.00th=[ 8848],
     | 99.00th=[11600], 99.50th=[14746], 99.90th=[36439], 99.95th=[53216],
     | 99.99th=[87557]
   bw (  KiB/s): min=40936, max=71478, per=100.00%, avg=52672.38, stdev=4578.42, samples=119
   iops        : min=10234, max=17869, avg=13168.03, stdev=1144.60, samples=119
  lat (usec)   : 10=0.01%, 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%
  lat (usec)   : 1000=0.01%
  lat (msec)   : 2=0.01%, 4=25.97%, 10=72.29%, 20=1.45%, 50=0.23%
  lat (msec)   : 100=0.05%, 250=0.01%
  cpu          : usr=6.95%, sys=89.70%, ctx=4749, majf=0, minf=908
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,788918,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=51.4MiB/s (53.9MB/s), 51.4MiB/s-51.4MiB/s (53.9MB/s-53.9MB/s), io=3082MiB (3232MB), run=60001-60001msec
Read throughput: 
read_throughput: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)

read_throughput: (groupid=0, jobs=8): err= 0: pid=4150604: Sun May 29 13:14:59 2022
  read: IOPS=2105, BW=2114MiB/s (2217MB/s)(124GiB/60030msec)
    slat (usec): min=493, max=95256, avg=3781.59, stdev=1241.32
    clat (usec): min=8, max=391418, avg=238662.03, stdev=51816.05
     lat (msec): min=2, max=396, avg=242.44, stdev=52.60
    clat percentiles (msec):
     |  1.00th=[   46],  5.00th=[   85], 10.00th=[  192], 20.00th=[  241],
     | 30.00th=[  251], 40.00th=[  253], 50.00th=[  255], 60.00th=[  257],
     | 70.00th=[  259], 80.00th=[  262], 90.00th=[  266], 95.00th=[  271],
     | 99.00th=[  292], 99.50th=[  305], 99.90th=[  334], 99.95th=[  351],
     | 99.99th=[  384]
   bw (  MiB/s): min= 1668, max= 4316, per=99.76%, avg=2109.28, stdev=98.20, samples=952
   iops        : min= 1668, max= 4315, avg=2108.34, stdev=98.20, samples=952
  lat (usec)   : 10=0.01%, 20=0.01%, 50=0.01%
  lat (msec)   : 4=0.01%, 10=0.01%, 20=0.02%, 50=2.44%, 100=3.49%
  lat (msec)   : 250=22.94%, 500=71.50%
  cpu          : usr=0.50%, sys=42.47%, ctx=113883, majf=0, minf=48975
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=126417,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=2114MiB/s (2217MB/s), 2114MiB/s-2114MiB/s (2217MB/s-2217MB/s), io=124GiB (133GB), run=60030-60030msec
Read IOPS: 
read_iops: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
read_iops: Laying out IO file (1 file / 10240MiB)

read_iops: (groupid=0, jobs=1): err= 0: pid=185509: Sun May 29 13:16:25 2022
  read: IOPS=20.0k, BW=78.3MiB/s (82.1MB/s)(4696MiB/60001msec)
    slat (usec): min=4, max=5808, avg=46.51, stdev=38.23
    clat (usec): min=3, max=17752, avg=3145.74, stdev=418.88
     lat (usec): min=53, max=17822, avg=3192.60, stdev=423.37
    clat percentiles (usec):
     |  1.00th=[ 2671],  5.00th=[ 2769], 10.00th=[ 2835], 20.00th=[ 2933],
     | 30.00th=[ 2999], 40.00th=[ 3032], 50.00th=[ 3097], 60.00th=[ 3163],
     | 70.00th=[ 3228], 80.00th=[ 3294], 90.00th=[ 3425], 95.00th=[ 3556],
     | 99.00th=[ 4228], 99.50th=[ 4752], 99.90th=[ 7767], 99.95th=[ 8291],
     | 99.99th=[12911]
   bw (  KiB/s): min=65776, max=88816, per=100.00%, avg=80169.93, stdev=4613.40, samples=120
   iops        : min=16444, max=22204, avg=20042.43, stdev=1153.36, samples=120
  lat (usec)   : 4=0.01%, 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%
  lat (usec)   : 1000=0.01%
  lat (msec)   : 2=0.01%, 4=97.93%, 10=2.04%, 20=0.03%
  cpu          : usr=7.43%, sys=91.60%, ctx=739, majf=0, minf=237
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=1202097,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=78.3MiB/s (82.1MB/s), 78.3MiB/s-78.3MiB/s (82.1MB/s-82.1MB/s), io=4696MiB (4924MB), run=60001-60001msec
