Write throughput: 
write_throughput: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)

write_throughput: (groupid=0, jobs=8): err= 0: pid=3146485: Sun May 29 11:35:19 2022
  write: IOPS=362, BW=371MiB/s (389MB/s)(21.8GiB/60018msec); 0 zone resets
    slat (msec): min=6, max=171, avg=22.05, stdev= 4.54
    clat (usec): min=7, max=2303.4k, avg=1368021.37, stdev=208853.85
     lat (msec): min=12, max=2332, avg=1389.84, stdev=210.65
    clat percentiles (msec):
     |  1.00th=[  617],  5.00th=[ 1200], 10.00th=[ 1234], 20.00th=[ 1267],
     | 30.00th=[ 1301], 40.00th=[ 1334], 50.00th=[ 1351], 60.00th=[ 1385],
     | 70.00th=[ 1401], 80.00th=[ 1452], 90.00th=[ 1536], 95.00th=[ 1670],
     | 99.00th=[ 2198], 99.50th=[ 2265], 99.90th=[ 2299], 99.95th=[ 2299],
     | 99.99th=[ 2299]
   bw (  KiB/s): min=196608, max=464896, per=97.84%, avg=371796.29, stdev=6206.73, samples=952
   iops        : min=  192, max=  454, avg=362.91, stdev= 6.07, samples=952
  lat (usec)   : 10=0.02%, 20=0.01%, 50=0.01%
  lat (msec)   : 20=0.02%, 50=0.04%, 100=0.07%, 250=0.22%, 500=0.44%
  lat (msec)   : 750=0.44%, 1000=1.20%, 2000=97.70%, >=2000=2.14%
  cpu          : usr=0.34%, sys=3.22%, ctx=178613, majf=0, minf=5184
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,21761,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=371MiB/s (389MB/s), 371MiB/s-371MiB/s (389MB/s-389MB/s), io=21.8GiB (23.4GB), run=60018-60018msec
Write IOPS: 
write_iops: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
write_iops: Laying out IO file (1 file / 10240MiB)

write_iops: (groupid=0, jobs=1): err= 0: pid=3264017: Sun May 29 11:36:22 2022
  write: IOPS=8511, BW=33.2MiB/s (34.9MB/s)(1995MiB/60001msec); 0 zone resets
    slat (usec): min=9, max=42318, avg=111.70, stdev=225.35
    clat (usec): min=4, max=73527, avg=7404.63, stdev=4911.21
     lat (usec): min=79, max=73787, avg=7517.04, stdev=4982.44
    clat percentiles (usec):
     |  1.00th=[ 3130],  5.00th=[ 3425], 10.00th=[ 3621], 20.00th=[ 3982],
     | 30.00th=[ 4490], 40.00th=[ 5211], 50.00th=[ 5932], 60.00th=[ 6587],
     | 70.00th=[ 7439], 80.00th=[ 9634], 90.00th=[14222], 95.00th=[17433],
     | 99.00th=[23200], 99.50th=[26870], 99.90th=[50594], 99.95th=[57934],
     | 99.99th=[68682]
   bw (  KiB/s): min=11174, max=66776, per=100.00%, avg=34075.10, stdev=14581.53, samples=119
   iops        : min= 2793, max=16694, avg=8518.73, stdev=3645.36, samples=119
  lat (usec)   : 10=0.01%, 100=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
  lat (msec)   : 2=0.01%, 4=20.83%, 10=59.98%, 20=16.92%, 50=2.17%
  lat (msec)   : 100=0.11%
  cpu          : usr=5.63%, sys=56.79%, ctx=137260, majf=0, minf=565
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,510677,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=33.2MiB/s (34.9MB/s), 33.2MiB/s-33.2MiB/s (34.9MB/s-34.9MB/s), io=1995MiB (2092MB), run=60001-60001msec
Read throughput: 
read_throughput: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)

read_throughput: (groupid=0, jobs=8): err= 0: pid=3606006: Sun May 29 11:43:17 2022
  read: IOPS=574, BW=583MiB/s (611MB/s)(34.2GiB/60155msec)
    slat (usec): min=431, max=758049, avg=13913.88, stdev=45407.45
    clat (usec): min=7, max=3295.4k, avg=872209.54, stdev=708467.45
     lat (msec): min=4, max=3341, avg=886.18, stdev=718.87
    clat percentiles (msec):
     |  1.00th=[   34],  5.00th=[   36], 10.00th=[   39], 20.00th=[   46],
     | 30.00th=[   59], 40.00th=[  743], 50.00th=[  986], 60.00th=[ 1133],
     | 70.00th=[ 1301], 80.00th=[ 1502], 90.00th=[ 1787], 95.00th=[ 2022],
     | 99.00th=[ 2467], 99.50th=[ 2567], 99.90th=[ 2903], 99.95th=[ 3037],
     | 99.99th=[ 3306]
   bw (  KiB/s): min=53248, max=4122624, per=98.95%, avg=590244.22, stdev=179448.35, samples=955
   iops        : min=   52, max= 4026, avg=576.36, stdev=175.24, samples=955
  lat (usec)   : 10=0.01%, 20=0.01%
  lat (msec)   : 10=0.01%, 50=24.19%, 100=11.37%, 250=0.27%, 500=0.88%
  lat (msec)   : 750=4.04%, 1000=10.86%, 2000=44.37%, >=2000=5.42%
  cpu          : usr=0.07%, sys=7.13%, ctx=6967, majf=0, minf=8396
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.1%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=34543,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=583MiB/s (611MB/s), 583MiB/s-583MiB/s (611MB/s-611MB/s), io=34.2GiB (36.7GB), run=60155-60155msec
Read IOPS: 
read_iops: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
read_iops: Laying out IO file (1 file / 10240MiB)

read_iops: (groupid=0, jobs=1): err= 0: pid=3804463: Sun May 29 11:45:02 2022
  read: IOPS=21.6k, BW=84.5MiB/s (88.6MB/s)(5073MiB/60001msec)
    slat (usec): min=4, max=9772, avg=42.83, stdev=15.26
    clat (usec): min=3, max=25035, avg=2912.23, stdev=266.01
     lat (usec): min=51, max=25095, avg=2955.41, stdev=268.76
    clat percentiles (usec):
     |  1.00th=[ 2573],  5.00th=[ 2671], 10.00th=[ 2704], 20.00th=[ 2769],
     | 30.00th=[ 2802], 40.00th=[ 2835], 50.00th=[ 2868], 60.00th=[ 2900],
     | 70.00th=[ 2966], 80.00th=[ 3032], 90.00th=[ 3163], 95.00th=[ 3261],
     | 99.00th=[ 3654], 99.50th=[ 3916], 99.90th=[ 4883], 99.95th=[ 5211],
     | 99.99th=[ 6587]
   bw (  KiB/s): min=72849, max=90533, per=100.00%, avg=86601.41, stdev=3481.84, samples=120
   iops        : min=18212, max=22633, avg=21650.29, stdev=870.47, samples=120
  lat (usec)   : 4=0.01%, 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%
  lat (usec)   : 1000=0.01%
  lat (msec)   : 2=0.01%, 4=99.59%, 10=0.41%, 20=0.01%, 50=0.01%
  cpu          : usr=8.02%, sys=91.97%, ctx=213, majf=0, minf=75
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=1298506,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=84.5MiB/s (88.6MB/s), 84.5MiB/s-84.5MiB/s (88.6MB/s-88.6MB/s), io=5073MiB (5319MB), run=60001-60001msec
