Write throughput: 
write_throughput: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)

write_throughput: (groupid=0, jobs=8): err= 0: pid=4135484: Sun May 29 06:09:34 2022
  write: IOPS=557, BW=566MiB/s (594MB/s)(33.2GiB/60013msec); 0 zone resets
    slat (msec): min=2, max=309, avg=14.33, stdev= 3.77
    clat (usec): min=7, max=1425.5k, avg=894931.13, stdev=82906.45
     lat (msec): min=8, max=1444, avg=909.20, stdev=83.34
    clat percentiles (msec):
     |  1.00th=[  592],  5.00th=[  818], 10.00th=[  852], 20.00th=[  869],
     | 30.00th=[  877], 40.00th=[  894], 50.00th=[  902], 60.00th=[  911],
     | 70.00th=[  927], 80.00th=[  936], 90.00th=[  953], 95.00th=[  978],
     | 99.00th=[ 1028], 99.50th=[ 1045], 99.90th=[ 1250], 99.95th=[ 1301],
     | 99.99th=[ 1418]
   bw (  KiB/s): min=438391, max=715292, per=98.56%, avg=571489.59, stdev=4738.13, samples=952
   iops        : min=  428, max=  698, avg=557.92, stdev= 4.63, samples=952
  lat (usec)   : 10=0.01%, 20=0.01%, 50=0.01%
  lat (msec)   : 10=0.01%, 20=0.02%, 50=0.06%, 100=0.09%, 250=0.24%
  lat (msec)   : 500=0.41%, 750=1.55%, 1000=96.55%, 2000=2.55%
  cpu          : usr=0.43%, sys=4.33%, ctx=311640, majf=0, minf=7051
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,33470,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=566MiB/s (594MB/s), 566MiB/s-566MiB/s (594MB/s-594MB/s), io=33.2GiB (35.6GB), run=60013-60013msec
Write IOPS: 
write_iops: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
write_iops: Laying out IO file (1 file / 10240MiB)

write_iops: (groupid=0, jobs=1): err= 0: pid=32890: Sun May 29 06:10:36 2022
  write: IOPS=4467, BW=17.5MiB/s (18.3MB/s)(1047MiB/60001msec); 0 zone resets
    slat (usec): min=7, max=166210, avg=218.93, stdev=428.80
    clat (usec): min=6, max=248558, avg=14101.38, stdev=6596.85
     lat (usec): min=581, max=249043, avg=14320.90, stdev=6682.27
    clat percentiles (msec):
     |  1.00th=[    4],  5.00th=[    6], 10.00th=[    7], 20.00th=[   10],
     | 30.00th=[   12], 40.00th=[   13], 50.00th=[   15], 60.00th=[   16],
     | 70.00th=[   17], 80.00th=[   18], 90.00th=[   21], 95.00th=[   23],
     | 99.00th=[   28], 99.50th=[   33], 99.90th=[   64], 99.95th=[   82],
     | 99.99th=[  239]
   bw (  KiB/s): min= 6096, max=56015, per=100.00%, avg=17918.83, stdev=7284.81, samples=119
   iops        : min= 1524, max=14003, avg=4479.68, stdev=1821.17, samples=119
  lat (usec)   : 10=0.01%, 750=0.01%
  lat (msec)   : 2=0.01%, 4=1.12%, 10=22.63%, 20=65.55%, 50=10.57%
  lat (msec)   : 100=0.11%, 250=0.05%
  cpu          : usr=2.21%, sys=93.88%, ctx=12114, majf=0, minf=568
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,268056,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=17.5MiB/s (18.3MB/s), 17.5MiB/s-17.5MiB/s (18.3MB/s-18.3MB/s), io=1047MiB (1098MB), run=60001-60001msec
Read throughput: 
read_throughput: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)

read_throughput: (groupid=0, jobs=8): err= 0: pid=244524: Sun May 29 06:14:11 2022
  read: IOPS=462, BW=471MiB/s (494MB/s)(27.6GiB/60017msec)
    slat (usec): min=507, max=140326, avg=17274.62, stdev=9525.95
    clat (usec): min=7, max=1695.9k, avg=1079524.64, stdev=206046.29
     lat (msec): min=5, max=1719, avg=1096.83, stdev=208.45
    clat percentiles (msec):
     |  1.00th=[  617],  5.00th=[  793], 10.00th=[  852], 20.00th=[  919],
     | 30.00th=[  969], 40.00th=[ 1020], 50.00th=[ 1083], 60.00th=[ 1133],
     | 70.00th=[ 1167], 80.00th=[ 1217], 90.00th=[ 1334], 95.00th=[ 1485],
     | 99.00th=[ 1586], 99.50th=[ 1620], 99.90th=[ 1636], 99.95th=[ 1653],
     | 99.99th=[ 1687]
   bw (  KiB/s): min=284745, max=702628, per=98.29%, avg=474326.24, stdev=10727.62, samples=952
   iops        : min=  278, max=  686, avg=463.10, stdev=10.47, samples=952
  lat (usec)   : 10=0.02%, 20=0.01%
  lat (msec)   : 10=0.01%, 20=0.02%, 50=0.05%, 100=0.06%, 250=0.25%
  lat (msec)   : 500=0.41%, 750=2.00%, 1000=34.38%, 2000=64.60%
  cpu          : usr=0.09%, sys=16.33%, ctx=26929, majf=0, minf=11001
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=27771,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=471MiB/s (494MB/s), 471MiB/s-471MiB/s (494MB/s-494MB/s), io=27.6GiB (29.7GB), run=60017-60017msec
Read IOPS: 
read_iops: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
read_iops: Laying out IO file (1 file / 10240MiB)

read_iops: (groupid=0, jobs=1): err= 0: pid=318983: Sun May 29 06:15:51 2022
  read: IOPS=433, BW=1739KiB/s (1781kB/s)(102MiB/60001msec)
    slat (usec): min=5, max=7813, avg=2300.29, stdev=965.48
    clat (usec): min=5, max=181961, avg=145034.87, stdev=11315.18
     lat (msec): min=2, max=184, avg=147.34, stdev=11.43
    clat percentiles (msec):
     |  1.00th=[  121],  5.00th=[  129], 10.00th=[  133], 20.00th=[  138],
     | 30.00th=[  140], 40.00th=[  142], 50.00th=[  144], 60.00th=[  148],
     | 70.00th=[  150], 80.00th=[  155], 90.00th=[  161], 95.00th=[  163],
     | 99.00th=[  169], 99.50th=[  171], 99.90th=[  176], 99.95th=[  180],
     | 99.99th=[  182]
   bw (  KiB/s): min= 1504, max= 1936, per=99.75%, avg=1735.63, stdev=92.31, samples=120
   iops        : min=  376, max=  484, avg=433.78, stdev=23.07, samples=120
  lat (usec)   : 10=0.01%
  lat (msec)   : 4=0.01%, 10=0.01%, 20=0.02%, 50=0.06%, 100=0.09%
  lat (msec)   : 250=100.06%
  cpu          : usr=0.25%, sys=96.56%, ctx=772, majf=0, minf=241
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=26027,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=1739KiB/s (1781kB/s), 1739KiB/s-1739KiB/s (1781kB/s-1781kB/s), io=102MiB (107MB), run=60001-60001msec
