Write throughput: 
write_throughput: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)

write_throughput: (groupid=0, jobs=8): err= 0: pid=1635106: Sun May 29 00:29:44 2022
  write: IOPS=565, BW=574MiB/s (601MB/s)(33.6GiB/60011msec); 0 zone resets
    slat (usec): min=2863, max=96989, avg=14143.73, stdev=2208.03
    clat (usec): min=6, max=1121.0k, avg=884056.48, stdev=77873.98
     lat (msec): min=3, max=1135, avg=898.16, stdev=78.27
    clat percentiles (msec):
     |  1.00th=[  567],  5.00th=[  818], 10.00th=[  844], 20.00th=[  860],
     | 30.00th=[  877], 40.00th=[  885], 50.00th=[  894], 60.00th=[  902],
     | 70.00th=[  911], 80.00th=[  927], 90.00th=[  936], 95.00th=[  953],
     | 99.00th=[  978], 99.50th=[  986], 99.90th=[ 1099], 99.95th=[ 1099],
     | 99.99th=[ 1116]
   bw (  KiB/s): min=495354, max=696320, per=98.53%, avg=578747.36, stdev=3678.80, samples=952
   iops        : min=  483, max=  680, avg=564.97, stdev= 3.60, samples=952
  lat (usec)   : 10=0.02%, 20=0.01%
  lat (msec)   : 4=0.01%, 10=0.01%, 20=0.03%, 50=0.07%, 100=0.10%
  lat (msec)   : 250=0.25%, 500=0.42%, 750=1.59%, 1000=98.65%, 2000=0.34%
  cpu          : usr=0.47%, sys=4.23%, ctx=282195, majf=0, minf=5984
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,33910,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=574MiB/s (601MB/s), 574MiB/s-574MiB/s (601MB/s-601MB/s), io=33.6GiB (36.1GB), run=60011-60011msec
Write IOPS: 
write_iops: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
write_iops: Laying out IO file (1 file / 10240MiB)

write_iops: (groupid=0, jobs=1): err= 0: pid=1641444: Sun May 29 00:30:47 2022
  write: IOPS=4457, BW=17.4MiB/s (18.3MB/s)(1045MiB/60001msec); 0 zone resets
    slat (usec): min=8, max=95054, avg=219.66, stdev=263.89
    clat (usec): min=4, max=121001, avg=14132.98, stdev=5212.26
     lat (usec): min=536, max=121451, avg=14353.24, stdev=5288.06
    clat percentiles (msec):
     |  1.00th=[    5],  5.00th=[    7], 10.00th=[    8], 20.00th=[   10],
     | 30.00th=[   12], 40.00th=[   13], 50.00th=[   15], 60.00th=[   16],
     | 70.00th=[   17], 80.00th=[   19], 90.00th=[   21], 95.00th=[   22],
     | 99.00th=[   27], 99.50th=[   29], 99.90th=[   35], 99.95th=[   41],
     | 99.99th=[  121]
   bw (  KiB/s): min= 9584, max=38894, per=100.00%, avg=17873.27, stdev=6535.21, samples=119
   iops        : min= 2396, max= 9723, avg=4468.27, stdev=1633.76, samples=119
  lat (usec)   : 10=0.01%, 750=0.01%, 1000=0.01%
  lat (msec)   : 2=0.01%, 4=0.12%, 10=22.11%, 20=66.31%, 50=11.43%
  lat (msec)   : 100=0.02%, 250=0.02%
  cpu          : usr=2.19%, sys=94.82%, ctx=11989, majf=0, minf=406
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,267456,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=17.4MiB/s (18.3MB/s), 17.4MiB/s-17.4MiB/s (18.3MB/s-18.3MB/s), io=1045MiB (1096MB), run=60001-60001msec
Read throughput: 
read_throughput: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)

read_throughput: (groupid=0, jobs=8): err= 0: pid=1679468: Sun May 29 00:34:13 2022
  read: IOPS=591, BW=600MiB/s (629MB/s)(35.2GiB/60011msec)
    slat (usec): min=526, max=1222.4k, avg=13511.68, stdev=8223.10
    clat (usec): min=9, max=2151.5k, avg=846865.48, stdev=184158.70
     lat (msec): min=8, max=2165, avg=860.40, stdev=186.68
    clat percentiles (msec):
     |  1.00th=[  592],  5.00th=[  676], 10.00th=[  709], 20.00th=[  760],
     | 30.00th=[  785], 40.00th=[  810], 50.00th=[  835], 60.00th=[  852],
     | 70.00th=[  869], 80.00th=[  894], 90.00th=[  919], 95.00th=[  969],
     | 99.00th=[ 1670], 99.50th=[ 1720], 99.90th=[ 2123], 99.95th=[ 2123],
     | 99.99th=[ 2165]
   bw (  KiB/s): min=454656, max=786432, per=98.79%, avg=606879.64, stdev=10150.04, samples=950
   iops        : min=  444, max=  768, avg=592.44, stdev= 9.91, samples=950
  lat (usec)   : 10=0.01%, 20=0.02%
  lat (msec)   : 10=0.01%, 20=0.02%, 50=0.05%, 100=0.08%, 250=0.24%
  lat (msec)   : 500=0.44%, 750=16.85%, 1000=79.34%, 2000=4.19%, >=2000=0.18%
  cpu          : usr=0.13%, sys=15.84%, ctx=37685, majf=0, minf=13832
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=35488,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=600MiB/s (629MB/s), 600MiB/s-600MiB/s (629MB/s-629MB/s), io=35.2GiB (37.7GB), run=60011-60011msec
Read IOPS: 
read_iops: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
read_iops: Laying out IO file (1 file / 10240MiB)

read_iops: (groupid=0, jobs=1): err= 0: pid=1689981: Sun May 29 00:35:52 2022
  read: IOPS=424, BW=1704KiB/s (1745kB/s)(99.8MiB/60001msec)
    slat (usec): min=6, max=7430, avg=2348.44, stdev=1013.41
    clat (usec): min=4, max=173530, avg=148063.28, stdev=11154.83
     lat (msec): min=2, max=176, avg=150.41, stdev=11.26
    clat percentiles (msec):
     |  1.00th=[  124],  5.00th=[  132], 10.00th=[  136], 20.00th=[  140],
     | 30.00th=[  142], 40.00th=[  146], 50.00th=[  148], 60.00th=[  153],
     | 70.00th=[  155], 80.00th=[  159], 90.00th=[  163], 95.00th=[  165],
     | 99.00th=[  169], 99.50th=[  169], 99.90th=[  171], 99.95th=[  171],
     | 99.99th=[  174]
   bw (  KiB/s): min= 1536, max= 1928, per=99.77%, avg=1700.26, stdev=91.26, samples=120
   iops        : min=  384, max=  482, avg=424.93, stdev=22.84, samples=120
  lat (usec)   : 10=0.01%
  lat (msec)   : 4=0.01%, 10=0.02%, 20=0.02%, 50=0.05%, 100=0.09%
  lat (msec)   : 250=100.07%
  cpu          : usr=0.21%, sys=95.38%, ctx=779, majf=0, minf=71
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=25496,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=1704KiB/s (1745kB/s), 1704KiB/s-1704KiB/s (1745kB/s-1745kB/s), io=99.8MiB (105MB), run=60001-60001msec
