Write throughput: 
write_throughput: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)

write_throughput: (groupid=0, jobs=8): err= 0: pid=1235341: Sun May 29 12:22:12 2022
  write: IOPS=747, BW=756MiB/s (793MB/s)(44.3GiB/60009msec); 0 zone resets
    slat (msec): min=2, max=407, avg=10.69, stdev= 4.11
    clat (usec): min=5, max=1256.5k, avg=669328.19, stdev=95531.50
     lat (msec): min=3, max=1267, avg=679.98, stdev=96.58
    clat percentiles (msec):
     |  1.00th=[  451],  5.00th=[  510], 10.00th=[  514], 20.00th=[  651],
     | 30.00th=[  676], 40.00th=[  684], 50.00th=[  684], 60.00th=[  693],
     | 70.00th=[  701], 80.00th=[  709], 90.00th=[  735], 95.00th=[  760],
     | 99.00th=[  961], 99.50th=[ 1053], 99.90th=[ 1250], 99.95th=[ 1250],
     | 99.99th=[ 1250]
   bw (  KiB/s): min=346770, max=1073708, per=98.98%, avg=766079.16, stdev=12893.43, samples=952
   iops        : min=  336, max= 1046, avg=747.88, stdev=12.59, samples=952
  lat (usec)   : 10=0.02%, 20=0.01%
  lat (msec)   : 4=0.01%, 10=0.01%, 20=0.02%, 50=0.06%, 100=0.09%
  lat (msec)   : 250=0.24%, 500=2.78%, 750=91.23%, 1000=5.71%, 2000=0.96%
  cpu          : usr=0.72%, sys=6.54%, ctx=379422, majf=0, minf=10537
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,44846,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=756MiB/s (793MB/s), 756MiB/s-756MiB/s (793MB/s-793MB/s), io=44.3GiB (47.6GB), run=60009-60009msec
Write IOPS: 
write_iops: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
write_iops: Laying out IO file (1 file / 10240MiB)

write_iops: (groupid=0, jobs=1): err= 0: pid=1340141: Sun May 29 12:23:15 2022
  write: IOPS=13.1k, BW=51.0MiB/s (53.5MB/s)(3061MiB/60001msec); 0 zone resets
    slat (usec): min=8, max=67017, avg=71.41, stdev=205.71
    clat (usec): min=4, max=78043, avg=4825.65, stdev=2679.87
     lat (usec): min=82, max=78183, avg=4897.66, stdev=2711.77
    clat percentiles (usec):
     |  1.00th=[ 3097],  5.00th=[ 3392], 10.00th=[ 3589], 20.00th=[ 3785],
     | 30.00th=[ 3916], 40.00th=[ 4047], 50.00th=[ 4146], 60.00th=[ 4293],
     | 70.00th=[ 4490], 80.00th=[ 4948], 90.00th=[ 7439], 95.00th=[ 8717],
     | 99.00th=[13960], 99.50th=[18482], 99.90th=[38536], 99.95th=[48497],
     | 99.99th=[70779]
   bw (  KiB/s): min=27639, max=69104, per=100.00%, avg=52319.99, stdev=6113.36, samples=119
   iops        : min= 6909, max=17276, avg=13079.93, stdev=1528.36, samples=119
  lat (usec)   : 10=0.01%, 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%
  lat (usec)   : 1000=0.01%
  lat (msec)   : 2=0.01%, 4=36.99%, 10=60.76%, 20=1.84%, 50=0.37%
  lat (msec)   : 100=0.05%
  cpu          : usr=7.68%, sys=86.97%, ctx=10663, majf=0, minf=1077
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,783602,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=51.0MiB/s (53.5MB/s), 51.0MiB/s-51.0MiB/s (53.5MB/s-53.5MB/s), io=3061MiB (3210MB), run=60001-60001msec
Read throughput: 
read_throughput: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)

read_throughput: (groupid=0, jobs=8): err= 0: pid=1751512: Sun May 29 12:26:41 2022
  read: IOPS=1952, BW=1961MiB/s (2057MB/s)(115GiB/60005msec)
    slat (usec): min=516, max=46011, avg=4078.32, stdev=2879.19
    clat (usec): min=8, max=626403, avg=257732.95, stdev=50522.48
     lat (usec): min=1767, max=631514, avg=261824.13, stdev=51209.18
    clat percentiles (msec):
     |  1.00th=[   69],  5.00th=[  142], 10.00th=[  199], 20.00th=[  232],
     | 30.00th=[  251], 40.00th=[  262], 50.00th=[  271], 60.00th=[  279],
     | 70.00th=[  284], 80.00th=[  292], 90.00th=[  305], 95.00th=[  313],
     | 99.00th=[  326], 99.50th=[  330], 99.90th=[  401], 99.95th=[  489],
     | 99.99th=[  609]
   bw (  MiB/s): min= 1574, max= 3710, per=99.67%, avg=1954.94, stdev=58.68, samples=952
   iops        : min= 1574, max= 3710, avg=1954.34, stdev=58.67, samples=952
  lat (usec)   : 10=0.01%, 20=0.01%, 50=0.01%
  lat (msec)   : 2=0.01%, 4=0.01%, 10=0.02%, 20=0.02%, 50=0.09%
  lat (msec)   : 100=1.96%, 250=27.73%, 500=70.56%, 750=0.04%
  cpu          : usr=0.50%, sys=54.13%, ctx=65381, majf=0, minf=9937
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=117177,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=1961MiB/s (2057MB/s), 1961MiB/s-1961MiB/s (2057MB/s-2057MB/s), io=115GiB (123GB), run=60005-60005msec
Read IOPS: 
read_iops: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
read_iops: Laying out IO file (1 file / 10240MiB)

read_iops: (groupid=0, jobs=1): err= 0: pid=1974619: Sun May 29 12:28:08 2022
  read: IOPS=21.2k, BW=82.8MiB/s (86.8MB/s)(4969MiB/60001msec)
    slat (usec): min=4, max=48022, avg=43.70, stdev=57.93
    clat (usec): min=3, max=51638, avg=2972.74, stdev=527.65
     lat (usec): min=50, max=51689, avg=3016.85, stdev=532.59
    clat percentiles (usec):
     |  1.00th=[ 2606],  5.00th=[ 2704], 10.00th=[ 2737], 20.00th=[ 2802],
     | 30.00th=[ 2835], 40.00th=[ 2868], 50.00th=[ 2933], 60.00th=[ 2966],
     | 70.00th=[ 2999], 80.00th=[ 3064], 90.00th=[ 3163], 95.00th=[ 3326],
     | 99.00th=[ 3851], 99.50th=[ 4686], 99.90th=[ 8979], 99.95th=[ 9372],
     | 99.99th=[14877]
   bw (  KiB/s): min=57888, max=90352, per=100.00%, avg=84848.19, stdev=4601.31, samples=119
   iops        : min=14472, max=22588, avg=21212.01, stdev=1150.35, samples=119
  lat (usec)   : 4=0.01%, 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%
  lat (usec)   : 1000=0.01%
  lat (msec)   : 2=0.01%, 4=99.25%, 10=0.73%, 20=0.02%, 100=0.01%
  cpu          : usr=8.19%, sys=91.00%, ctx=434, majf=0, minf=67
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=1272058,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=82.8MiB/s (86.8MB/s), 82.8MiB/s-82.8MiB/s (86.8MB/s-86.8MB/s), io=4969MiB (5211MB), run=60001-60001msec
