Write throughput: 
write_throughput: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)
write_throughput: Laying out IO file (1 file / 10240MiB)

write_throughput: (groupid=0, jobs=8): err= 0: pid=3631059: Sun May 29 06:48:22 2022
  write: IOPS=1099, BW=1108MiB/s (1161MB/s)(64.9GiB/60007msec); 0 zone resets
    slat (usec): min=1998, max=729617, avg=7257.00, stdev=9927.70
    clat (usec): min=6, max=1519.1k, avg=455912.68, stdev=137986.78
     lat (msec): min=3, max=1526, avg=463.14, stdev=139.23
    clat percentiles (msec):
     |  1.00th=[  239],  5.00th=[  296], 10.00th=[  338], 20.00th=[  376],
     | 30.00th=[  422], 40.00th=[  451], 50.00th=[  460], 60.00th=[  468],
     | 70.00th=[  477], 80.00th=[  485], 90.00th=[  527], 95.00th=[  584],
     | 99.00th=[ 1284], 99.50th=[ 1469], 99.90th=[ 1502], 99.95th=[ 1519],
     | 99.99th=[ 1519]
   bw (  MiB/s): min=  326, max= 1790, per=99.60%, avg=1103.15, stdev=31.09, samples=949
   iops        : min=  324, max= 1790, avg=1102.38, stdev=31.12, samples=949
  lat (usec)   : 10=0.01%, 20=0.01%
  lat (msec)   : 4=0.01%, 10=0.01%, 20=0.03%, 50=0.08%, 100=0.10%
  lat (msec)   : 250=1.09%, 500=84.51%, 750=12.79%, 1000=0.73%, 2000=1.41%
  cpu          : usr=1.17%, sys=10.64%, ctx=646275, majf=0, minf=13247
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,65954,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=1108MiB/s (1161MB/s), 1108MiB/s-1108MiB/s (1161MB/s-1161MB/s), io=64.9GiB (69.7GB), run=60007-60007msec
Write IOPS: 
write_iops: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
write_iops: Laying out IO file (1 file / 10240MiB)

write_iops: (groupid=0, jobs=1): err= 0: pid=3888754: Sun May 29 06:49:25 2022
  write: IOPS=12.9k, BW=50.5MiB/s (52.0MB/s)(3031MiB/60001msec); 0 zone resets
    slat (usec): min=8, max=48025, avg=72.03, stdev=175.73
    clat (usec): min=7, max=93619, avg=4872.91, stdev=2507.34
     lat (usec): min=130, max=93751, avg=4945.60, stdev=2537.78
    clat percentiles (usec):
     |  1.00th=[ 3130],  5.00th=[ 3458], 10.00th=[ 3621], 20.00th=[ 3818],
     | 30.00th=[ 3949], 40.00th=[ 4080], 50.00th=[ 4228], 60.00th=[ 4293],
     | 70.00th=[ 4490], 80.00th=[ 5080], 90.00th=[ 7439], 95.00th=[ 8848],
     | 99.00th=[12911], 99.50th=[17433], 99.90th=[35390], 99.95th=[42730],
     | 99.99th=[56886]
   bw (  KiB/s): min=43008, max=65112, per=100.00%, avg=51753.78, stdev=4375.85, samples=119
   iops        : min=10752, max=16278, avg=12938.37, stdev=1093.97, samples=119
  lat (usec)   : 10=0.01%, 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01%
  lat (msec)   : 2=0.01%, 4=32.66%, 10=65.23%, 20=1.72%, 50=0.38%
  lat (msec)   : 100=0.02%
  cpu          : usr=7.27%, sys=89.15%, ctx=4921, majf=0, minf=2214
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=0,775983,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
  WRITE: bw=50.5MiB/s (52.0MB/s), 50.5MiB/s-50.5MiB/s (52.0MB/s-52.0MB/s), io=3031MiB (3179MB), run=60001-60001msec
Read throughput: 
read_throughput: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=64
...
fio-3.25
Starting 8 processes
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)
read_throughput: Laying out IO file (1 file / 10240MiB)

read_throughput: (groupid=0, jobs=8): err= 0: pid=293467: Sun May 29 06:52:13 2022
  read: IOPS=1932, BW=1941MiB/s (2035MB/s)(114GiB/60006msec)
    slat (usec): min=499, max=49706, avg=4125.72, stdev=2171.20
    clat (usec): min=7, max=399274, avg=260250.15, stdev=53784.02
     lat (msec): min=3, max=403, avg=264.38, stdev=54.55
    clat percentiles (msec):
     |  1.00th=[   61],  5.00th=[  122], 10.00th=[  211], 20.00th=[  247],
     | 30.00th=[  259], 40.00th=[  268], 50.00th=[  271], 60.00th=[  275],
     | 70.00th=[  288], 80.00th=[  296], 90.00th=[  305], 95.00th=[  317],
     | 99.00th=[  330], 99.50th=[  334], 99.90th=[  359], 99.95th=[  384],
     | 99.99th=[  393]
   bw (  MiB/s): min= 1534, max= 3883, per=99.72%, avg=1935.16, stdev=72.53, samples=952
   iops        : min= 1534, max= 3882, avg=1934.50, stdev=72.50, samples=952
  lat (usec)   : 10=0.01%, 20=0.01%
  lat (msec)   : 4=0.01%, 10=0.01%, 20=0.01%, 50=0.27%, 100=3.54%
  lat (msec)   : 250=17.27%, 500=79.32%
  cpu          : usr=0.43%, sys=34.15%, ctx=109534, majf=0, minf=5872
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=115933,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=1941MiB/s (2035MB/s), 1941MiB/s-1941MiB/s (2035MB/s-2035MB/s), io=114GiB (122GB), run=60006-60006msec
Read IOPS: 
read_iops: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=64
fio-3.25
Starting 1 process
read_iops: Laying out IO file (1 file / 10240MiB)

read_iops: (groupid=0, jobs=1): err= 0: pid=829777: Sun May 29 06:53:41 2022
  read: IOPS=17.1k, BW=66.7MiB/s (69.9MB/s)(4000MiB/60001msec)
    slat (usec): min=5, max=10080, avg=54.81, stdev=87.37
    clat (usec): min=3, max=76997, avg=3693.20, stdev=2215.96
     lat (usec): min=45, max=77175, avg=3748.45, stdev=2249.00
    clat percentiles (usec):
     |  1.00th=[ 2540],  5.00th=[ 2638], 10.00th=[ 2704], 20.00th=[ 2769],
     | 30.00th=[ 2802], 40.00th=[ 2835], 50.00th=[ 2900], 60.00th=[ 2966],
     | 70.00th=[ 3294], 80.00th=[ 3916], 90.00th=[ 5866], 95.00th=[ 8291],
     | 99.00th=[11863], 99.50th=[12780], 99.90th=[15008], 99.95th=[31851],
     | 99.99th=[62129]
   bw (  KiB/s): min=12448, max=93568, per=100.00%, avg=68285.26, stdev=24953.83, samples=120
   iops        : min= 3112, max=23392, avg=17071.24, stdev=6238.46, samples=120
  lat (usec)   : 4=0.01%, 50=0.01%, 100=0.01%, 250=0.01%, 500=0.01%
  lat (usec)   : 750=0.01%, 1000=0.01%
  lat (msec)   : 2=0.01%, 4=80.85%, 10=16.50%, 20=2.59%, 50=0.03%
  lat (msec)   : 100=0.03%
  cpu          : usr=6.96%, sys=75.43%, ctx=25778, majf=0, minf=395
  IO depths    : 1=0.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=1023949,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Run status group 0 (all jobs):
   READ: bw=66.7MiB/s (69.9MB/s), 66.7MiB/s-66.7MiB/s (69.9MB/s-69.9MB/s), io=4000MiB (4194MB), run=60001-60001msec
