fio | My Note

fio

Updated: Apr 18th, 2024

fio --name=64k_seqwrite_bw --filename=/wyf_cephfs/test  --size=100GB --rw=write --bs=65536 --direct=1 --ioengine=libaio --iodepth=2 --numjobs=4 --verify=0 --time_based --runtime=10 --group_reporting --eta-newline=1 --eta=always
fio --name=4k_randwrite_lat --filename=./temp --size=100GB --rw=randwrite --bs=4096 --direct=1 --ioengine=libaio --iodepth=1 --numjobs=1 --verify=0 --time_based --runtime=10 --group_reporting --eta-newline=1 --eta=always
sudo bash -c "blkzone reset /dev/nvme2n2"
sudo nvme zns reset-zone /dev/nvme2n2 -s 0 -a
sudo bash -c "echo deadline > /sys/block/nvme2n2/queue/scheduler"
sudo bash -c "fio --ioengine=psync --direct=1 --filename=/dev/nvme2n2 --rw=write --bs=64k --group_reporting --zonemode=zbd --name=seqwrite --offset_increment=8z --size=8z --numjobs=2 --job_max_open_zones=1 --group_reporting --eta-newline=1 --eta=always"

https://zonedstorage.io/docs/benchmarking/fio/zns-fio

sudo bash -c "fio --ioengine=psync --direct=1 --filename=/dev/nvme2n2 --rw=write --bs=64k --group_reporting --zonemode=zbd --name=seqwrite --offset_increment=8z --size=8z --numjobs=14 --job_max_open_zones=1"


fio --name=64k_seqwrite_bw --filename=/dev/nvme2n2  --size=100GB --rw=write --bs=65536 --direct=1 --ioengine=libaio --iodepth=2 --numjobs=4 --verify=0 --time_based --runtime=10 --group_reporting --eta-newline=1 --eta=always
yongfeng@c4n6:~$ sudo bash -c "fio --ioengine=psync --direct=1 --filename=/dev/nvme2n2 --rw=write --bs=64k --group_reporting --zonemode=zbd --name=seqwrite --offset_increment=8z --size=8z --numjobs=14 --job_max_open_zones=1"
seqwrite: (g=0): rw=write, bs=(R) 64.0KiB-64.0KiB, (W) 64.0KiB-64.0KiB, (T) 64.0KiB-64.0KiB, ioengine=psync, iodepth=1
...
fio-3.28
Starting 14 processes
Jobs: 14 (f=14): [W(14)][51.9%][w=2018MiB/s][w=32.3k IOPS][eta 01m:03s]
seqwrite: (groupid=0, jobs=14): err= 0: pid=6963: Wed Apr 17 17:44:39 2024
  write: IOPS=28.2k, BW=1765MiB/s (1851MB/s)(118GiB/68346msec); 107 zone resets
    clat (usec): min=48, max=18573, avg=488.82, stdev=323.59
     lat (usec): min=49, max=18574, avg=490.86, stdev=323.59
    clat percentiles (usec):
     |  1.00th=[   84],  5.00th=[  120], 10.00th=[  157], 20.00th=[  233],
     | 30.00th=[  310], 40.00th=[  379], 50.00th=[  449], 60.00th=[  523],
     | 70.00th=[  603], 80.00th=[  701], 90.00th=[  840], 95.00th=[  979],
     | 99.00th=[ 1352], 99.50th=[ 1549], 99.90th=[ 2704], 99.95th=[ 3326],
     | 99.99th=[ 9372]
   bw (  MiB/s): min= 1041, max= 2084, per=100.00%, avg=1766.66, stdev=16.92, samples=1903
   iops        : min=16656, max=33356, avg=28266.44, stdev=270.72, samples=1903
  lat (usec)   : 50=0.01%, 100=2.62%, 250=19.63%, 500=34.96%, 750=27.22%
  lat (usec)   : 1000=11.02%
  lat (msec)   : 2=4.34%, 4=0.17%, 10=0.03%, 20=0.01%
  cpu          : usr=1.35%, sys=3.12%, ctx=2014891, majf=0, minf=665
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,1929984,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=1

Run status group 0 (all jobs):
  WRITE: bw=1765MiB/s (1851MB/s), 1765MiB/s-1765MiB/s (1851MB/s-1851MB/s), io=118GiB (126GB), run=68346-68346msec

Disk stats (read/write):
  nvme2n2: ios=51/1923628, merge=0/0, ticks=8/915163, in_queue=915171, util=99.93%
TOC

Notes mentioning this note