225. virtio event idx interrupt mode test plan¶

225.1. Description¶

This feature is to suppress interrupts for performance improvement, need compare interrupt times with and without virtio event idx enabled. Also need cover driver reload test. For packed virtqueue test, need using qemu version > 4.2.0.

225.2. Test flow¶

TG –> NIC –> Vhost-user –> Virtio-net

225.3. Test Case 1: Compare interrupt times with and without split ring virtio event idx enabled¶

Bind one nic port to vfio-pci, then launch the vhost sample by below commands:

rm -rf vhost-net*
./x86_64-native-linuxapp-gcc/app/dpdk-testpmd -c 0xF0000000 -n 4 --file-prefix=vhost \
    --vdev 'net_vhost,iface=vhost-net,queues=1' \
    -- -i --nb-cores=1 --txd=1024 --rxd=1024
testpmd>start

Launch VM:

taskset -c 32-33 \
qemu-system-x86_64 -name us-vhost-vm1 \
 -cpu host -enable-kvm -m 2048 -object memory-backend-file,id=mem,size=2048M,mem-path=/mnt/huge,share=on -numa node,memdev=mem -mem-prealloc \
 -smp cores=2,sockets=1 -drive file=/home/osimg/ubuntu16.img  \
 -monitor unix:/tmp/vm2_monitor.sock,server,nowait -net nic,macaddr=00:00:00:08:e8:aa,addr=1f -net user,hostfwd=tcp:127.0.0.1:6004-:22 \
 -chardev socket,id=char0,path=./vhost-net -netdev type=vhost-user,id=mynet1,chardev=char0,vhostforce \
 -device virtio-net-pci,mac=52:54:00:00:00:01,netdev=mynet1,mrg_rxbuf=on,csum=on,gso=on,guest_csum=on,host_tso4=on,guest_tso4=on,guest_ecn=on \
 -vnc :12 -daemonize

On VM1, set virtio device IP:

ifconfig [ens3] 1.1.1.2  # [ens3] is the name of virtio-net

Send 10M packets from packet generator to nic, check virtio-net interrupt times by below cmd in VM:
```
cat /proc/interrupts
```
Disable virtio event idx feature and rerun step1 ~ step4.
Compare interrupt times between virtio event_idx enabled and virtio event_idx disabled.

225.4. Test Case 2: Split ring virtio-pci driver reload test¶

Bind one nic port to vfio-pci, then launch the vhost sample by below commands:

rm -rf vhost-net*
./x86_64-native-linuxapp-gcc/app/dpdk-testpmd -c 0xF0000000 -n 4 --file-prefix=vhost \
    --vdev 'net_vhost,iface=vhost-net,queues=1' \
    -- -i --nb-cores=1 --txd=1024 --rxd=1024
testpmd>start

Launch VM:

taskset -c 32-33 \
qemu-system-x86_64 -name us-vhost-vm1 \
 -cpu host -enable-kvm -m 2048 -object memory-backend-file,id=mem,size=2048M,mem-path=/mnt/huge,share=on -numa node,memdev=mem -mem-prealloc \
 -smp cores=2,sockets=1 -drive file=/home/osimg/ubuntu16.img  \
 -monitor unix:/tmp/vm2_monitor.sock,server,nowait -net nic,macaddr=00:00:00:08:e8:aa,addr=1f -net user,hostfwd=tcp:127.0.0.1:6004-:22 \
 -chardev socket,id=char0,path=./vhost-net -netdev type=vhost-user,id=mynet1,chardev=char0,vhostforce \
 -device virtio-net-pci,mac=52:54:00:00:00:01,netdev=mynet1,mrg_rxbuf=on,csum=on,gso=on,guest_csum=on,host_tso4=on,guest_tso4=on,guest_ecn=on \
 -vnc :12 -daemonize

On VM1, set virtio device IP, send 10M packets from packet generator to nic then check virtio device can receive packets:
```
ifconfig [ens3] 1.1.1.2      # [ens3] is the name of virtio-net
tcpdump -i [ens3]
```

Reload virtio-net driver by below cmds:

ifconfig [ens3] down
./usertools/dpdk-devbind.py -u [00:03.0]   # [00:03.0] is the pci addr of virtio-net
./usertools/dpdk-devbind.py -b virtio-pci [00:03.0]

Check virtio device can receive packets again:

ifconfig [ens3] 1.1.1.2
tcpdump -i [ens3]

Rerun step4 and step5 10 times to check event idx workable after driver reload.

225.5. Test Case 3: Wake up split ring virtio-net cores with event idx interrupt mode 16 queues test¶

Bind one nic port to vfio-pci, then launch the vhost sample by below commands:

rm -rf vhost-net*
./x86_64-native-linuxapp-gcc/app/dpdk-testpmd -l 1-17 -n 4 --file-prefix=vhost \
    --vdev 'net_vhost,iface=vhost-net,queues=16' \
    -- -i --nb-cores=16 --txd=1024 --rxd=1024 --rxq=16 --txq=16
testpmd>start

Launch VM:

taskset -c 32-33 \
qemu-system-x86_64 -name us-vhost-vm1 \
 -cpu host -enable-kvm -m 2048 -object memory-backend-file,id=mem,size=2048M,mem-path=/mnt/huge,share=on -numa node,memdev=mem -mem-prealloc \
 -smp cores=16,sockets=1 -drive file=/home/osimg/ubuntu16.img  \
 -monitor unix:/tmp/vm2_monitor.sock,server,nowait -net nic,macaddr=00:00:00:08:e8:aa,addr=1f -net user,hostfwd=tcp:127.0.0.1:6004-:22 \
 -chardev socket,id=char0,path=./vhost-net -netdev type=vhost-user,id=mynet1,chardev=char0,vhostforce,queues=16 \
 -device virtio-net-pci,mac=52:54:00:00:00:01,netdev=mynet1,mrg_rxbuf=on,mq=on,vectors=40,csum=on,gso=on,guest_csum=on,host_tso4=on,guest_tso4=on,guest_ecn=on \
 -vnc :12 -daemonize

On VM1, give virtio device ip addr and enable vitio-net with 16 quques:

ifconfig [ens3] 1.1.1.2           # [ens3] is the name of virtio-net
ethtool -L [ens3] combined 16

Send 10M different ip addr packets from packet generator to nic, check virtio-net interrupt times by below cmd in VM:
```
cat /proc/interrupts
```
After two hours stress test, stop and restart testpmd, check each queue has new packets coming:
```
testpmd>stop
testpmd>start
testpmd>stop
```

225.6. Test Case 4: Compare interrupt times with and without packed ring virtio event idx enabled¶

Bind one nic port to vfio-pci, then launch the vhost sample by below commands:

rm -rf vhost-net*
./x86_64-native-linuxapp-gcc/app/dpdk-testpmd -c 0xF0000000 -n 4 --file-prefix=vhost \
    --vdev 'net_vhost,iface=vhost-net,queues=1' \
    -- -i --nb-cores=1 --txd=1024 --rxd=1024
testpmd>start

Launch VM:

taskset -c 32-33 \
qemu-system-x86_64 -name us-vhost-vm1 \
 -cpu host -enable-kvm -m 2048 -object memory-backend-file,id=mem,size=2048M,mem-path=/mnt/huge,share=on -numa node,memdev=mem -mem-prealloc \
 -smp cores=2,sockets=1 -drive file=/home/osimg/ubuntu16.img  \
 -monitor unix:/tmp/vm2_monitor.sock,server,nowait -net nic,macaddr=00:00:00:08:e8:aa,addr=1f -net user,hostfwd=tcp:127.0.0.1:6004-:22 \
 -chardev socket,id=char0,path=./vhost-net -netdev type=vhost-user,id=mynet1,chardev=char0,vhostforce \
 -device virtio-net-pci,mac=52:54:00:00:00:01,netdev=mynet1,mrg_rxbuf=on,csum=on,gso=on,guest_csum=on,host_tso4=on,guest_tso4=on,guest_ecn=on,packed=on \
 -vnc :12 -daemonize

On VM1, set virtio device IP:

ifconfig [ens3] 1.1.1.2  # [ens3] is the name of virtio-net

Send 10M packets from packet generator to nic, check virtio-net interrupt times by below cmd in VM:
```
cat /proc/interrupts
```
Disable virtio event idx feature and rerun step1 ~ step4.
Compare interrupt times between virtio event_idx enabled and virtio event_idx disabled.

225.7. Test Case 5: Packed ring virtio-pci driver reload test¶

Bind one nic port to vfio-pci, then launch the vhost sample by below commands:

rm -rf vhost-net*
./x86_64-native-linuxapp-gcc/app/dpdk-testpmd -c 0xF0000000 -n 4 --file-prefix=vhost \
    --vdev 'net_vhost,iface=vhost-net,queues=1' \
    -- -i --nb-cores=1 --txd=1024 --rxd=1024
testpmd>start

Launch VM:

taskset -c 32-33 \
qemu-system-x86_64 -name us-vhost-vm1 \
 -cpu host -enable-kvm -m 2048 -object memory-backend-file,id=mem,size=2048M,mem-path=/mnt/huge,share=on -numa node,memdev=mem -mem-prealloc \
 -smp cores=2,sockets=1 -drive file=/home/osimg/ubuntu16.img  \
 -monitor unix:/tmp/vm2_monitor.sock,server,nowait -net nic,macaddr=00:00:00:08:e8:aa,addr=1f -net user,hostfwd=tcp:127.0.0.1:6004-:22 \
 -chardev socket,id=char0,path=./vhost-net -netdev type=vhost-user,id=mynet1,chardev=char0,vhostforce \
 -device virtio-net-pci,mac=52:54:00:00:00:01,netdev=mynet1,mrg_rxbuf=on,csum=on,gso=on,guest_csum=on,host_tso4=on,guest_tso4=on,guest_ecn=on,packed=on \
 -vnc :12 -daemonize

On VM1, set virtio device IP, send 10M packets from packet generator to nic then check virtio device can receive packets:
```
ifconfig [ens3] 1.1.1.2      # [ens3] is the name of virtio-net
tcpdump -i [ens3]
```

Reload virtio-net driver by below cmds:

ifconfig [ens3] down
./usertools/dpdk-devbind.py -u [00:03.0]   # [00:03.0] is the pci addr of virtio-net
./usertools/dpdk-devbind.py -b virtio-pci [00:03.0]

Check virtio device can receive packets again:

ifconfig [ens3] 1.1.1.2
tcpdump -i [ens3]

Rerun step4 and step5 10 times to check event idx workable after driver reload.

225.8. Test Case 6: Wake up packed ring virtio-net cores with event idx interrupt mode 16 queues test¶

Bind one nic port to vfio-pci, then launch the vhost sample by below commands:

rm -rf vhost-net*
./x86_64-native-linuxapp-gcc/app/dpdk-testpmd -l 1-17 -n 4 --file-prefix=vhost \
    --vdev 'net_vhost,iface=vhost-net,queues=16' \
    -- -i --nb-cores=16 --txd=1024 --rxd=1024 --rxq=16 --txq=16
testpmd>start

Launch VM:

taskset -c 32-33 \
qemu-system-x86_64 -name us-vhost-vm1 \
 -cpu host -enable-kvm -m 2048 -object memory-backend-file,id=mem,size=2048M,mem-path=/mnt/huge,share=on -numa node,memdev=mem -mem-prealloc \
 -smp cores=16,sockets=1 -drive file=/home/osimg/ubuntu16.img  \
 -monitor unix:/tmp/vm2_monitor.sock,server,nowait -net nic,macaddr=00:00:00:08:e8:aa,addr=1f -net user,hostfwd=tcp:127.0.0.1:6004-:22 \
 -chardev socket,id=char0,path=./vhost-net -netdev type=vhost-user,id=mynet1,chardev=char0,vhostforce,queues=16 \
 -device virtio-net-pci,mac=52:54:00:00:00:01,netdev=mynet1,mrg_rxbuf=on,mq=on,vectors=40,csum=on,gso=on,guest_csum=on,host_tso4=on,guest_tso4=on,guest_ecn=on,packed=on \
 -vnc :12 -daemonize

On VM1, give virtio device ip addr and enable vitio-net with 16 quques:

ifconfig [ens3] 1.1.1.2           # [ens3] is the name of virtio-net
ethtool -L [ens3] combined 16

Send 10M different ip addr packets from packet generator to nic, check virtio-net interrupt times by below cmd in VM:
```
cat /proc/interrupts
```
After two hours stress test, stop and restart testpmd, check each queue has new packets coming:
```
testpmd>stop
testpmd>start
testpmd>stop
```