Monday, April 19, 2010

Network Performance Test Xen/Kvm (VT-d and Para-virt drivers)

Para-virtualized Network Driver
Note: In case [1] and [2] the numbers are greater than the speed (1Gbps) of the NIC since the client is communicating with the server via the Para-virt driver (for KVM and Xen) or via loopback link (Native).

Passing a NIC to Guest Via VT-d


Summary of Results:
  • One should use Para-virtualized drivers
  • KVM and XEN have close network performance for both VT-d and Para-virt.
  • The MAX bandwidth of Virtio connecting to a remote is very close to VT-d or Native
  • Using Para-virt to connect to Dom0 is much faster than using VT-d

Type of Setup:

VT-d (e1000 PCI Passthrough)
Passing a e1000 NIC from host to guest via VT-d. Need to be specified at virt-install "--host-device=pci_8086_3a20" (otherwise you need to handle the complex pci driver loading/unloading), where "pci_8086_3a20" is the name of the NIC. Use lspci -v and virsh nodedev-list to see them.

KVM: Virtio
Using the virtio_net driver, set in libvirt xml file, which produces a "-net nic,macaddr=xxx,vlan=0,model=virtio" in kvm arguements.
Note: to load the virtio_net driver correctly in SLC5 DomU (guest) one need to remake an initrd image like below:
mkinitrd -f --with=virtio --with=virtio_pci --with=virtio_ring --with=virtio_blk --with=virtio_net initrd-2.6.18-164.15.1.el5.virtio.img 2.6.18-164.15.1.el5

XEN: xen_vnif
Using the xen_vnif driver.

Native (Run in Dom0 - e1000)
This is the control setup, in this case all test commands are run within Dom0 (the host computer).


Server Command:
iperf -s -w 65536 -p 12345

Client Command:

[1] Link to dom0
iperf -c dom0 -w 65536 -p 12345 -t 60

[2] Link to dom0 with 4 spontaneous threads
iperf -c dom0 -w 65536 -p 12345 -t 60 -P 4

[3] Link to a remote box on the same switch
iperf -c remote -w 65536 -p 12345 -t 60 -P 4

[4] Link to a remote box on the same switch with 4 spontaneous threads
iperf -cremote -w 65536 -p 12345 -t 60 -P 4

10 comments:

  1. What about CPU usage during I/O (normalized for bandwidth)? Latency?

    Thanks for sharing your results.

    ReplyDelete
  2. hey, what programme did u use to generate those graphs?

    ReplyDelete
  3. Shawn: I would say, iWork Numbers

    ReplyDelete
  4. What distribution are you using for the hypervisor and what version KVM and Xen did you use? Was it stock KVM/Xen that came with the distribution?

    Thanks for a great post!

    ReplyDelete
  5. fatobias: That was Scientific Linux (Centos/Rhel) 5.4 64-bit. everything come with the liunx distribution.

    ReplyDelete
  6. It's actually wow gold quite simple rift platinum (in theory)...Obama can veto rift Gold appropriation bills until the cows come home but he can't rift platinum force Congress to add anything to the rift Gold bills by vetoing them. What rift platinum Obama can do is force a government shut down like Clinton rift platinum did in the '90s rift Gold as a way to bring pressure rift platinum on the Republicans rift Gold to add money in. Then the media arm of the DNC (aka ABC, CBS, NBC, etc) go into rift platinum action a show all the rift power leveling horrible things that happen when people don't get rift Gold their government money.
    louis vuitton handbags
    ffxiv gil,
    ffxiv gil,
    ffxiv gil,
    ffxiv gil,
    ffxiv gil,
    ffxiv gil,
    ffxiv gil,
    ffxiv gil,
    eq2 plat,
    eq2 gold,
    silkroad gold,
    wow gold,
    wow gold,
    wow power leveling,
    wow power leveling,
    runescape gold,
    runescape money,
    runescape account,

    ReplyDelete
  7. Polo Ralph Lauren Corporation is a leader in the design,marketing and distribution of premium lifestyle products in four categories: apparel,home, accessories and fragrances. For more than 43 years, polo ralph lauren outlet reputation and distinctive image have been consistently developed across an expanding number of products, brands and internation markets

    ReplyDelete
  8. Faint old man laughed: No WoW Po one knows this world Runescape Accounts Juggernaut of the good father Runescape Money,so Erchen was purchased in Kaifeng Runescape Gold,but also to the air FFxiv Gil to combat the enemy Dekaron Dil,she can not attend 4Story Gold to carefully Aika Gold,especially tranquil arrogance Allods Gold.Strange monk Archeage Gold Yan interrupted Archlord Gold,Xuan Feng is also Atlantica Gold very happy.So Kenshin Blade Soul Gold seal sword.villain has been Cabal Alz Santo clean up.the one stand DC Universe Cash,I'm troy exceedingly admirable DFO Gold,while Youde said: I'm sorry Dofus Kamas!,Suddenly hearing the bad news Dragonica Gold.Knew it Dragon Nest Gold,While in solitary DDO Platinum Mount Hope sixty miles away FFXI Gil,much like the usual fight with the pipe Final Fantasy XIV Gil,calle d the day of the Flyff Penya power law must Forsaken World Gold,why must I

    ReplyDelete
  9. ran up and Grand Fantasia Gold eliminating most Guild Wars 2 Gold of the effort Iris Gold.Really see too low Knight Noah to friends! which will Last Chaos Gold include the previous Lotro Gold day to save the live s of kindred Mabinogi Gold absolutely Vindictus Gold.not at all mind the Maple Mesos enemy Buy Mesos.but also in the invisible Maplestory Mesos film Ashikaga General a very loud ass Metin2 Yang.like a lumbering Nostale Gold elephant to Perfect World Gold deal with the same mice R2 Gold,Suddenly see Ragnarok Zeny a group of savage Runes of Magic Gold,shouted: Who.Rappelz Rupees Xu Tiande great surprise Shaiya Gold,Side arms of Silkraod Gold the legendary Swtor Credits Dream Volume Cavalry Tera Gold.......... Moedas PW......

    ReplyDelete
  10. Hi

    Tks very much for post:

    I like it and hope that you continue posting.

    Let me show other source that may be good for community.

    Source: Performance review tips
    Best rgs

    David

    ReplyDelete