Talos Secure Workstation

← View All Updates

Nov

01

GPU Passthrough Demo

This video demonstrates effective use of virtual machines with direct GPU access to get the most out of your Talos™ machine.

OpenPOWER fully supports advanced virtualization technologies, including PCI device passthrough when used with a PowerNV system, KVM, and the HV module. We demonstrate the power of this virtualization support below by launching two separate virtual machines, each with its own dedicated AMD Radeon GPU attached, and putting both virtual machines and GPUs under moderate load simultaneously.

Demonstration

For the best viewing experience, expand the video to full screen mode on your device. A screen resolution of at least 1920 x 1080 pixels is recommended. This video is available in native 4K resolution for those with 4K-compatible devices. The version below is scaled down and some detail, such as text, may have been lost in the scaling process.

Notes

  • This radeon driver patch is required for proper GPU start on non-x86 platforms, and was applied to the radeon driver used in this demonstration.
  • This radeon driver patch is required for QEMU VFIO support on all platforms, and was applied to the radeon driver used in this demonstration.
  • The Radeon R9 290X GPUs (Hawaii class) used in this demonstration contain a hardware reset bug that precludes stable long term use in virtualized environments. Specifically, they do not respond to the PCIe reset signal, and therefore cannot be reinitialized without a host power cycle. This affects all architectures including x86. Subsequent AMD cards do not have this issue.

System Configuration

VFIO Configuration and QEMU Launch

The following commands will isolate the GPU at PCI bus location 0000:01:00 (GPU core [1002:67b0], HDMI audio [1002:aac8]), then prepare it for attachment to a virtual machine:

modprobe vfio-pci
echo "1002 67b0" > /sys/bus/pci/drivers/vfio-pci/new_id
echo "1002 aac8" > /sys/bus/pci/drivers/vfio-pci/new_id
echo 0000:01:00.0 > /sys/bus/pci/devices/0000\:00\:00.0/0000\:01\:00.0/driver/unbind
echo 0000:01:00.1 > /sys/bus/pci/devices/0000\:00\:00.0/0000\:01\:00.1/driver/unbind
echo 0000:01:00.0 > /sys/bus/pci/drivers/vfio-pci/bind
echo 0000:01:00.1 > /sys/bus/pci/drivers/vfio-pci/bind
echo "1002 67b0" > /sys/bus/pci/drivers/vfio-pci/remove_id
echo "1002 aac8" > /sys/bus/pci/drivers/vfio-pci/remove_id

Once the GPU has been prepared, it can be attached to a newly started virtual machine via the “-device vfio-pci” arguments to QEMU:

qemu-system-ppc64 --enable-kvm -M pseries -cpu host -m 32G -device vfio-pci,host=0000:01:00.0 -device vfio-pci,host=0000:01:00.1 qemu-pcie-passthrough-vm-1.qcow2

$380,060 raised

of $3,700,000 goal

11

days left

10%

funded

291

pledges

Pledge Now

$10

Support Us!

Thanks for helping make Talos™ a reality! You will be rewarded with good karma and regular backer updates. Help grow the ecosystem and expand freedom!


$250

Log in with Us!

Thanks for helping make Talos™ a reality! You will be rewarded with good karma, regular backer updates, and 6 months of SSH access to a dedicated POWER8 virtual machine. Help grow the ecosystem and give POWER8 a try when you support Talos™!


$500

Develop with Us!

Thanks for helping make Talos™ a reality! You will be rewarded with good karma, regular backer updates, and 12 months of SSH access to a dedicated POWER8 virtual machine. You will even be able to download your complete VM image to a new Talos™ system to seamlessly continue your work on POWER8. Help grow the ecosystem and give POWER8 a try when you support Talos™!


$3,700

Talos™ Mainboard and Accessories

The world's first ATX-compatible, workstation-class mainboard for the new, free-software friendly IBM POWER8 processor. Includes one heatsink and 92 mm fan, one ATX-compatible I/O shield, and a live rescue DVD with factory reset utilities, source code for firmware and FPGA components, mainboard schematics, user manual, and Ubuntu installation media. CPU, RAM, power supply, storage drives, and chassis sold separately.


$7,100

Talos™ Desktop Edition (TALP8D050)

A complete Talos™ workstation with a CPU of your choice, 128 GB of DDR3 ECC RAM, an AMD Radeon RX 480 (8 GB VRAM) GPU, and two Western Digital WD40EFRX 4 TB SATA drives, all installed in a heavy-duty tower chassis. Comes pre-installed with Debian. Select the CPU by purchasing it as a separate item in the same order or under the same account - the CPU will be installed and ready to go before shipping.


$7,600

Talos™ Storage Server (TALP8S050)

A complete Talos™ server with a CPU of your choice, 128 GB of DDR3 ECC RAM, LSI SAS controller, and two Western Digital 4 TB SAS drives, all installed in a heavy-duty 4U rack mount chassis with 24 3.5" hot swap SAS drive bays and redundant 1200 W power supplies! Comes pre-installed with either Debian or CentOS. Select the CPU by purchasing it as a separate item in the same order or under the same account - the CPU will be installed and ready to go before shipping.


$17,600

Complete Talos™ Workstation (TALP8W100)

A complete 12-core Talos™ workstation with 256GB of DDR3 ECC RAM, installed in a customized, heavy-duty chassis with your choice of an AMD® FirePro™ or nVidia® Tesla™ graphics card (see list). Also includes built-in 4TB RAID1 (2x 4TB enterprise SAS disks and LSI SAS controller), plus a pre-installed copy of Debian or CentOS to get you up and running in no time!

Ask a Question

Have a question not answered in the description above or in the Updates?

Ask Raptor Computing Systems a Question or Browse the Crowd Supply Knowledge Base

Credits

Raptor Computing Systems


Timothy Pearson

Senior Electrical Engineer

Subscribe to the Crowd Supply newsletter, highlighting the latest creators and projects: