Numato Opsis: FPGA-based open video platform

$40,430 raised

of $8,725 goal

Funded! Order Now

Oct 26 2015

funded on

463%

funded

188

pledges

Product Choices

$399

Numato Opsis


$36

TOFE Low Speed IO Expansion Board


$65

TOFE Milkymist Compatibility Board

Details

An open platform for recording, routing, and manipulating HDMI and DisplayPort video signals.

As Featured In

Adafruit Industries

“Unlike the NeTV, the Opsis doesn’t contain an ARM SoC but as the FPGA is significantly bigger than available on the NeTV the functionality could be re-implemented using a soft core."

Xilinx

“If you need HDMI in/out, DisplayPort in/out, USB, and Gigabit Ethernet ports for your next project—not to mention a pretty darn good, video-capable FPGA—you still have five weeks to pledge your $349 for one of these bad boys.”

Hackaday

Hackaday

“Because everything’s open and it’s got an FPGA on board doing the video processing, you’re basically free to do whatever you’d like with the content in transit, so it could serve as an FPGA video experimenter board.”

CNXSoft - Embedded Systems News

“Beside being used as a video platform, the board can also be used for various other tasks as a Xilinx FPGA development board with high-speed transceivers, expansion I/Os and more.”

Tech The Future Logo

Tech The Future

"This allows for complex video recording and streaming setups."

Fortune

"... a powerful testament to how the democratization of FPGAs could change things."

The Numato Opsis is a powerful new FPGA-based open source video platform for videographers and visual artists. The Opsis board was designed to give the user complete control over high-speed video, enabling everything from real-time conference capturing solutions, to experimental visual art and even general FPGA-based video research.

  • A: HDMI Out 1
  • B: HDMI Out 2
  • C: HDMI In 1
  • D: HDMI In 2
  • E: DisplayPort Out
  • F: DisplayPort In
  • G: USB 2.0 Device / JTAG Programmer / UART Adapter
  • H: Expansion Port (TOFE, not PCI-Express compatible)
  • I: microSD (underside of board)
  • J: USB 2.0 OTG
  • K: Gigabit Ethernet

As a collaboration between the TimVideos.us live event streaming project and FPGA development board manufacturer Numato Lab, the Opsis is the ideal device for the HDMI2USB.tv video capturing firmware, which allows for “fool-proof” video recording from any computer. Enabling direct acquisition of video streams in realtime to a computer through the USB 2.0 interface or sent over the network through the Gigabit Ethernet interface, the Opsis is a vital component within the complete conference recording solution envisioned and pioneered by the TimVideos.us project.

Example Applications

The Opsis is flexible and powerful enough to have a large number of use cases, many of which we probably haven’t considered. That said, we had certain use cases in mind when we designed the system.

Running HDMI2USB Firmware

The Opsis was designed to run the HDMI2USB firmware developed by the TimVideos.us project. This firmware makes it easy to build automated conference/event recording systems.

The diagram below shows one such simple scenario. The HDMI output from the laptop is fed into the Opsis, which forwards it to an external monitor and simultaneously allows another computer to capture the output via the USB 2.0 interface. The HDMI2USB.tv firmware emulates a standard UVC webcam, allowing any video software, such as Skype, Google Hangouts, or WebRTC, to then send it to an online audience.

A simple setup

A more complex scenario is shown below. The Opsis is used to feed the output from a presenter’s laptop onto both a large projection screen and a private “confidence screen” for the speaker (probably at the foot of the stage). The speaker’s dramatic facial expressions are also captured by a HDMI camera. Using the USB interface, a capture computer is able to switch between the two inputs and rebroadcast online.

A setup for recording a conference or user group

The HDMI2USB.tv firmware project has experimental support for using the Gigabit Ethernet interface as an alternative capture interface and is developing algorithms for hardware-based mixing and scaling, such as picture-in-picture.

General-purpose FPGA Development Platform for Video

In addition to running the HDMI2USB firmware, the Opsis can be used as a powerful FPGA development platform. The Xilinx Spartan-6 LX45T FPGA on this board can hold extremely large designs and can be used with the free Xilinx ISE Webpack software. The 2 Gbits (256 Megabytes) of onboard DDR3 SDRAM allow ample data storage accessible at high speeds. Onboard USB 2.0 and Gigabit Ethernet controllers allow high-speed, high-bandwidth connectivity to workstations and the network. With a USB host stack, the built-in USB OTG controller can connect to a wide variety of peripherals, such as keyboards, mice, cameras, and other USB devices. The programmable USB device controller can act both as a JTAG programmer and as a serial converter to be used as a debug console to assist development and debugging. See how the Opsis compares to other boards in the chart below.

Comparison
Opsis miniSpartan6+ Mixxeo Atlys Nexys Video Anvyl CVK 2.0 AVDB
Make Numato ScarabHardware M-Labs Digilent Digilent Digilent TED OmniTek
License Open Open Open Closed Closed Closed Closed Closed
Cost USD $349 USD $105 no stock USD $419 USD $499 USD $539 USD $2,995 USD $999
FPGA
Fab Xilinx Xilinx Xilinx Xilinx Xilinx Xilinx Xilinx Altera
Family Spartan-6 Spartan-6 Spartan-6 Spartan-6 Artix-7 Spartan-6 Spartan-6 Cyclone V
Part LX45T LX25 LX45 LX45 XC7A200T LX45 LX150T GT
Memory
Type DDR3-1600 166MHz SDRAM DDR1-400 DDR2-800 DDR3-1600 DDR2-800 DDR3-1600 DDR3-1600
Size 256MB 32MB 2x 64MB 128MB 256MB 128MB 128MB 2x 128MB
HDMI
Inputs 2 1 4 2 1 1 1 1
Outputs 2 1 1 [0] 2 [1] 1 1 1 1
CEC Support All Ports No No No No No No No
Hotplug Ctrl All Ports No All Inputs No No No No No
VGA Out Expansion 0 1 Expansion Expansion 0 Expansion 0
DisplayPort
Inputs 1 0 0 0 0 0 1 1
Outputs 1 0 0 0 0 0 1 1
Dual mode [2] Yes N/A N/A N/A N/A N/A ? Yes
USB 2.0
Device FX2[4] and UTMI OTG No No FX2[3] No FX2[3] No No
Host UTMI OTG No No HID only HID only HID only No No
JTAG Yes [4] Yes Yes Yes [3] Yes Yes Yes Yes
UART Yes [4] Yes Yes Yes Yes Yes Yes Yes
Ethernet
Speed Gigabit None 100Mbit Gigabit Gigabit 100Mbit Expansion Gigabit
Unique MAC Yes N/A No No Yes No N/A Yes
microSD Yes Yes Yes No Yes No No No
Config Storage 16 Mbyte SPI 8 Mbyte SPI 32 Mbyte PROM 16 Mbyte SPI 32 Mbyte SPI 16 Mbyte SPI 16 Mbyte SPI 2x 32 Mbyte SPI
Audio Expansion Yes No Yes Yes Yes Expansion Yes
High-Speed Expansion TOFE No No VHDCI FMC LPC No 3x FMC LPC, 1x FMC HPC No
PMOD Connectors Expansion 0 0 1 [1] 5 7 0 0
  • [0]: The output is a DVI output, not a HDMI output.
  • [1]: The second HDMI output is on a “Micro‑D” connector and shares pins with the PMOD header. Either the second HDMI output or the PMOD header may be used.
  • [2]: Dual mode DisplayPorts allow connecting HDMI (or DVI) using a simple passive adapter that adjusts for the different connector and the lower voltages used by DisplayPort.
  • [3]: The FX2 can operate as USB JTAG programmer or high-speed USB Device emulation. Configuration can be switched via loading firmware from host computer but this isn’t supported by Digilent.
  • [4]: The FX2 can operate as both a USB UART and USB JTAG programmer or high-speed USB Device emulation. Configuration can be switched via loading firmware from host computer.

Fun with High-Speed Transceivers

Opsis has four high-speed transceivers (officially known as GTP transceivers in Xilinx’s documentation) capable of running up to 3.2 Gb/s per transceiver. Opsis provides an aggregate bandwidth of slightly more than 12Gb/s when the four transceivers are combined. These transceivers can be used to implement a variety of high-speed serial protocols such as Serial ATA, Aurora, Gigabit Ethernet, PCI Express, DisplayPort, and XAUI. The FPGA on Opsis (XC6SLX45T) has one built-in PCI Express endpoint block that allows easy implementation of a PCI Express endpoint using Xilinx’s Spartan-6 FPGA Integrated Endpoint Block for PCI Express IP.

The high-speed transceivers are broken out into two dual-mode compatible DisplayPort connectors. This makes implementation of both DisplayPort sink and source easy without external adapters. The dual-mode compatibility also allows the implementation of high-speed HDMI with cheap, readily available adapters. Other protocols, such as PCI-Express, may be implemented by using appropriate high-speed transceiver breakout solutions.

The transceivers can also be used as a high-speed communication method between multiple Opsis boards (in a daisy chain configuration) allowing the possibility for the creation of large matrix configurations using cheap and readily available DisplayPort cables.

The dual-mode DisplayPort interface enabled by the high-speed transceivers nicely compliments the already extensive video support and extends the reach of the Opsis into some of the highest resolution video formats previously unavailable on an open platform.

Video DJing, Video Art Installations, and Live Video Effects

The same features which make the Numato Opsis an excellent platform for video development and an essential part of the TimVideos capture system also make the board awesome for anyone doing video-based art or live video effects such as Video DJing.

When in 2010, the Milkymist project launched the Milkymist One (M1) hardware platform and Flickernoise software, a system for visual effects with the ability to power high-definition video DJ projects, video art installations and live video effects projections was finally available! The Milkymist hardware did all the processing with the powerful onboard FPGA, processing every pixel, giving exceptional control and customization possibilities. Sadly, with the M1 hardware is no longer available and the second generation Mixxeo hardware was not turned into a finished product. With M-labs now concentrating on advanced quantum physics it seemed that the promise of an open, advanced, video mixing platform had ended.

The Numato Opsis hardware has a large amount in common with the Milkymist developed hardware, being built around the same FPGA core and designed for high-speed video manipulation. With support for the Opsis board currently being added to the MiSoC firmware, the Opsis makes a great candidate to fulfil the vision of the original Milkymist platform.

Features & Specifications

  • FPGA:
    • Xilinx Spartan-6 S6LX45T
  • Memory:
    • 256 Megabytes of DDR3-1600 RAM
  • HDMI:
    • inputs: 2
    • outputs: 2
    • resolution: 1080p30, 720p60, 1280×1024@60Hz
  • DisplayPort:
    • inputs: 1
    • outputs: 1
    • resolution: up to 4096 × 2304 × 30 bpp @ 30 Hz
    • compatible with dual-mode DisplayPort / DisplayPort++ protocol
  • Storage:
    • microSD card holder
    • 128-Mbit SPI flash for configuration data
  • USB 2.0 Device:
    • Cypress FX2 chipset supported by fully FOSS toolchain
    • real-world transfer rates of 30-40 Megabytes/second
    • serves also as a USB JTAG programmer and a USB UART adapter
  • USB 2.0 OTG:
    • supports both host and device operation
    • compatible with many USB devices (e.g. keyboards and flash drives)
  • Gigabit Ethernet:
    • unique MAC address
  • Expansion:
    • TOFE
    • PCI-Express connector (not signal-compatible)
    • 19 differential, length-matched pairs
    • 3.3V and 12V power rails
    • I2C interface for expansion board auto-detection and configuration
    • dedicated I/O bank on FPGA reduces peripherals conflict
    • access to global clock signals
  • Dimensions:
    • standard mini ITX mounting
  • Default Firmware:
    • demo functionality; USB controller set to be a USB JTAG programmer
  • License:
  • Reference:

Expansion Connector

The Opsis is also the first device to have Tim’s TOFE interface for extra I/O board expansion. The TOFE interface dramatically reduces the cost of high-speed I/O functionality by taking inspiration from the PCI-Express standard and repurposing its connectors and mechanical specifications.

TimVideos and Numato are committed to developing expansion boards to add new features (such as VGA capture) to the Opsis board through the TOFE connector. We also plan to create simple adapter boards to other existing expansion I/O standards such as PMOD and the Digilent VHDCI.

We hope that the significantly reduced cost of the TOFE interface will also enable the community to create new expansion boards we haven’t even dreamt of yet!

Expansion Connector Interface Standard Comparison
TOFE Digilent VHDCI FMC LPC FMC HPC Altera HSMC
Open Specification Yes None No No Yes
Autodetect and Configuration Interface SMBUS or JTAG [5] None JTAG or SMBUS JTAG or SMBUS JTAG or SMBUS
Power 12V and 3.3V 3.3V or 2.5V 12V, 3.3V and adjustable 12V, 3.3V and adjustable 12V and 3.3V
Transceiver Pairs Up to 14 RX and 14 TX 0 0 Up to 10 Up to 8 RX and 8TX
LVDS Pairs
Total Up to 34 22 Up to 34 Up to 80 Up to 18 TX and 18 RX
IO Pairs Up to 34 [6] 22 ? ? Up to 16 TX and 16 RX
Clock Pairs Up to 7 [6] 2 ? ? Up to 2 TX and 2 RX
Additional low speed IO 11 0 ? ? 4 x IO, 2 x CLK
Connector
Motherboard PCI - Express ~$1 USD VHDCI ~$8 USD Low Density FMC ~$30 USD High Density FMC ~$80 USD HSMC ~$5 USD
Daughterboard None ~$0 USD VHDCI ~$8 USD Low Density FMC ~$30 USD High Density FMC ~$80 USD HSMC ~$5 USD
  • [5]: The JTAG interface can be configured as JTAG or 2 x LVDS IO pairs.
  • [6]: 7 of the IO pairs can be configured as clock pairs or general IO pairs.

The Nitty Gritty Details

We’ve written an extensive video information FAQ. Here’s the synopsis:

  • The HDMI connectors support resolutions with equivalent bandwidth of SXGA @ 60Hz (1280×1024 @ 60Hz progressive), which includes:
    • XGA@85Hz (1024×768 @ 85Hz progressive)
    • 1080p30 (1920×1080 @ 30Hz progressive)
    • 1080i60 (1920×1080 @ 60Hz interlaced)
    • 720p60 (1280×720 @ 60Hz progressive),
    • but not 1080p60 (1920×1080 @ 60Hz progressive)
  • The DisplayPort connector supports resolutions up to a bandwidth of ~12Gbit/s which include extremely high resolutions around 4096 × 2160 @ 24Hz.
  • The DisplayPort connector is dual-mode enabled and thus can operate as high speed HDMI ports using cheap adapters. When operating in HDMI modes, many high resolutions up to 3840 x 2160 @ 30Hz should work.

Free as in Freedom

This board is designed for users who care about free and open source software and hardware development, and/or want to modify and extend their hardware. The schematics and PCB layout are designed using KiCad, a set of free and open source tools for creating PCBs.

The HDMI2USB firmware, which includes code for the FPGA and the Cypress FX2, is free and open source. Code samples for the FPGA are under development and there is a very good library for developing code for the FX2 firmware that can be used in conjunection with a free and open source compiler.

The latest HDMI2USB firmware is built around the MiSoC firmware. We are also working on adding support to MiSoC for the Opsis board upstream. MiSoC provides truly open source implementations of essential functionality, such as high-speed memory controllers, central processing units, and much more without using any restrictive third party IP blocks normally required even by open source firmware. MiSoC is a high performance, flexible and lightweight solution to build system-on-chips for various applications, and is based on Migen. Migen is a Python-based tool that helps automate the VLSI design process.

Unfortunately, development on the Opsis, as with all other FPGA boards, requires the use of proprietary tools for programming the FPGA. In this case, the tools are the free (as in beer) Xilinx ISE Webpack software.

Who are we?

The Numato Opsis FPGA-based video development platform is a collaboration between Numato and the TimVideos.us project.

TimVideos.us is a group of exciting projects which together create a system for both recording and streaming live events for conferences, meetings, user groups and other presentations. We hope that, through our projects, the costs and expertise currently required to produce live streaming events will be reduced to near zero. We wish to develop a system where everyone has the ability to record presentations and host live remote participants across the globe.

Tim Ansell is the founder of the TimVideos.us project and lacks an imagination when naming things. Having been involved in FOSS since 1998, he got involved with conferences like Linux.conf.au before starting the PyCon AU conference. After getting frustrated with the lack of open high-definition video recording systems he started the TimVideos.us project in 2011. He was inspired by Bunnie Huang’s NeTV project to tackle the idea of creating open capture hardware which resulted in the HDMI2USB.tv project.

Numato Lab has been designing and manufacturing FPGA and Microcontroller based products and solutions, catering to a wide variety of demography from hobbyists to academics to industries. Numato has designed and manufactured many open source cost effective FPGA designs based on Xilinx Spartan 3 and Spartan 6. We believe strongly in open source hardware and sharing knowledge thus making technology available to everyone.

References

Ask a Question

Have a question not answered in the description above or in the Updates?

Ask Numato Lab a Question or Browse the Crowd Supply Knowledge Base

Credits

Numato Lab

We design and manufacture products that help engineers, students, and industry learn, design, and implement embedded systems and other electronic systems.


Tim Ansell

Thomas

Subscribe to the Crowd Supply newsletter, highlighting the latest creators and projects: