Vision FPGA SoM

by tinyVision.ai

An FPGA-based SoM with integrated vision, audio, and motion-sensing capability

View all updates Aug 20, 2020

Campaign is Live!

by Venkat R

The Vision FPGA SoM campaign is now live!

Hello potential backers, thank you for signing up. This update covers the background and vision behind the Vision FPGA SoM. In case you missed it, do check out the AMA for the project and various other cool projects here.

Of all the various human senses, Vision is the one that supplies the most information about the world around us. Processing the huge data stream from our eyes (already compressed!) requires the largest portion of the human brain (in terms of size and energy) to process and make sense of. Vision is a key sense that is now being used by machines to see, as opposed to conventional cameras who’s primary job was to reproduce an image/video as faithfully as possible.

Vision is also the modality that is missing in most IoT devices due to high cost, power, and complexity as compared to other senses such as balance/motion (accelerometer/gyro) and hearing (Hint: olfactory sensors are another area ripe for picking!).

Machine vision is a term associated with the Cloud more often than with smaller battery powered devices. Machine vision may be defined as the ability to not just capture images but also extract meaning from them rather than the ability to accurately reproduce the scene, eg. "Dog" or "Package near door" rather than just the image of a dog or the porch.

The Cloud, while being easy to integrate with and providing extensive libraries/frameworks and almost indefinite compute, requires compromises of power to send images and receive information about the image, latency, and perhaps most importantly (but least prioritized!) privacy. There are a large number of use cases that can be enabled by enabling low power CV on such devices eg. toys that can respond to their "owners" faces, fire alarms that can detect the number of people in the room, and so on.

This project aims to bring together various components of machine vision: hardware, optics, algorithms and software into a common platform that will enable a significantly larger group of users to experiment with and incorporate CV into their devices. The FPGA Vision SoM supports makers with one-off experimentation while providing a path to higher volume products they may come up with.

Ideal users and problem solved

The ideal user for this module is one looking to incorporate vision into their device. eg. this may be a smart camera trigger that only responds when motion is detected in a particular region of the field of view.

As described above, CV for IoT/edge processing requires high cost, deep expertise in various aspects of CV such as HW, supply chain, SW, algorithms. This module integrates all these aspects and presents the user with a low-cost volume capable solution.

Why I undertook this project

At my previous employer (Qualcomm Inc.), I founded and eventually led an amazing team to develop a low power image processing chip/system from ground up. While this was revolutionary for its time (and even today) in terms of its low power consumption and other features, I came to the realization that there was a large gap between companies building chips and end users creating end products. I saw the need (and opportunity) to create not just low power/cost ASIC’s but the infrastructure around them to enable vision.

Cloud-based vision is not only a crowded space but also reasonably well developed. My North Star is to enable vision on IoT devices that tend to be highly constrained power/cost/size yet have potentially huge impact in the world. As a Google researcher Pete Warden put it "The future of ML is Tiny".

I invite you to participate with me in this quest by backing this project. Thank you!

About the Author

Venkat R

tinyvision-ai-inc  ·   San Diego, CA


$2,238 raised

of $8,000 goal

28% Funded

Pledge Now

$70

FPGA Vision SoM

One FPGA Vision SoM to play with! The price will increase once the campaign is over, so back us today!


$80

Vision FPGA SoM Breakout Kit

One Vision FPGA SoM and one Breakout Board.


$120

Vision FPGA SoM Dev Kit

One Vision FPGA SoM and Developer Board.


$125

Two FPGA SoM

Two FPGA Vision SoM's.


$620

Ten FPGA SoM

Pack of 10 FPGA Vision SoM's, at a 5% discount.


$14

SoM Breakout Board

The SoM breakout board brings all SoM pins to 2.54 mm pitch pins for breadboarding, can't do without it! SoMe assembly required to solder the 2.54 mm headers on. Note: SoM is not included.


$60

SoM Developer Board

One developer board that breaks out SoM IO with in-line LEDs, allows for USB power (with power monitoring) and programming, includes Pmod and Qwiic connectors, and has room for prototyping. Note: SoM is NOT included.

Credits

tinyVision.ai

tinyVision.ai works closely with clients to incorporate low power CV into their devices. We are enabling CV with hardware in the form of tightly integrated CV modules with a clean API.


Venkat Rangan


Emcraft Systems

Manufacturer

Pixart Imaging

Imaging

Himax

Component provider

Subscribe to the Crowd Supply newsletter, highlighting the latest creators and projects: