This project is coming soon. Sign up to receive updates and be notified when this project launches.
The Vision FPGA SoM is an iCE40 5K FPGA based System on Module that integrates a low power qVGA vision sensor, 3 axis accelerometer/Gyroscope and an I2S MEMS microphone in a small form factor (3 cm x 2 cm).
We designed the device with the following thoughts in mind:
The modular concept is summarized in a talk given at a recent tinyML meetup.
Image sensor options:
One Knowles MEMS I2S microphone, expandable to a stereo configuration.
Invensense IMU 60289 6-axis Gyro/accelerometer
Four GPIO, programmable IO voltage
4 wire SPI host interface with programmable IO voltage
Flexible power options:
Supports the Lattice SensAI toolchain using Tensorflow/Caffe/Keras for model development, quantization and mapping to the SensAI Neural Network engines.
Small size: 2cm x 3cm
The Developer Kit: The Developer kit breaks out all pins and provides USB connectivity for programming/debug, power measurement over I2C, LED’s, additional microphone, IR LED’s for illumination, PMOD expansion header, and a small prototyping area.
|Vision SoM||Developed, in Design Verification & Testing (DVT)||The star of this campaign!|
|Developer kit||Developed, in DVT||Uber dev kit with all features exposed!|
|Breakout board||Prototype completed||Passive board breakout to 2.54mm pitch headers for quick prototyping|
|Gateware||Under development||Verilog FPGA code|
|SW API||Under development||SPI based API to enable developers to control the provided example design and push models into it as well as retrieve NN inferences.|
|Brainware||Under development||Google Colab training framework to enable developers to train their own models and deploy on the SoM.|
|NN models||Completed||Object (face) detection and audio classification are the first models to be developed.|
|BLE/Wifi dongle||Prototyped||Adapter with a LiPo battery that attaches to the SoM connector to form a complete system|
Want to participate? We are looking for developers to get involved with the FPGA code as well as SW and Neural network training, please join the Discord channel!
Vision FPGA SoM on the SoM breakout board.
Hello potential backers, thank you for signing up! We need your help to define the project's future! We invite you to fill out this short survey to help guide us. Read the full update.
We're doing an AMA! If you are interested in this project and have any questions, or just want to learn more about Vision FPGA SoM, come join us tomorrow: March 25th 2020 at 1pm PDT. Read the full update.
Hello potential backers, Thank you for signing up! We've been working on many fronts and spreading the word about the SoM over the past couple of months since you signed up to be potential backers of this project. Heres an update on the many happenings in SoM-land. Read the full update.