megaAI

by Luxonis

Tiny-but-mighty 4K, 60 FPS camera solution for computer vision powered by Myriad X

Crowdfunding Page History

This page is an archive of the original crowdfunding campaign for this project. It may not be up-to-date with the latest updates and product availability. Return to the current project page.

$26,763 raised

of $15,000 goal

178% Funded! Order Below

Pledge Now

$20

Support Us!


$169

megaAI

One megaAI unit. Formerly named "Crowd Supply Edition megaAI".


$795

megaAI Five Pack

Includes five megaAI units. Save on shipping with megaAIs for you and all your friends.


$149

Educator Edition megaAI

Discounted megaAI, for educators and teachers only! Limited availability.


$10,000

Custom Feature Implementation

Work directly with the Luxonis team to implement a feature using DepthAI with the equivalent of one engineering month of our time. For example, our team recently implemented H.265 recording in one week! Luxonis reserves the right to refund and cancel any requests we feel are not possible within this scope.


$149

Early Bird megaAI

Get your megaAI at a $20 discount! Limited availability.


$199

Roadrunner megaAI

Can't wait for your megaAI? This expedited shipping version will ship to you as soon as the campaign ends! Limited availability.

Details

Recent Updates


As Featured In

Hackster News

"The compact module is powered by Intel's Myriad X neural processing unit (NPU), offering 4 TOPS of compute performance alongside 12 megapixel hardware JPEG encoding and hardware H.264 and H.265 encoding"

CNXSoft - Embedded Systems News

"... instead of just handling QVGA at around 15 to 18 fps, megaAI can supports inference at 4K resolution up to 30 fps."

CircuitDigest

"MegaAI becomes the best bet for engineers and researchers if they want to directly integrate by OEMs and expand the AI processing capability of their project."

Electromaker

"If you are looking for a truly tiny board for artificial intelligence (AI) and computer vision projects, megaAI from Luxonis is worth your attention."

LinuxGizmos.com

"Like the DepthAI USB module, the megaAI can work with any Linux, Mac, or Windows computer, but is primarily marketed as an add-on to the Raspberry Pi."

diarioelectronicohoy

"Tanto con el apartado de procesamiento, como con el puramente óptico, este módulo compacto para visión por computadora viene ya preprogramado para reconocer hasta una veintena de categorías de objetos."

megaAI with a US quarter for scale. Actual size: 43mm by 30mm

megaAI with a US quarter for scale. Actual size: 43 mm by 30 mm

The megaAI is a turn-key computer vision and artificial intelligence solution that combines and harnesses the four TOPS (Trillion Operations Per Second) of AI processing power with a beautiful 4K, 60 FPS camera for human/object tracking in a tiny, low-power, package. It’s perfect for hobbyists and researchers and is ready for direct integration by OEMs. It’s also compatible with our DepthAI ecosystem, and is therefore insanely easy to use.

Hardware Features

Unbelievably Simple Object Detection

The megaAI takes previously difficult computer vision tasks like real-time object detection and tracking and makes them as simple as plugging in a USB cable and running a Python script. Just clone the DepthAI git repository and run python depthai.py to see a live demonstration of MobileNetSSD being run on your host system. You can even record live 4K, 30 FPS video of everything the camera sees.

Object Tracking & Detection

Object localization is the capability to know what an object is and where it is in the physical world. The megaAI is able to accomplish this at 30 frames per second on a Raspberry Pi, without adding any load on the Pi.

The easiest-to-run net on megaAI is what we use as our test case: Object Detection on 20 classes (PASCAL VOC 2012):

  • Person: person
  • Animal: bird, cat, cow, dog, horse, sheep
  • Vehicle: aeroplane, bicycle, boat, bus, car, motorbike, train
  • Indoor: bottle, chair, dining table, potted plant, sofa, TV/monitor

Consequently, when you connect megaAI to a host and point the camera at these objects, you’ll see a bounding box with a label drawn around each object.

Pre-trained Detection & Tracking

Need other neural network models? There are many pre-trained models that will work right away, many are available directly from Intel for free. Swap the new model in to the included Python script and boom! You’re ready to go.

Some examples of cool megaAI-compatible models:

  • COVID-19 mask/no-mask detection
  • Age recognition
  • Emotions recognition
  • Face detection
  • Facial Landmark (e.g., corners of eyes, mouth, chin, etc.)
  • General object detection (20-class)
  • Pedestrian detection
  • Vehicle detection

Custom Detection & Tracking

If you want something custom, you can train your own models based on available/public datasets and then use OpenVINO to deploy them to DepthAI. See our documentation section on creating custom tracked objects.

Real-time H.264 & H.265 Encoding

Not only is megaAI a fast and power-efficient way to implement stock or custom recurrent neural networks, it’s also a real-time video encoder that compresses 4K H.265 video at 30 frames per second.

High Frame Rates, Low Power Consumption

Since megaAI does so much processing on its own (including optionally compressing video), the load on both USB and the CPU is lowered significantly, allowing Luxonis to achieve dramatically higher frame rates, bringing low-power hardware acceleration to any project:

Real time object detection with OpenVINO and Movidius

Pi 3B+, CPU OnlyPi 3B+, NCS2, OpenVINOPi 3B+, DepthAI, OpenVINO
MobileNetSSD (display on)5.88 FPS8.31 FPS25.5 FPS
MobileNetSSD (display off)6.08 FPS8.37 FPS25.5 FPS

(Raspberry Pi/NCS2 data courtesy of the awesome folks over at PyImageSearch)

Some Ideas For How To Use megaAI

  • Automatic 4K Filming - Start recording when only specific things or actions are seen. E.g., that perfect National Geograhic shot (of your housecat)
  • Agriculture/food processing - Check for good apples and bad apples, make note of apples harmed by pests for stat purposes
  • Health/safety - Are people wearing masks?? Detect unsafe conditions
  • Mining - Including mining for Legos - going through a pile of Legos to find the ‘gold’ one
  • Manufacturing - Run real-time defect detection, look for specific defects, and have the system get better over time

Movidius Myriad X, Unleashed

DepthAI, megaAI’s software, enables the use of the full power of the Myriad X. This was the sole mission of the DepthAI project originally and we achieved this through custom implementation at all layers of the stack (hardware, firmware, and software). After a lot of iteration and and collaboration what resulted was an efficient and easy-to-use system which takes full advantage of the four Trillion Operations Per Second (TOPS) vision processing capability of the Myriad X.

Hardware BlockOther Myriad X SolutionsLuxonis DepthAI
Neural Compute EngineYes Yes
SHAVE CoresYes Yes
Motion EstimationInaccessible Yes
Edge DetectionInaccessible Yes
Harris FilteringInaccessible Yes
Warp/De-WarpInaccessible Yes
MIPI ISP PipelineInaccessible Yes
JPEG EncodingInaccessible Yes
H.264 and H.265 EncodingInaccessible Yes

Comparison to Another Full AI/CV Solution

MetricmegaAI w/ Raspberry Pi*Intel NUC AI Kit
Picture Resolution12 MP (4056x3040)1 MP (1280x720)
Video Resolution4K720p
Easy Setup & DevelopmentYesNo
Efficient Data PathYesNo
Real TimeYesYes
Low LatencyYesYes
EmbeddableYesNo
ProductizableYesNo
CPU Free for User CodeYesNo
CPU UtilizationNear-zeroHigh
Hardware H.265 SupportYesNo
Hardware JPEG SupportYesNo
Hardware Feature Tracking SupportYesNo
Power6 W (max, including Pi)50 W (max)
Price$169 USD (during campaign)$879.95 USD

* A Raspberry Pi is not included with any megaAI product or pledge offered during this campaign.

Open Source - MIT Licensed

megaAI is an open source project. So if you want to build something off of it, do it!

We’ve open sourced hardware and software to allow you to do so:

Hardware: https://github.com/luxonis/depthai-hardware

Software:

Complete documentation on all the software

And even our documentation is open-source, so if you find an error you can submit a PR with the fix!

From Zero to Artificial Intelligence

It’s never been easier to get up and running with machine learning, computer vision, and artificial intelligence.

With megaAI it’s just a handful of steps before you’re up and running. The following video shows everything required with a Raspberry Pi.

For other systems (macOS, Windows, and Linux variants), it’s just as easy. How about training megaAI to detect custom objects?

That’s easy too. We provide free online training through Google Colab notebooks:

The below tutorials are based on MobileNetv2-SSD, which is an object detector which natively runs on DepthAI. A bunch of other object detectors could be trained/supported on Colab and run on DepthAI, so if you have a request for a different object detector/network backend, please feel free to submit a GitHub Issue! We’re constantly adding more (in fact as of this writing, we just got some new YOLO variants running).

Easy Object Detector Training: Open in Colab

The tutorial notebook Easy_Object_Detection_With_Custom_Data_Demo_Training.ipynb shows how to quickly train an object detector based on the Mobilenet SSDv2 network.

After training is complete, it also converts the model to a .blob file that runs on our DepthAI platform and modules. First the model is converted to a format usable by OpenVINO called Intermediate Representation, or IR. The IR model is then compiled to a .blob file using a server we set up for that purpose. (The IR model can also be converted locally to a blob.)

And that’s it, in less than a couple of hours you have an advanced proof of concept object detector that can run on megaAI to detect objects of your choice. But don’t take our word for it, keep reading for an example we built.

Example: COVID-19 Mask/No-Mask Training: Open In Colab

The Medical Mask Detection Demo Training.ipynb training notebook shows an example of a more complex object detector. The training data set consists of people wearing or not wearing masks for viral protection. There are almost 700 pictures with approximately 3600 bounding box annotations. The images are complex: they vary quite a lot in scale and composition. Nonetheless, the object detector does quite a good job with this relatively small dataset for such a task. Again, training takes around 2 hours. Depending on which GPU the Colab lottery assigns to the notebook instance, training 10k steps can take 2.5 hours or 1.5 hours. Either way, a short period for such a good quality proof of concept for such a difficult task. We then performed the steps above for converting to blob and then ran it on our DepthAI module.

Risks & Challenges

Manufacturing at scale is always a challenge, with problems occurring at high-volumes which were simply not experienced at smaller production. We will do our best to nimbly respond to these problems as they arise and keep to the schedule, while delivering megaAI at the standard of quality we at Luxonis would expect as customers.

We have already produced a first run of the megaAI boards, so our supply chain and manufacturing process has been tested and verified successfully. Of course, delays are possible with any manufacturing process, and we will communicate any issues with backers through regular updates.

Manufacturing

The megaAI is a ready-for-manufacture product. We delivered all four original DepthAI boards with additional features above and beyond the ones promised during that campaign. Not only that, but unlike some other crowdfunded campaigns, we shipped on time!

Logistics: Shipping & Fulfillment

The megaAI boards will be fulfilled in the following batches:

  • Quantity in first manufacturing batch: 500
  • Estimated delivery date of first manufacturing batch: 30 July, 2020
  • Quantity in subsequent manufacturing batches: 100
  • Delivery schedule of subsequent manufacturing batches: 30 August, 2020

NOTE: Roadrunner tier pledges will be shipped immediately at the conclusion of the campaign by Luxonis (based in USA). The rest of the campaign orders will be shipped using Crowd Supply’s fulfillment service. Domestic (within the USA) orders ship for free, while international shipments incur a shipping surcharge that is applied at checkout.

Thanks For Reading All That - Here’s Some Top Secret News

COMING SOON: A PoE version of megaAI!


Credits

Luxonis

Brandon quit his job at Ubiquiti leading the UniFi team in order to focus on embedded machine learning and computer vision. He misses the UniFi team. But he just had to try this, as he thinks it's the future!


Brandon Gilles


King-Top

Manufacturing Partner

Subscribe to the Crowd Supply newsletter, highlighting the latest creators and projects: