DepthAI Brings AI plus Depth to the Raspberry Pi (Crowdfunding)

Edge computing on the Raspberry PI has been a bit of ups and downs, especially with everyone gearing for AI in everything. The Raspberry Pi, on its own, isn’t really capable of any reliable AI applications. Typical object detection on the Raspberry Pi would get you something around 1 – 2 fps depending on the nature of your model and this because all those processing is done on the CPU.

To address this poor performance of AI applications on the Raspberry Pi, AI Accelerators came to the rescue. The Intel Neural Compute Stick 2 is one such accelerator capable of somewhere around 8 – 15 fps depending on your application. The NCS2, which is based on the Myriad X VPU technology, offers so much more than the compute stick delivers, and this is something that the team behind DepthAI has exploited to create a powerful AI module for edge computing called DepthAI.

DepthAI Embedded Platform
DepthAI Embedded Platform

It is one thing to do object detection. Still, it’s another thing to do localization in the physical world, an essential feature for mobile robots, and this is something DepthAI is gearing to deliver. DepthAI is an embedded platform for combining Depth and AI, which is built around Myriad X VPU.

DepthAI is an embedded platform conceived by Luxonis, and they participated in the Microchip Get Launched 2019 design competition and the Hackaday Price for 2019. Initializing conceived from the desire to improve bike safety of building an artificial intelligence bike light that detects and prevents from behind crashes.

DepthAI is a platform built around the Myriad X to combine depth perception, object detection (neural inference), and object tracking that gives you this power in a simple, easy-to-use Python API.

At the core of the device is the Myriad X SOM, the same module powering the Intel Neural Compute Stick 2. Unlike the compute stick, some of the capabilities of the Myriad aren’t being utilized; for example, the MIPI Lanes are unused and some of the other features, as shown in the image below.  Through custom integration, DepthAI enables the full power usage of the Myriad X, which takes full advantage of the four trillion-operations-per-second vision processing capability of the Myriad X.

DepthAI
Unleash the Full Power of the Myriad X

Object localization in the physical world is possible on the module at 25FPS where the x, y, z (cartesian) coordinates in meters can be gotten. This feature is possible through the attachment of two MIPI cameras sparsed apart. It also comes with an accompanying RGB Camera.

DepthAI – Object Localization

DepthAI comes as a system on a module with the idea of making it possible to integrate into any custom embedding platform. Aside from the module, DepthAI is also available in 3 editions:

  1. Fully-integrated solution with on-board cameras that work upon boot-up for easy prototyping (Powered by the Raspberry Compute Module 3+)
  2. Raspberry Pi HAT with modular/remote cameras.
  3. USB3 interface that’s usable with any host.
DepthAI Editions
DepthAI Editions

The Raspberry Pi Compute Module Edition comes with everything needed: pre-calibrated stereo cameras on-board with a 4K, 60 Hz color camera, and a microSD card with Raspbian and DepthAI Python code automatically running on bootup. The Pi HAT Edition allows users to attach the module to the Raspberry Pi has a HAT, and the cameras mounted on the HAT itself. The USB3 Edition will enable you to use DepthAI with any platform through only a single USB connection.

Some of the features possible with DepthAI are:

  • Object Localization
  • Object Detection
  • Depth Video or Image
  • Color Video or Image
  • Stereo Pair Video or Image

DepthAI works with OpenVINO for optimizing neural models, just like with the NCS2. This allows you to train models with any popular frameworks such as TensorFlow, Keras, etc. and then use OpenVINO to optimize them to run efficiently and at low latency on DepthAI/Myriad X.

DepthAI is currently crowdfunding on Crowd Supply. The SoM is available for $99, the USB3 Edition for $149, the HAT Edition for $149, and the Complete Version for $299. If the campaign is successful, shipping is expected from February 2020.

Share this:

Support CNX Software! Donate via cryptocurrencies, become a Patron on Patreon, or purchase goods on Amazon or Aliexpress

ROCK 5 ITX RK3588 mini-ITX motherboard
Subscribe
Notify of
guest
The comment form collects your name, email and content to allow us keep track of the comments placed on the website. Please read and accept our website Terms and Privacy Policy to post a comment.
4 Comments
oldest
newest
Malik Cissé
4 years ago

Thank you Ayo for this very interesting post.

Jon Smirl
4 years ago

Lindenis V5 board been shipping dual 4K camera binocular depth vision with AI for a couple years now.
http://www.lindeni.org/lindenis-v5.html

Brandon Gilles
4 years ago

Brandon from Luxonis here!

Thanks, Ayo Ayibiowu, for covering DepthAI! Much appreciated, and any/all questions welcome here, on our forum at discuss.luxonis.com, or via my email at brandon at luxonis dot com.

Thanks again,
Brandon

Boardcon Rockchip and Allwinner SoM and SBC products