Several low power neural network accelerators have been launched over the recent years in order to accelerator A.I. workloads such as object recognition, and speech processing. Recent announcements include USB devices such as Intel Neural Compute Stick 2 or Orange Pi AI Stick2801.
I completely forgot about it, but Google also announced their own Edge TPU ML accelerator, development kit, and USB accelerator last summer. The good news is that Edge TPU powered Coral USB accelerator and Coral dev board and are going to launch in the next few days for respectively $74.99 and $149.99.
Edge TPU Module
- SoC – NXP i.MX 8M quad core Arm Cortex-A53 processor with Arm Cortex-M4F real-time core, GC7000 Lite 3D GPU
- ML accelerator – Google Edge TPU coprocessor delivering up to 4 TOPS
- System Memory – 1 GB LPDDR4 RAM
- Storage – 8 GB eMMC Flash memory
- Wireless Connectivity – Wi-Fi 2×2 MIMO (802.11b/g/n/ac 2.4/5GHz) Bluetooth 4.1
- 300-pin board-to-board connectors
- Dimensions – 48 x 40 x 5mm
- Storage – MicroSD slot
- USB – 1x USB Type-C OTG port, 1x USB Type-C power, 1x USB Type-A 3.0 host, and 1x Micro-B serial console
- Networking – Gigabit Ethernet port
- Video Out / In
- HDMI 2.0a (full size)
- 39-pin FFC connector for MIPI-DSI display (4-lane)
- 24-pin FFC connector for MIPI-CSI2 camera (4-lane)
- 3.5mm audio jack (CTIA compliant)
- Digital PDM microphone (x2) 2.54mm 4-pin terminal for stereo speakers
- GPIO – 40-pin Raspberry Pi style header with 3.3V power rail, 40 – 255 ohms programmable impedance, ~82 mA max current
- Power – 5V DC via USB Type-C port
- Dimensions – 88 x 60 x 24mm
A compact (25x25mm) 5MP camera module will also be offered as option.
The board will run Debian Linux, support TensorFlow Lite framework, and be programmable with Python, and C++ language support coming soon.
Coral USB accelerator is similar to the Intel Neural Compute Stick or Orange Pi Ai Stick but features Google Edge TPU ML processor instead:
- ML accelerator – Edge TPU ASIC designed by Google that provides high performance ML inferencing for TensorFlow Lite models
- MCU – Unnamed Arm 32-bit Cortex-M0+ microcontroller clocked at up to 32 MHz with 16 KB Flash memory with ECC, 2 KB RAM
- USB – 1x USB 3.1 (gen 1) port and cable (SuperSpeed, 5Gb/s transfer speed)
- Dimensions – 65 x 30 mm
The USB accelerator supports Debian Linux on the host CPU, TensorFlow Lite framework, and works with Raspberry Pi 3 board, and basically any 64-bit Arm or 64-bit x86 platform supported by Debian. Google claims their Edge TPU can execute state-of-the-art mobile vision models such as MobileNet v2 at 100+ fps in a power efficient manner.
I’ve been informed Google will showcase their new Edge TPU coprocessor, development board, and USB accelerator on Wednesday at the Tensorflow Dev Summit 2019. However, you’ll already find plenty of documentation, and resources such as pre-compiled models and the Edge TPU Model Compiler on Google Coral website, as well as on a dedicated AIY Projects page.
A screenshot of a page now removed shows the USB accelerator is expected to starting shipping on March 20th, and same thing for Coral development board. The SoM will be available separately to integrate into commercial project, but I could not find any pricing information at the time of writing.