Leverage ESP32-S3 AI capabilities with the ESP-DL library

ESP32-S3 is the first Espressif wireless processor with AI instructions, and ESP-DL library for ESP-IDF allows you to easily leverage those AI instructions using boards such as the ESP32-S3-DevKitC-1.

The ESP-DL library provides APIs for Neural Network (NN) Inference, Image Processing, Math Operations, and Deep Learning Models that make full use of ESP32-S3’s AI instructions with a 16-bit face recognition model running 6.25 faster, while the 8-bit model is 2.5 times faster than without acceleration.

ESP32-S3 AI ESP-DL library

The ESP-DL library can be used as a project component. For instance, it can be used as a submodule of ESP-WHO computer vision framework, by simply copying it to the esp-who/components/ directory.

The Model Zoo contains several pre-trained models for (human) face detection & recognition, and cat face detection, with more being developed including color detection and hand-pose detection.

Face detection esp32-s3 vs esp32-s2 vs esp32
ESP-DL face detection demo on ESP32, ESP32-S3 and ESP32-S3

Espressif Systems also provides tools to use your own models, and a convention tool allowing you to use models developed for TensorFlow, PyTorch, MXNetm, and others.

There may be even higher performance in the future, as besides acceleration with SIMD instructions, ESP-DL will be further developed with autoload/preload as well as DMA engine support to manipulated the data faster.

You’ll find the code, samples, and documentation on Github. The tricky part will be to get the ESP32-S3, as right now you’d need to request a sample directly from Espressif Systems. ESP32-S3 modules and development boards are slated to become available before the end of the year.

Share this:

Support CNX Software! Donate via PayPal or cryptocurrencies, become a Patron on Patreon, or buy review samples

Subscribe
Notify of
guest
The comment form collects your name, email and content to allow us keep track of the comments placed on the website. Please read and accept our website Terms and Privacy Policy to post a comment.
0 Comments
Advertisement