Khadas VIM3 board based on Amlogic A311D processor with a 5TOPS Neural-network Processing Unit (NPU) launched last June. We’ve reviewed VIM3 with Android 9 shortly after launch, but until recently it was not possible to leverage the NPU since the software was not quite ready yet.
The goods news is that Khadas has now released the NPU toolkit for both VIM3, and the cheaper VIM3L boards.
The NPU toolkit contains the following directory:
- docs – Model conversion documentation
- acuity-toolkit – Model conversion tools
- linux_sdk – Linux SDK
- android_sdk – Android SDK
The toolkit works in host PCs running Ubuntu 16.04 or 18.04 with Tensorflow framework, and inference can run on both Linux and Android OS in Khadas VIM3/3L board. It includes an Inception v3 sample with 299×299 sample photos, among other demos. You’ll find documentation to get started with model conversion and inference in Linux on Khadas Wiki.
You can also watch the video demo below running Yolo v3 object detection model.
The less good news is that the NPU toolkit has licensing requirements from Amlogic and VeriSilicon (NPU Intellectual Property) which requires you to fill-up a form to apply for VIM3/3L NPU Toolkit with your contact details, project description, and order number.
The toolkit release was announced about two weeks ago in the forum, and it seems easy enough to get access to the toolkit.