We covered the launch of Orange Pi AI Stick 2801 neural compute stick a few days ago, the first easily available Gyralcon Lightspeeur based USB stick, and noted that while the hardware was there, we had no details about software development kit and documentation at the time.
I’ve got some more information now. First, the company release an English presentation about the neural stick, and while it’s not technical documentation, it provides insights into what it is capable of, and an overview about the workflow.
More importantly, Shenzhen Xunlong Software also released Orange Pi AI Stick SDK and user manual for x86 PC, as well as cat/dog data and pre-trained models to get started.
However, if you want to perform training with your own data, you’ll need to purchase the stick plus PLAI model transformation and training tools sold on Aliexpress for $218 plus shipping, that’s $69 for the hardware, and $149 for the software tools. The company further explains that the tools support model decomposition of convolutional neural network (CNN) based on Caffe, and the training tool can train image, video, voice, and natural language into prototype to be loaded into the neural stick.
PLAI stands for People Learning Artificial Intelligence , and is an ecosystem of hardware and tools provided directly by Gyrfalcon, the ASIC vendor. Shenzhen Xunlong did not provide the full details about the tools, but the tools should be Plai Builder, a PyTorch based “full-stack” framework specially designed to quickly train and build neural network models for Lightspeeur and G.A.I.N series solutions from GTI (Gyrfalcon Technology Inc).
- Moving edge calculation
- Intelligent monitoring
- Smart toys and robots
- Smart home
- Virtual reality and augmented reality
- Face detection and recognition
- Speech Recognition
- Natural language processing
- Embedded deep learning device
- Cloud Machine Learning and Deep Learning System
- Artificial intelligence data center server
- Advanced assisted driving and autonomous driving
So lots of fun applications. If you are specially interested in Tensorflow, you’ll have to wait a little longer, as I understand support for the framework is still being worked on.
Jean-Luc started CNX Software in 2010 as a part-time endeavor, before quitting his job as a software engineering manager, and starting to write daily news, and reviews full time later in 2011.
10 Replies to “Orange Pi AI Stick 2801 Neural Compute Stick SDK & Documentation Released”
Thanks for the update! It looks a little disappointing because you would really need the software, and together it’s too expensive. I’ll wait for the Movidius 2 release and more info on it, it should be much more competitive because it comes with proper software. Otherwise the RK3399Pro is still in the pipeline.
Movidius NCS 2 is “only” 1 TOPS. This stick is 2.8 TOPS …
But it’s not clear if we’re talking about the same thing. We’d need objective benchmarks for that. I’m not sure, maybe Intel is talking about int8 inference and this one about int4 inference. Then you’d have to halve the numbers.
I have seen several sources now speak of 4 TOPS for the Movidius NCS2, like here the official distributor
The 1 TOPS according to this article refers to the Neural network engine itself, but there are also the Shave cores and additional images processing capabilities.
I think there need to be some real benchmarks to say in which application which one is better.
Those two links just reproduce the marketing materials from Intel (like I did), they have not done any testing.
Thank you for the info about this very interesting device.
I’m hoping Allwinner sees this and releases similar tools for the V5 AI engine.
Lindenis folks spot your post but not Allwinner folks.
Let’s hope so!
this model support tensorflow lite? i need an example code to test my 2801 please advise.