Rockchip RK3399 (aka OP1) SoC was launched in 2016 with an hexa core Arm Cortex A72/A53 processor, Mali-T860MP4 GPU, support for 4K video decoding, and high speed interfaces like USB 3.0 and PCIe, as well as Gigabit Ethernet. The processor is found in Chromebooks, TV boxes, development boards, and other devices.
The company has unveiled an upgraded “Pro” version of the processor at CES 2018. Rockchip RK3399Pro appears to have most of the same features as its predecessor but adds a neural network processing unit (NPU) delivering up to 2.4 TOPS for artificial intelligence and deep learning applications.
The company claims that compared to traditional solution, the computing performance of typical deep neural network Inception V3, ResNet34 and VGG16 models on RK3399Pro is improved by almost one hundred times, and power consumption is less than 1% than A.I. solutions implemented using GPU acceleration.
Based on the information provided in the chart above (source: elDEE on twitter), Rockchip RK3399Pro outperforms other high-end SoCs (for such tasks) including Apple A11, and Huawei Kirin 970, both of which also features an NPU, and even offers better performance than NVIDIA TX2.
RK3399Pro NPU supports 8-bit & 16-bit operations, is compatible with various AI software frameworks and APIs, including OpenVX and TensorFlow Lite/AndroidNN API, and comes with AI software tools capable of handling Caffe/TensorFlow models. An RK3399Pro hardware reference design can also be provided to speed up development, but no details were provided.
Jean-Luc started CNX Software in 2010 as a part-time endeavor, before quitting his job as a software engineering manager, and starting to write daily news, and reviews full time later in 2011.
17 Replies to “Rockchip RK3399Pro SoC Integrates a 2.4 TOPS Neural Network Processing Unit for Artificial Intelligence Applications”
I have to say, this is a very wise strategy, adding a NPU in the existing chip instead of a new one. RK3399 PRO is pin to pin with RK3399. So ROCK960 PRO is on the way 😀
@Vamrs did you get confirmation from RK that it’s pin-to-pin compatible? what about the functionality, did they change anything additionally to adding the NPU? did they say anything about price?
Do you already have samples or did Rockchip provide you with a devkit? If so, is it working as advertised in the table above?
Wondering it’s a in-house design or IP from other vendor(like ceva core in rv1108).
sorry for my ignorance but is 2.4TOPS good/average/poor compared to the other ASICs that have come out recently?
Kirin 970 NPU is said to offer 1.92 TOPS, and Apple A11’s Neural Engine can deliver 0.6 TOPS.
The new Myriad X should be 1.0 TOPS (10x Myriad 2 performance).
Tegra X2: 1.5 TOPS (single precision). I understand the latest NVIDIA Xavier SoC can do 30 TOPS, but that’s quite a different power envelop.
No. We haven’t got the real sample of rk3399 pro. I think it’s just announcement because CES is a good time to announce something new 🙂 I guess it’s still IP from third IP companies. The price for RK3399pro is very competitive, considering the availability and Rockchip’s open-source strategy now. I think RK3399pro will be a success.
CEVA NeuPro insided!
RK3399pro looks like delayed for some reasons, a dedicated NPU chip will be out first instead….
What are the units on that graph?
Are you aware of any board with this CPU?
* RockPro64 – https://www.cnx-software.com/2018/01/29/pine64-to-release-rockpro64-boards-based-on-rockchip-rk3399-and-rk3399pro-for-60-and-up/
* Rock960 AI – https://www.cnx-software.com/2018/03/19/96boards-unveils-a-i-developer-platforms-hikey-970-ultra96-rock960-pro-enterprise-edition/#rock960-pro-enterprise-edition
But actually available, no. I’ve read the processor has been delayed.
I have your blog on my feed 🙂 I read about that boards but I was looking to buy them and none is available to buy 🙁
We will release rk3399pro based board in Q4.
How is the development coming along? I’m gonna need one of these puppies for my next project.
Vamrs published an interesting update on the topic. https://www.96rocks.com/blog/2018/09/23/rk3399pro-update-and-rk1808-introduce/
Also discussed @ https://www.cnx-software.com/2018/09/24/rockchip-rk3399pro-details-rk1808-npu/ for reference/