ToyBrick RK3399Pro Board Shown to Outperform Jetson Nano SBC

NVIDIA created a lot of buzz when they released $99 Jetson Nano SBC featuring a 128-core Maxwell GPU, and said to deliver 472 GFLOPS of compute performance for running modern AI workloads with a power consumption of around 5 watts.

But Jetson Nano is not the only low cost platform to deliver high performance at low power for AI workloads, as for example Rockchip RK3399Pro (RK1808 NPU) found in boards such as Toybrick RK3399Pro is said to deliver 3 TOPS for INT8, 300 GOPS for INT16, and 100 GOPS for FP16 inferences.

Those operations per second numbers can be confusing and misleading, so it’s important to check out the performance of actual neural network models, and Rockchip did provide some RK3399Pro benchmarks last year for Inception V3, ResNet34 and VGG16 models comparing the results to Apple A11, Huawei Kirin 970, and NVIDIA Jetson TX2. However, ideally you’d want result from third parties, and Chengwei Zhang got hold of a Toybrick board, and explain in details how to run Inception V3 Keras model on the board in his blog.

Toybrick RK3399Pro
Toybrick RK3399Pro

There are basically two main steps:

  1. Freeze Keras model to TensorFlow graph and creates inference model with RKNN Toolkit. To be done in a powerful Linux computer instead of the target board for performance reasons.
  2. Load the RKNN model on an RK3399Pro dev board and make predictions.

As a side note, Toybrick team put the Android source code in Github using a manifest file, instead of just providing the usual 6GB tarballs. That means you can just retrieve the code as follows:


The tarball is also available on Baidu in case you run into problems with Github.

Chengwei goes into details about the two steps described above, so I’ll skip right the the final results. Toybrick RK3399Pro board achieves an average FPS of 28.94, even faster than Jetson Nano’s 27.18 FPS running a much smaller MobileNetV2 model. The Inception V3 model is way more complex than MobileNet V2, so we can expect a larger difference between the two boards for identical models.

For reference, Rockchip reported VGG16 ran at 50 fps on RK3399Pro while running at 32 fps on the Jetson TX2 with a 256-core Pascal GPU, and 86 fps vs 82 fps for Resnet50 as shown in the older chart below.

Rockchip-RK3399Pro

The downside is that Toybrick RK3399Pro is much more expensive than Jetson Nano, since the 3GB RAM version sells for $249, and the 6GB RAM model for $299 on VAMRS website. Hopefully, a vendor will come up with a cheap RK3399Pro board, or better with a Rockchip RK1808 board that should offer similar inference performance at a much lower cost.

Thanks to Jon for the tip.

Share this:

Support CNX Software! Donate via cryptocurrencies, become a Patron on Patreon, or purchase goods on Amazon or Aliexpress

ROCK 5 ITX Rockchip RK3588 mini-ITX motherboard
Subscribe
Notify of
guest
The comment form collects your name, email and content to allow us keep track of the comments placed on the website. Please read and accept our website Terms and Privacy Policy to post a comment.
12 Comments
oldest
newest
piotrasd
piotrasd
5 years ago

Comparison of latest RK3399 with 2 year old apple is little not fair 😉 if I good remember that was one of the first CPU with NPU, release when no body before offer that in mobile phones CPU.

CPU A12 – got score for ResNET50 – 147 and for inceptionV3 84. and there we talking about phone unit – but RK3399 on have load could eat 10W so better just compare to this same class of CPU – like A12X from iPad … but then it will be smashed

theguyuk
theguyuk
5 years ago

Like for like comparison is what is required. How much does CPU A12 , A12X device cost?

Jon Smirl
5 years ago

These RK3399Pro boards should come down in price. It should be possible to make one for $100 depending on RAM/flash configuration. A RK1808 USB stick is also an alternative. I think we’ll see RK1808 USB sticks for under $25. And Rk3399 – not Pro boards are already available for under $70. So total is under $100. The current boards are expensive because they are new, and because they are loaded with 6GB RAM and flash. Note that the AI core is in the RK1808 and the RK1808 is $6. You are going to see $30 SBCs shortly that out perform… Read more »

clement
clement
5 years ago

ROCKPro64 2GB Single Board Computer is 60USD but there is no storage

Jon Smirl
5 years ago

8GM EMMC module for ROCKPro64 is $12

Jon Smirl
5 years ago

Jetson Nano Module is $129. https://developer.nvidia.com/embedded/buy/jetson-nano

TB-96AIoT RK1808 module with same RAM/flash is $119.

But there is a lot of room for price cuts in the TB-96AIoT module. The BOM cost for that module is under $50.

TLS
TLS
5 years ago

Everyone wants their cut, the bigger the better…

Nobody Of Import
5 years ago

Toybrick’s not the only one with a 3399Pro offered. They’re just more expensive than some of the other offerings.

blu
blu
5 years ago

Just a correction: Jetson nano is 5W only in conservative-power mode; at full power it’s 10W or a tad above.

tkaiser
tkaiser
5 years ago

The new Asus Tinker Edge T and CR1S-CM-A SBC will be both equipped with an NXP i.MX 8M and Google’s Coral Edge TPU.

Jon Smirl
5 years ago

$199?

Boardcon Rockchip RK3588S SBC with 8K, WiFI 6, 4G LTE, NVME SSD, HDMI 2.1...