Rockchip RK3399Pro was expected to be the first processor from the company featuring an NPU (Neural Processing Unit) to accelerate artificial intelligence workloads, but eventually went through a redesign, and the community found it gave birth to RK1808 NPU by looking at a device tree file in the Linux kernel.
Rockchip has now made the NPU official at CES 2019, and we now know a little bit more.
Here are the specifications shared by the company:
- Dual-core Arm Cortex-A35 CPU
- NPU computing performance up to 3.0TOPs supporting INT8/INT16/FP16 hybrid operation
- VPU supporting 1080P video codec
- Built-in 2MB system-level SRAM
- Display – MIPI/RGB video output
- Camera – MIPI/CIF/BT1120 Camera video signal input with built-in ISP
- Microphone array support with hardware VAD function for low-power monitoring and far-field wake-up
- Audio output
- PWM/I2C/SPI /UART
- PCIe interface
- Support for Gigabit Ethernet and external WiFi/Bluetooth modules
- Manufacturing – 22nm FD-SOI process
It shares many similar functions as standard media SoCs, but it appears to lack a GPU for example, it’s not a platform capable of handling advanced user interface with 3D graphics.
The NPU is compatible with TensorFlow, MXNet, PyTorch and Caffe frameworks, and the company provides a Linux system AI application development SDK supporting C/C++ and Python programming languages.
Rockchip RK1808 solution is expected to end up in various AI applications in the domain of security, education, automobile, smart wearable devices, home appliances, storage, etc.. thanks to AI functions including voice wake-up, speech recognition, face detection and attribute analysis, face recognition, posture analysis, target detection and recognition, image processing, an so on.
Jean-Luc started CNX Software in 2010 as a part-time endeavor, before quitting his job as a software engineering manager, and starting to write daily news, and reviews full time later in 2011.