Testing AI and LLM on Rockchip RK3588 using Mixtile Blade 3 SBC with 32GB RAM

mixtile blade 3 review RK3588 AI LLM

We were interested in testing artificial intelligence (AI) and specifically large language models (LLM) on Rockchip RK3588 to see how the GPU and NPU could be leveraged to accelerate those and what kind of performance to expect. We had read that LLMs may be computing and memory-intensive, so we looked for a Rockchip RK3588 SBC with 32GB of RAM, and Mixtile – a company that develops hardware solutions for various applications including IoT, AI, and industrial gateways – kindly offered us a sample of their Mixtile Blade 3 pico-ITX SBC with 32 GB of RAM for this purpose. While the review focuses on using the RKNPU2 SDK with computer vision samples running on the 6 TOPS NPU, and a GPU-accelerated LLM test (since the NPU implementation is not ready yet), we also went through an unboxing to check out the hardware and a quick guide showing how to get started […]

Mixtile Core 3588E SoM review – Part 2: Ubuntu 22.04, hardware features, RK3588 AI samples, NVIDIA Jetson compatibility

Mixtile Core 3588E Ubuntu 22.04 review

We’ve already had a look at the Mixtile Core 3588E NVIDIA Jetson Nano/TX2 NX/Xavier NX/Orin Nano compatible Rockchip RK3588 SO-DIMM system-on-module in the first part of the review with an unboxing and first boot with an Ubuntu 22.04 OEM installation. I’ve now had more time to play with the devkit comprised of a Core 3588 module in 16GB/128GB configuration and a Leetop A206 carrier board with low-level features testing, some benchmarks, multimedia testing with 3D graphics acceleration and video playback, some AI tests using the built-in 6 TOPS NPU and the RKNPU2 toolkit, and finally I also tried out the system-on-module with the carrier board from an NVIDIA Jetson Nano developer kit. Ubuntu 22.04 System info We had already checked some of the system information in the first part of the Mixtile Core 3588E review, but here’s a reminder:

I also ran inxi to check a few more details. […]

Mixtile Core 3588E development kit review – Part 1: Unboxing and first boot

Mixtile Core 3588E development kit review

Mixtile Core 3588E is a Rockchip RK3588 SO-DIMM system-on-module with up to 32GB LPDDR4 and 256GB eMMC flash that follows NVIDIA Jetson Nano, TX2 NX, Xavier NX, and Orin Nano form factor and should work with any board made for Jetson SO-DIMM modules. We first covered the module last April, but Mixtile is now shipping their Rockchip RK3588 module and sent us a development kit with the Mixtile Core 3588 SoM fitted with a fansink and a carrier board that looks quite similar to the NVIDIA Jetson Nano developer kit we reviewed a few years ago, although its design is closer to the new B01 developer kit as we’ll see below.  We’ll start the review with an unboxing and first boot, before testing it in more detail with Ubuntu 22.04 in the second part of the review. Mixtile Core 3588E development kit unboxing We received the development kit fully preassembled. […]

Mixtile Cluster Box supports four Rockchip RK3588 SBCs connected over PCIe

Mixtile Cluster Box

The Mixtile Cluster Box is comprised of four Mixtile Blade 3 Pico-ITX single board computers each powered by a Rockchip RK3588 processor and connected over a 4-lane PCIe Gen3 interface through a U.2 to PCIe/SATA breakout board. We mentioned the Cluster Box last year, but Mixtile had few details about it at the time. The company has now released more technical information, worked on the software, and just launched the box for $339 (without the SBCs). Mixtile Cluster Box specifications: Supported SBCs – Up to 4x Mixtile Blade 3 with Rockchip RK3588, up to 32GB LPDDR4 each, up to 256GB eMMC flash each Control board running OpenWrt 22.03 SoC – MediaTek MT7620A MIPS processor @ 580 MHz System Memory 256 MB DDR2 Storage – 16 MB SPI Flash PCIe Switch – ASMedia ASM2824 with four PCIe 3.0 4-lane ports Storage interfaces via 4x U.2 breakout boards 4x NVMe M.2 M-Key […]

Mixtile Core 3588E Rockchip RK3588 system-on-module works with NVIDIA Jetson TX2 NX carrier boards

Rockchip RK3588 SoM NVIDIA Jetson TX2 NX alternative

Mixtile Core 3588E is a system-on-module powered by a Rockchip RK3588 SoC and equipped with the 260-pin SO-DIMM connector found in the NVIDIA Jetson TX2 NX (and Jetson Nano, Xavier NX, Orin Nano modules). We’ve seen several companies make Raspberry Pi CM4 alternatives such as Radxa CM3 or Pine64 SoQuartz, and Mixtile even has its own Core 3568M SoM that can be used as a drop-in replacement for the Raspberry Pi CM4. But I had not seen companies try to make system-on-modules based on NVIDIA Jetson’s 260-pin SO-DIMM edge connector, and that’s exactly what the Mixtile Core 3588E has to offer. Mixtile Core 3588E specifications: SoC – Rockchip RK3588 CPU – Octa-core processor with 4x Arm Cortex-A76 cores @ up to 2.4 GHz, 4x Arm Cortex-A55 cores GPU – Arm Mali-G610 MP4 GPU with support for OpenGL ES3.2, OpenCL 2.2, Vulkan1.1 AI accelerator – 6 TOPS NPU with support for […]

Mixtile Edge 2 Kit mini PC/IoT gateway supports an external 20Ah battery pack

Mixtile Edge 2 Battery Pack

Mixtile Edge 2 Kit is a mini PC/IoT edge computer powered by a Rockchip RK3568 quad-core Cortex-A55 processor coupled with up to 4GB RAM and 32GB flash that features a 12V SATA + SMBUS port that allows the insertion of a 20Ah battery pack lasting up to 12 hours for locations where power may be intermittent. The 3.5-inch industrial mini PC also offers Gigabit Ethernet and WiFi 6  connectivity, three USB 3.0 ports, plus expansion with M.2 and mPCIe sockets, as well as a similar U.2 connector found in the company’s Mixtile Blade 3 SBC powered by Rockchip RK3588 processor, but routed to different interfaces. Mixtile Edge 2 Kit specifications: SoC – Rockchip RK3568 quad-core Arm Cortex-A55 processor @ up to 2.0 GHz with Mali-G52 EE GPU, 0.8 TOPS NPU, 4Kp60 H.265/H.264/VP9 video decoder, 1080p100 H.265/H.264 video encoder System Memory – 2GB or 4GB LPDDR4 Storage 16GB or 32GB eMMC […]

Mixtile reveals U.2 to PCIe/SATA breakout board for Rockchip RK3588 cluster

Mixtile Blade 3 cluster: boards connection

Mixtile Blade 3 is a Rockchip RK3588 SBC with up to 32GB RAM designed for server applications, notably to build clusters through a U.2 edge connector with 4-lane PCIe Gen3, SATA 3.0 to interconnect multiple boards. What was not clear so far is how multiple boards would be connected, as we were just shown two boards connected by a U.2 cable, which does not scale, and does not provide power as the 12V input also comes with the U.2 connector. The company has now provided more details showing how it’s done, namely through a breakout board that connects to the U.2 edge connector, and allows cluster design as shown below. The U.2 breakout board comes with a 6-pin connector 12V power, pair of SFF-8643 (mini SAS) connectors for PCIe daisy-chaining, and a SATA port. Since short SFF-8643 cables are hard to find, Mixtile will provide custom 15-cm cables with the […]

Mixtile Blade 3 – A Rockchip RK3588 Pico-ITX board for server applications

Mixtile Blade 3 Rockchip RK3588 Pico-ITX SBC

The Rockchip RK3588 hype continues with the Mixtile Blade 3, a new Pico-ITX board powered by the Cortex A76/A55 processor, coupled with up to 32GB RAM, up to 256GB storage, and designed for server applications with two 2.5GbE interfaces. The single board computer also comes with HDMI 2.1 output, HDMI 2.0 input, USB 3.2 Gen 1 USB Type-C ports, a mini PCIe Gen 2 for expansion, and a PCIe Gen 3 x4 connector to connect two Mixtile Blade 3 boards together for high-performance computing. Mixtile Blade 3 specifications: SoC – Rockchip RK3588 octa-core processor with four Arm Cortex-A76 cores @ up to 2.4 GHz, four Arm Cortex-A55 cores, ArmMali-G610 MP4 quad-core GPU with support for OpenGL ES3.2, OpenCL 2.2, Vulkan1.1, 6 TOPS NPU, 48MP ISP, 8Kp60 video decoding, 8Kp30 video encoding System Memory – Up to 32GB LPDDR4 memory Storage – Up to 256GB eMMC flash, MicroSD 3.0 card socket, […]

Memfault IoT and embedded debugging platform