picoLLM is a cross-platform, on-device LLM inference engine

picoLLM Raspberry Pi 5

Large Language Models (LLMs) can run locally on mini PCs or single board computers like the Raspberry Pi 5 but with limited performance due to high memory usage and bandwidth requirements. That’s why Picovoice has developed the picoLLM Inference Engine cross-platform SDK optimized for running compressed large language models on systems running Linux (x86_64), macOS (arm64, x86_64), and Windows (x86_64), Raspberry Pi OS on Pi 5 and 4, Android and iOS mobile operating systems, as well as web browsers such as Chrome, Safari, Edge, and Firefox. Alireza Kenarsari, Picovoice CEO, told CNX Software that “picoLLM is a joint effort of Picovoice deep learning researchers who developed the X-bit quantization algorithm and engineers who built the cross-platform LLM inference engine to bring any LLM to any device and control back to enterprises”. The company says picoLLM delivers better accuracy than GPTQ when using Llama-3.8B MMLU (Massive Multitask Language Understanding) as a […]

Rockchip RK2118G/RK2118M dual-core Star-SE Armv8-M microcontrollers target smart audio applications

Rockchip RK2118G microcontroller block diagram

Rockchip RK2118G and RK2118M smart audio microcontrollers based on a dual-core Star-SE Armv8-M processor, an NPU for smart AI audio processor, three DSPs, 1024KB SRAM, optional DDR memory in package, and a range of peripherals. I first noticed the RK2118M in slides from the Rockchip Developer Conference 2024 last March, but I did not have enough information for an article at the time. Things have now changed since I’ve just received a bunch of datasheets including the one for the RK2118G and RK2118G microcontrollers, which look identical except for the DDR interface and optional built-in 64MB RAM for the RK2118G. The datasheets have only one reference to Arm with the string “Arm-V8M” and nothing else, and Cortex is not mentioned at all. But the slide above reveals the STAR-SE core looks to be an Arm Cortex-M33 core. We also learn the top frequencies for the “STAR-M33″/”STAR-SE” core  (300MHz) and the […]

$23 C790 HDMI to MIPI CSI adapter adds HDMI and audio input to Raspberry Pi SBCs

Raspberry Pi 4 HDMI Input board

C790 is an HDMI to MIPI CSI-2 board compatible with Raspberry Pi single board computers featuring a 40-pin GPIO header that adds both HDMI input up to 1080p60 and I2S audio input to the popular Arm SBC. The solution can be useful for IP KVM solutions as we’ve seen with the PiKVM v3 and PiCast portable KVM switch, or to capture video and audio from a camera that outputs HDMI with audio through the board’s MIPI CSI camera interface and I2S input signals on the GPIO header. C790 specifications: Supported SBC’s – Raspberry Pi Zero, 3B, 3B+, 4B, CM3, CM4 with MIPI CSI-2 input port (Note: Raspberry Pi 4 is limited to 1080p50 due to 2-lane MIPI CSI-2, CM4 supports 1080p60) Main chip – Toshiba TC358743XBG HDMI to CSI-2 bridge chip up to 1920×1080, 60 FPS Video and audio input – HDMI port up to 1080p60 Video Output – 2-lane […]

Sonocotta’s ESParagus “Media Center” is a series of ESP32-based, open-source audio streamers (Crowdfunding)

Louder ESParagus

ESParagus Media Center is a line of audio streamers from Sonocotta, all powered by an ESP32 microcontroller module. It includes the ESParagus HiFi MediaLink, Loud ESParagus, and the Louder ESParagus. The ESP32-based audio centers can be used to power old stereo speaker systems that lack streaming capabilities. They are completely open-source, consume little power when not in use, and boot up in seconds. The ESParagus Media Center products are based on the ESP32-WROVER microcontroller module with Wi-Fi and Bluetooth connectivity and an onboard PSRAM chip. They are fitted with an external Wi-Fi antenna and the top-end model – the Louder ESParagus – is fitted with a W5500 LAN chip for Ethernet networking. All three ESParagus Media Centers run squeezelite-esp32 firmware which supports Spotify Connect, Apple AirPlay, and Logitech Media Server. Integrations with Home Assistant are possible and can be useful for multi-room configurations. The Louder ESParagus is quite similar to […]

Pineboards adds four more Raspberry Pi 5 PCIe HAT+ boards with PCIe x4 slot, mPCIe socket, Coral Dual Edge TPU support, and audio ports

Pineboards Raspberry Pi 5 HAT

Pineboards, previously known as PineBerry, has launched four new Raspberry Pi HAT+ with a PCIe interface: the Hat uPCIty Lite, HatDrive! Piano, Hat mPCIe, and Hat Ai! Dual. The Polish company decided to change the name from Pineberry to Pineboards since the “berry” name implied they were manufacturing single-board computers, while Pineboards, not to be confused with Pine64 boards, apparently does not :). Nevertheless, let’s have a look at the four new HAT+ boards. Hat uPCIty Lite – PCIe x4 slot and ATX power supply Specifications: Supported SBCs – Raspberry Pi 5 and other SBCs with a compatible 16-pin PCIe FPC connector and form factor PCIe 16-pin PCIe FPC connector (input) PCIe X4 slot (output) to connect PCIe cards such as NVIDIA or AMD graphics cards; Note: only PCIe x1 Gen2 and Gen3 are supported Misc – 12V and PWR LEDs Power Supply 12V/8A via ATX power connector 12V/8A via […]

8devices TobuFi SoM is designed for drones, robotics, and advanced audio systems

8devices TobuFi SoM

8devices has recently introduced TobuFi, a Qualcomm QCS405-powered System-on-Module (SoM) featuring dual-band Wi-Fi 6 and Wi-Fi 5 capabilities. The device also features 1GB LPDDR3, 8GB of eMMC storage, and multiple display resolutions. It also offers various interfaces, including USB 3.0, HDMI, I2S, DMIC, SDC, UART, SPI, I2C, and GPIO. In previous posts, we covered 8devices product launches like the Noni M.2 WiFi 7 module, Rambutan and Rambutan-I modules, Habanero IPQ4019 SoM, Mango-DVK OpenWrt Devkit, and many more innovative products. If you’re interested in 8devices, feel free to check those out for more details. 8devices TobuFi SoM specifications: SoC – Qualcomm QCS405 CPU – Quad-core Arm Cortex-A53 at 1.4GHz; 64-bit GPU – Qualcomm Adreno 306 GPU at 600MHz; supports 64-bit addressing DSP – Qualcomm Hexagon QDSP6 v66 with Low Power Island and Voice accelerators Memory – 1GB LPDDR3 + 8GB eMMC Storage 8GB eMMC flash SD card – One 8-bit (SDC1, 1.8V) and one […]

FLIR Si2 acoustic imaging camera features 124 microphones to detect leaks and faults up to 200 meters away

FLIR SI2 acoustic imaging camera

Teledyne FLIR is well known for its thermal imaging infrared cameras, but the FLIR Si2 is different as instead of measuring temperature, the acoustic imaging camera is equipped with 124 sensitive microphones to detect leaks, electrical discharge, and mechanical faults up to 200 meters away. The acoustic imaging camera also comes with a 5-inch display and a 12MP RGB camera. It is available in three variants: the FLIR Si2-PD for partial discharge detection, the Si2-LD for air leak and mechanical fault detection, and the Si2 Pro capable of handling both. FLIR Si2 specifications: Display – 5-inch resistive touchscreen TFT PCB with 1280 × 720 resolution Measurement and analysis FLIR Si2-LD Detection threshold 20 kHz: -7 dB SPL 35 kHz: 4 dB SPL 50 kHz: 10 dB SPL 80 kHz: 36 dB SPL 100 kHz: 51 dB SPL Supported gases: Compressed air, hydrogen, CO2, methane, natural gas, helium, argon, ammonia Other […]

Qualcomm unveils Snapdragon X80 5G modem with NB-NTN satellite connectivity, AI Hub, and FastConnect 7900 WiFi 7 chip

Snapdragon X80 5G modem satellite

Mobile World Congress 2024 (MWC 2024) has just started, and Qualcomm had three major announcements with the introduction of the Snapdragon X80 5G modem with NB-NTN satellite connectivity, the Qualcomm AI Hub with over 75 AI models optimized for Snapdragon processors, and the FastConnect 7900 WiFi 7, Bluetooth, and Ultra Wideband (UWB) chip. Snapdragon X80 5G modem-RF system Snapdragon X80 5G modem specifications: Peak download speed – 10 Gbps Peak upload speed – 3.5 Gbps Cellular Modem-RF Specs – 10CC aggregation in mmWave, 5CC aggregation in 5G sub-6GHz Cellular Technology 5G NR, sub-6 GHz Dynamic Spectrum Sharing (DSS) LTE, WCDMA, LAA, TD-SCDMA, GSM/EDGE, CBRS mmWave, sub-6 carrier aggregation (FDD-FDD) sub-6 carrier aggregation (TDD-TDD), 5G FDD, 5G TDD, sub-6 carrier aggregation (FDD-TDD) 5G SA (standalone), 5G NSA (non-standalone) F + F ULCA, FDD UL MIMO, Switched Uplink, 3GPP R18-ready (5G Advanced-ready), 6x CA sub-6 downlink carrier aggregation, 1024-QAM sub-6, FR1 + […]

Exit mobile version