artificial intelligence

Posted on by Debashis Das - No Comments on Jetway F35-MTU1 3.5-inch SBC features Intel Core Ultra 7 155U or Ultra 5 125U Meteor Lake SoC

Jetway F35-MTU1 3.5-inch SBC features Intel Core Ultra 7 155U or Ultra 5 125U Meteor Lake SoC

jetwayipc F35 MTU1 3.5 Inch SubCompact SBC

Jetway recently launched the F35-MTU1 3.5-inch SubCompact SBC, built around the Intel Core 5 125U and Ultra 7 155U (Meteor Lake) processors which also integrates an NPU for AI acceleration. It supports up to 96GB of DDR5 memory, features dual Intel 2.5GbE LAN with TSN, and supports WiFi 6 and 4G LTE connectivity via M.2 sockets. The board has several 4K display outputs, including DP Type-C, DP, HDMI, and LVDS/eDP. For storage, it offers M.2 slots supporting NVMe, PCIe, and CNVi, along with a SATA III port with RAID 0/1 support for data redundancy. I/O options include USB 3.2, USB 2.0, and four COM ports for serial communication, which can be used to connect external peripherals. With a wide operating temperature range and support for both Windows and Linux, the SBC is well-suited for AI workloads, IoT edge devices, and industrial control systems that demand high performance, connectivity, and reliability. […]

Posted on by Jean-Luc Aufranc (CNXSoft) - 1 Comment on Imagination DXTP GPU promises 20% higher power efficiency compared to DXT GPU for mobile devices and laptops

Imagination DXTP GPU promises 20% higher power efficiency compared to DXT GPU for mobile devices and laptops

Imagination DXTP power-efficient GPU

Imagination has announced the DXTP GPU for mobile and power-constrained devices with up to 20% greater power efficiency than its predecessor, the D-Series DXT GPU for longer battery life for AI applications or complex games. The company says the GPU is suitable for gaming, user interfaces, graphics-rich applications, computer vision, generative AI, and other AI applications designed to run on smartphones, tablets, laptops, desktops, or non-safety automotive products. Imagination DXTP highlights: Two off-the-shelf configurations: DXTP-48-1536 48 GPixel/s 1.5 TFLOPS FP32 (1536 FLOPs/Clock) 3 TFLOPS FP16 6 TOPS INT8 48 ppc Bilinear 3D Textured Up to 96 ppc 2D Dual Rate Mode DXTP-64-2048 64 GPixel/s 2 TFLOPS FP32 (2048 FLOPs/Clock) 4 TFLOPS FP16 8 TOPS INT8 64 ppc Bilinear 3D Textured Up to 128 ppc 2D Dual Rate Mode Bus Interface – AXI, ACE-Lite Compression PVRIC5 Lossless and Lossy Framebuffer Compression ETC and ASTC LDR and HDR Support Microarchitecture improvement – […]

Posted on by Tomisin Olujinmi - 2 Comments on Loomos AI smart glasses integrate GPT-4o, offer a 16MP camera and hi-fi audio for $199+ (Crowdfunding)

Loomos AI smart glasses integrate GPT-4o, offer a 16MP camera and hi-fi audio for $199+ (Crowdfunding)

loomos AI smart glasses with 16MP camera

Chinese power supply company, SHARGE, has launched a pair of GPT-4o-powered smart glasses with a 16-megapixel camera capable of capturing 4K photos and 1080p videos. Like the Looktech AI glasses and Meta Ray-Ban series, the Loomos AI smart glasses have no onboard display. Instead, they feature a microphone array, onboard speakers, and side buttons for user control and feedback. The Loomos glasses are powered by a 2.0Ghz UNISOC quad-core processor and come integrated with the multi-modal GPT-4o for real-time AI assistance. The stated battery life is much more impressive than the competition at 40 hours of standby time (from a 450mAh battery). The company also offers a 6,500mAh neckband power bank for uninterrupted all-day wearing. The company promises security and privacy with the glasses. Data is processed anonymously with TLS encryption and users retain full control of their data. The glasses also include an indicator light to alert people around […]

Posted on by Debashis Das - 2 Comments on LLMStick – An AI and LLM USB device based on Raspberry Pi Zero W and optimized llama.cpp

LLMStick – An AI and LLM USB device based on Raspberry Pi Zero W and optimized llama.cpp

LLMStick

Youtuber and tech enthusiast Binh Pham has recently built a portable plug-and-play AI and LLM device housed in a USB stick called the LLMStick and built around a Raspberry Pi Zero W. This device portrays the concept of a local plug-and-play LLM which you can use without the internet. After DeepSeek shook the world with its performance and open-source accessibility, we have seen tools like Exo that allow you to run large language models (LLMs) on a cluster of devices, like computers, smartphones, and single-board computers, effectively distributing the processing load. We have also seen Radxa release instructions to run DeepSeek R1 (Qwen2 1.5B) on a Rockchip RK3588-based SBC with 6 TOPS NPU. Pham thought of using the llama.cpp project as it’s specifically designed for devices with limited resources. However, running llama.cpp on the Raspberry Pi Zero W wasn’t straightforward and he had to face architecture incompatibility as the old […]

Posted on by Jean-Luc Aufranc (CNXSoft) - 8 Comments on exo software – A distributed LLM solution running on a cluster of computers, smartphones, or SBCs

exo software – A distributed LLM solution running on a cluster of computers, smartphones, or SBCs

Exo software distributed LLM solution

You’d typically need hardware with a large amount of memory and bandwidth and multiple GPUs, if you want to run the latest large language models (LLMs), such as DeepSeek R1 with 671 billion parameters. But such hardware is not affordable or even available to most people, and the Exo software works around that as a distributed LLM solution working on a cluster of computers with or without NVIDIA GPUs, smartphones, and/or single board computers like Raspberry Pi boards. In some ways, exo works like distcc when compiling C programs over a build farm, but targets AI workloads such as LLMs instead. Key features of Exo software: Support for LLaMA (MLX and tinygrad), Mistral, LlaVA, Qwen, and Deepseek. Dynamic Model Partitioning – The solution splits up models based on the current network topology and device resources available in order to run larger models than you would be able to on any […]

Posted on by Jean-Luc Aufranc (CNXSoft) - 14 Comments on Orange Pi AIPro (8T) SBC features a 8 TOPS Huawei Ascend AI SoC, runs Ubuntu or openEuler

Orange Pi AIPro (8T) SBC features a 8 TOPS Huawei Ascend AI SoC, runs Ubuntu or openEuler

Orange Pi AIPro (8T)

Orange Pi AIPro (8T) is a new single board computer for AI applications that features an unnamed Huawei Ascend AI quad-core 64-bit processor delivering up to 8 TOPS (INT8) of AI inference performance, although there’s also a 20 TOPS (INT8) variant of the SoC. The SBC comes with up to 16GB LPDDR4X and a 32MB SPI flash but also supports other storage options such as a microSD card, an eMMC flash module, and/or an M.2 NVMe or SATA SSD. The board also features two HDMI 2.0 ports, one MIPI DSI connector, a 3.5mm audio jack, two MIPI CSI camera interfaces, Gigabit Ethernet and WiFi 5 connectivity, a few USB ports, and a 40-pin GPIO header for expansion. Orange Pi AIPro specifications: SoC – Huawei Ascend quad-core 64-bit processor delivering up to 8 TOPS (INT8) AI performance and equipped with an unnamed 3D GPU; Likely Ascend 310B with Arm Cortex-A76 equivalent […]

Posted on by Jean-Luc Aufranc (CNXSoft) - 1 Comment on Boardcon SBC3576 – A feature-rich Rockchip RK3576 SBC with HDMI, mini DP, dual GbE, WiFi 6, optional 5G/4G LTE module, and more

Boardcon SBC3576 – A feature-rich Rockchip RK3576 SBC with HDMI, mini DP, dual GbE, WiFi 6, optional 5G/4G LTE module, and more

Boardcon SBC3576 SBC

Boardcon SBC3576 is a feature-rich single board computer (SBC) based on the MINI3576 system-on-module powered by a Rockchip RK3576 AI SoC and equipped with two 100-pin and one 44-pin board-to-board connectors for interfacing with the carrier board. The carrier board is equipped with up to 8GB RAM, 128GB eMMC flash, two gigabit Ethernet ports, a WiFi 6 and Bluetooth 5.3 module, 4K-capable HDMI 2.1 and mini DP video outputs, a mini HDMI input port, a USB 3.0 Type-A port, RS485 and CAN Bus terminal block, and more. The Rockchip RK3576 SoC comes with the same 6 TOPS NPU found in the Rockchip RK3588/RK3588S SoC and can be used as a lower-cost alternative with less performance. Boardcon SBC3576 specifications: SoC – Rockchip RK3576 CPU 4x Cortex-A72 cores at 2.2GHz, four Cortex-A53 cores at 1.8GHz Arm Cortex-M0 MCU at 400MHz GPU – ARM Mali-G52 MC3 GPU clocked at 1GHz with support for OpenGL […]

Posted on by Jean-Luc Aufranc (CNXSoft) - 1 Comment on Edge video processing platform features NXP i.MX 8M Plus, i.MX 93, or i.MX 95 SoC, supports up to 23 camera types

Edge video processing platform features NXP i.MX 8M Plus, i.MX 93, or i.MX 95 SoC, supports up to 23 camera types

DAB Embedded AquaEdge video processing platform

DAB Embedded AquaEdge is a compact computer based on NXP i.MX 8M Plus, i.MX 93, or i.MX 95 SoC working as an edge video processing platform and supporting 23 types of vision cameras with resolution from VGA up to 12MP, and global/rolling shutter. The small edge computer features a gigabit Ethernet RJ45 jack with PoE to power the device. It is also equipped with a single GSML2 connector to connect a camera whose input can be processed by the built-in AI accelerator found in the selected NXP i.MX processors. Other external ports include a microSD card slot, a USB 3.0 Type-A port, and a mini HDMI port (for the NXP i.MX 8M Plus model only). DAB Embedded AquaEdge specifications: SoC / Memory / Storage options NXP i.MX 8M Plus CPU – Quad-core Cortex-A53 processor @ 1.8GH, Arm Cortex-M7 real-time core AI accelerator – 2.3 TOPS NPU VPU Encoder up to […]

Exit mobile version
UP 7000 x86 SBC