artificial intelligence (AI) News - Page 4 of 122 - CNX Software

February 25, 2025February 25, 2025 by Jean-Luc Aufranc (CNXSoft) - 1 Comment

Imagination DXTP GPU promises 20% higher power efficiency compared to DXT GPU for mobile devices and laptops

Imagination has announced the DXTP GPU for mobile and power-constrained devices with up to 20% greater power efficiency than its predecessor, the D-Series DXT GPU for longer battery life for AI applications or complex games. The company says the GPU is suitable for gaming, user interfaces, graphics-rich applications, computer vision, generative AI, and other AI applications designed to run on smartphones, tablets, laptops, desktops, or non-safety automotive products. Imagination DXTP highlights: Two off-the-shelf configurations: DXTP-48-1536 48 GPixel/s 1.5 TFLOPS FP32 (1536 FLOPs/Clock) 3 TFLOPS FP16 6 TOPS INT8 48 ppc Bilinear 3D Textured Up to 96 ppc 2D Dual Rate Mode DXTP-64-2048 64 GPixel/s 2 TFLOPS FP32 (2048 FLOPs/Clock) 4 TFLOPS FP16 8 TOPS INT8 64 ppc Bilinear 3D Textured Up to 128 ppc 2D Dual Rate Mode Bus Interface – AXI, ACE-Lite Compression PVRIC5 Lossless and Lossy Framebuffer Compression ETC and ASTC LDR and HDR Support Microarchitecture improvement – […]

February 24, 2025February 24, 2025 by Tomisin Olujinmi - 2 Comments

Loomos AI smart glasses integrate GPT-4o, offer a 16MP camera and hi-fi audio for $199+ (Crowdfunding)

loomos AI smart glasses with 16MP camera

Chinese power supply company, SHARGE, has launched a pair of GPT-4o-powered smart glasses with a 16-megapixel camera capable of capturing 4K photos and 1080p videos. Like the Looktech AI glasses and Meta Ray-Ban series, the Loomos AI smart glasses have no onboard display. Instead, they feature a microphone array, onboard speakers, and side buttons for user control and feedback. The Loomos glasses are powered by a 2.0Ghz UNISOC quad-core processor and come integrated with the multi-modal GPT-4o for real-time AI assistance. The stated battery life is much more impressive than the competition at 40 hours of standby time (from a 450mAh battery). The company also offers a 6,500mAh neckband power bank for uninterrupted all-day wearing. The company promises security and privacy with the glasses. Data is processed anonymously with TLS encryption and users retain full control of their data. The glasses also include an indicator light to alert people around […]

February 20, 2025February 20, 2025 by Debashis Das - 2 Comments

LLMStick – An AI and LLM USB device based on Raspberry Pi Zero W and optimized llama.cpp

Youtuber and tech enthusiast Binh Pham has recently built a portable plug-and-play AI and LLM device housed in a USB stick called the LLMStick and built around a Raspberry Pi Zero W. This device portrays the concept of a local plug-and-play LLM which you can use without the internet. After DeepSeek shook the world with its performance and open-source accessibility, we have seen tools like Exo that allow you to run large language models (LLMs) on a cluster of devices, like computers, smartphones, and single-board computers, effectively distributing the processing load. We have also seen Radxa release instructions to run DeepSeek R1 (Qwen2 1.5B) on a Rockchip RK3588-based SBC with 6 TOPS NPU. Pham thought of using the llama.cpp project as it’s specifically designed for devices with limited resources. However, running llama.cpp on the Raspberry Pi Zero W wasn’t straightforward and he had to face architecture incompatibility as the old […]

February 18, 2025 by Jean-Luc Aufranc (CNXSoft) - 8 Comments

exo software – A distributed LLM solution running on a cluster of computers, smartphones, or SBCs

You’d typically need hardware with a large amount of memory and bandwidth and multiple GPUs, if you want to run the latest large language models (LLMs), such as DeepSeek R1 with 671 billion parameters. But such hardware is not affordable or even available to most people, and the Exo software works around that as a distributed LLM solution working on a cluster of computers with or without NVIDIA GPUs, smartphones, and/or single board computers like Raspberry Pi boards. In some ways, exo works like distcc when compiling C programs over a build farm, but targets AI workloads such as LLMs instead. Key features of Exo software: Support for LLaMA (MLX and tinygrad), Mistral, LlaVA, Qwen, and Deepseek. Dynamic Model Partitioning – The solution splits up models based on the current network topology and device resources available in order to run larger models than you would be able to on any […]

February 14, 2025February 14, 2025 by Jean-Luc Aufranc (CNXSoft) - 14 Comments

Orange Pi AIPro (8T) SBC features a 8 TOPS Huawei Ascend AI SoC, runs Ubuntu or openEuler

Orange Pi AIPro (8T) is a new single board computer for AI applications that features an unnamed Huawei Ascend AI quad-core 64-bit processor delivering up to 8 TOPS (INT8) of AI inference performance, although there’s also a 20 TOPS (INT8) variant of the SoC. The SBC comes with up to 16GB LPDDR4X and a 32MB SPI flash but also supports other storage options such as a microSD card, an eMMC flash module, and/or an M.2 NVMe or SATA SSD. The board also features two HDMI 2.0 ports, one MIPI DSI connector, a 3.5mm audio jack, two MIPI CSI camera interfaces, Gigabit Ethernet and WiFi 5 connectivity, a few USB ports, and a 40-pin GPIO header for expansion. Orange Pi AIPro specifications: SoC – Huawei Ascend quad-core 64-bit processor delivering up to 8 TOPS (INT8) AI performance and equipped with an unnamed 3D GPU; Likely Ascend 310B with Arm Cortex-A76 equivalent […]

February 13, 2025April 5, 2025 by Jean-Luc Aufranc (CNXSoft) - 2 Comments

Boardcon SBC3576 – A feature-rich Rockchip RK3576 SBC with HDMI, mini DP, dual GbE, WiFi 6, optional 5G/4G LTE module, and more

Boardcon SBC3576 is a feature-rich single board computer (SBC) based on the MINI3576 system-on-module powered by a Rockchip RK3576 AI SoC and equipped with two 100-pin and one 44-pin board-to-board connectors for interfacing with the carrier board. The carrier board is equipped with up to 8GB RAM, 128GB eMMC flash, two gigabit Ethernet ports, a WiFi 6 and Bluetooth 5.3 module, 4K-capable HDMI 2.1 and mini DP video outputs, a mini HDMI input port, a USB 3.0 Type-A port, RS485 and CAN Bus terminal block, and more. The Rockchip RK3576 SoC comes with the same 6 TOPS NPU found in the Rockchip RK3588/RK3588S SoC and can be used as a lower-cost alternative with less performance. Boardcon SBC3576 specifications: SoC – Rockchip RK3576 CPU 4x Cortex-A72 cores at 2.2GHz, four Cortex-A53 cores at 1.8GHz Arm Cortex-M0 MCU at 400MHz GPU – ARM Mali-G52 MC3 GPU clocked at 1GHz with support for OpenGL […]

February 13, 2025May 13, 2025 by Jean-Luc Aufranc (CNXSoft) - 1 Comment

Edge video processing platform features NXP i.MX 8M Plus, i.MX 93, or i.MX 95 SoC, supports up to 23 camera types

DAB Embedded AquaEdge video processing platform

DAB Embedded AquaEdge is a compact computer based on NXP i.MX 8M Plus, i.MX 93, or i.MX 95 SoC working as an edge video processing platform and supporting 23 types of vision cameras with resolution from VGA up to 12MP, and global/rolling shutter. The small edge computer features a gigabit Ethernet RJ45 jack with PoE to power the device. It is also equipped with a single GSML2 connector to connect a camera whose input can be processed by the built-in AI accelerator found in the selected NXP i.MX processors. Other external ports include a microSD card slot, a USB 3.0 Type-A port, and a mini HDMI port (for the NXP i.MX 8M Plus model only). DAB Embedded AquaEdge specifications: SoC / Memory / Storage options NXP i.MX 8M Plus CPU – Quad-core Cortex-A53 processor @ 1.8GHz, Arm Cortex-M7 real-time core AI accelerator – 2.3 TOPS NPU VPU Encoder up to […]

February 6, 2025February 7, 2025 by Jean-Luc Aufranc (CNXSoft) - 2 Comments

YOLO-Jevois leverages YOLO-World to enable open-vocabulary object detection at runtime, no dataset or training needed

YOLO-Jevois general object detection by typing words

YOLO is one of the most popular edge AI computer vision models that detects multiple objects and works out of the box for the objects for which it has been trained on. But adding another object would typically involve a lot of work as you’d need to collect a dataset, manually annotate the objects you want to detect, train the network, and then possibly quantize it for edge deployment on an AI accelerator. This is basically true for all computer vision models, and we’ve already seen Edge Impulse facilitate the annotation process using GPT-4o and NVIDIA TAO to train TinyML models for microcontrollers. However, researchers at jevois.org have managed to do something even more impressive with YOLO-Jevois “open-vocabulary object detection”, based on Tencent AI Lab’s YOLO-World, to add new objects in YOLO at runtime by simply typing words or selecting part of the image. It also updates class definitions on […]