reServer Jetson-50-1-H4 is an AI Edge server powered by NVIDIA Jetson AGX Orin 64GB

Jetson AGX Orin 64GB AI inference server

reServer Jetson-50-1-H4 is an AI inference edge server powered by Jetson AGX Orin 64GB with up to 275 TOPS of AI performance, and based on the same form factor as Seeed Studio’s reServer 2-bay multimedia NAS introduced last year with an Intel Core Tiger Lake single board computer. The 12-core Arm server comes with 32GB LPDDR5, a 256GB NVMe SSD pre-loaded with the Jetpack SDK and the open-source Triton Inference server, two SATA bays for 2.5-inch and 3.5-inch drives, up to 10 Gbps Ethernet, dual 8K video output via HDMI and DisplayPort, USB 3.2 ports, and more. reServer Jetson-50-1-H4 (preliminary) specifications: SoM – Jetson AGX Orin module with CPU – 12-core Arm Cortex-A78AE v8.2 64-bit processor with 3MB L2 + 6MB L3 cache GPU / AI accelerators NVIDIA Ampere architecture with 2048 NVIDIA CUDA cores and 64 Tensor Cores @ 1.3 GHz DL Accelerator – 2x NVDLA v2.0 Vision Accelerator […]

NVIDIA NVDLA AI accelerator driver submitted to mainline Linux

NVDLA

A large patchset has been submitted to mainline Linux for NVIDIA NVDLA AI accelerator Direct Rendering Manager (DRM) driver, accompanied by an open-source user mode driver. The NVDLA (NVIDIA Deep Learning Accelerator) can be found in recent Jetson modules such as Jetson AGX Xavier and Jetson AGX Orin, and since NVDLA was made open-source hardware in 2017, it can also be integrated into third-party SoCs such as StarFive JH7100 Vision SoC and Allwinner V831 processor. I actually assumed everything was open-source already since we were told that NVDLA was a “complete solution with Verilog and C-model for the chip, Linux drivers, test suites, kernel- and user-mode software, and software development tools all available on Github’s NVDLA account.” and the inference compiler was open-sourced in September 2019. But apparently not, as developer Cai Huoqing submitted a patchset with 23 files changed, 13243 insertions, and the following short description: The NVIDIA Deep […]

NVIDIA launches Jetson AGX Orin Developer Kit, Orin NX modules, and Isaac Nova Orin AMR platform

NVIDIA Jetson AGX Orin Developer Kit

NVIDIA Jetson AGX Orin module was first introduced in November 2021, but the company has now officially launched the Jetson AGX Orin Developer Kit, andunveiled the lower cost Orin NX modules still with 70 TOPS or more, and the Isaac Nova Orin AMR (autonomous mobile robot) reference platform. NVIDIA Jetson AGX Orin Developer Kit Jetson Orin AGX developer kit specifications: Jetson AGX Orin module with CPU – 12-core Arm Cortex-A78AE v8.2 64-bit processor with 3MB L2 + 6MB L3 cache GPU / AI accelerators NVIDIA Ampere architecture with 2048 NVIDIA CUDA cores and 64 Tensor Cores @ 1.3 GHz DL Accelerator – 2x NVDLA v2.0 Vision Accelerator – PVA v2.0 (Programmable Vision Accelerator) AI Performance – Up to 275 TOPS (INT8) @ 60W Video Encode – 2x 4K60 | 4x 4K30 | 8x 1080p60 | 16x 1080p30 (H.265) Video Decode – 1x 8K30 | 3x 4K60 | 7x 4K30 | […]

Picovoice on-device speech-to-text engines slash the requirements and cost of transcription

Speech-to-text benchmarks accuracy

Picovoice Leopard and Cheetah offline, on-device speech-to-text engines are said to achieve cloud-level accuracy, rely on tiny Speech-to-Text models, and slash the cost of automatic transcription by up to 10 times. Leopard is an on-device speech-to-text engine, while Cheetah is an on-device streaming speech-to-text engine, and both are cross-platform with support for Linux x86_64, macOS (x86_64, arm64), Windows x86_64, Android, iOS, Raspberry Pi 3/4, and NVIDIA Jetson Nano. Looking at the cost is always tricky since companies have different pricing structures, and the table above basically shows the best scenario, where Picovoice is 6 to 20 times more cost-effective than solutions from Microsoft Azure or Google STT. Picovoice Leopard/Cheetah is free for the first 100 hours, and customers can pay a monthly $999 fee for up to 10,000 hours hence the $0.1 per hour cost with PicoVoice. If you were to use only 1000 hours out of your plan that […]

FOSDEM 2022 schedule with embedded Linux, IoT, automotive… sessions

FOSDEM 2022

While typically taking place in Brussels, Belgium, FOSDEM 2022 will take place online just like FOSDEM 2021 due to COVID-19 restrictions. The good news is that it means anybody can attend it live from anywhere in the world, and makes it more like “FOSDIM”, replacing European with International, in “Free and Open Source Developers’ European Meeting”. FOSDEM 2022 will take place on February 5-6 with 637 speakers, 718 events, and 103 tracks. I’ve made my own little virtual schedule below mostly with sessions from the Embedded, Mobile and Automotive devroom, but also other devrooms including “Computer Aided Modeling and Design”, “FOSS on Mobile Devices”, “Libre-Open VLSI and FPGA”, and others.   Saturday, February 5, 2022 12:30 – 13:00 – Five mysteries in Embedded Linux by Josef Holzmayr Once you start out in embedded Linux, there is a lot to do. Some things are obvious, some less so. First and foremost, […]

Teledyne FLIR Quartet Jetson TX2 carrier board supports up to four USB 3.0 cameras

Teledyne FLIR Quartet Jetson-TX2 Blackfly S USB3 cameras

There are already plenty of NVIDIA Jetson-based camera solutions from carrier boards to IP67 rugged cameras, but Teledyne FLIR has decided to launch its own with the Quartet carrier board for the Jetson TX2 module. The Quarter board is not designed to work with the thermal cameras the company is known for, but instead FLIR Blackfly S USB3 cameras designed for machine vision. Besides four TF38 USB 3.0 connectors, the carrier board also offers a SATA storage interface, HDMI video output, and extra USB Type-A ports for other peripherals. Teledyne FLIR Quartet (P/N ACC-01-6003) specifications: Supported SoMs – NVIDIA Jetson TX2, Jetson TX2i module Storage – SATA III connector, MicroSD card slot Video Output – 1x HDMI Type-A port up to 4Kp60 Camera Inputs – 4x USB 3.0 TF38 ports Other USB ports –  1x USB 3.0 Type-A port, 1x USB 2.0 Type-A port, 1x micro USB OTG port Misc […]

Jetson EX1 and SUB mini PCs put Xavier NX SoM into metal enclosures

Jetson EX1 mini PC metal enclosure

Seeed Studio has just unveiled another Jetson Xavier NX mini PC with the Jetson EX1, plus some metal enclosures for the Jetson SUB mini PC announced last month with the official NVIDIA Jetson Xavier NX developer kit, a 128GB SSD, and the Re_Computer case comprised of an aluminum frame and a plastic cover. Jetson EX1 mini PC The Jetson EX1 mini PC has a different design with a custom carrier board offering dual Gigabit Ethernet and support for four MIPI CSI cameras, a 256GB NVMe SSD, and an aluminum enclosure designed to help with cooling, albeit the computer is not completely fanless since a 5V fan is included in the design as well. Jetson EX1 specifications: NVIDIA Jetson Xavier NX module CPU – 6-core NVIDIA Carmel ARMv8.2 64-bit processor with 6 MB L2 + 4 MB L3 cache GPU – NVIDIA Volta architecture with 384 NVIDIA CUDA cores and 48 […]

NVIDIA Jetson AGX Orin 12-core Cortex-A78E module delivers up to 200 TOPS

Jetson AGX Orin

The upcoming NVIDIA Jetson AGX Orin module packs some serious processing power with a 12-core Cortex-A78AE processor, 2048 CUDA cores, and 64 Tensor cores delivering up to 200 TOPS of AI performance, or 6 times more than its predecessor, the Jetson AGX Xavier module. Designed for robotics, autonomous machines, medical devices, the Jetson AGX Orin delivers the same performance as a GPU-enabled server, but in a much more compact 100 x 87mm form factor. The module can be operated in three power modes, namely 15W, 30W, or 50W depending on performance and power requirements, and a compact developer kit will also be made available. Jetson AGX Orin specifications: CPU – 12-core Arm Cortex-A78AE v8.2 64-bit processor with 3MB L2 + 6MB L3 cache GPU / AI accelerators NVIDIA Ampere architecture with 2048 NVIDIA CUDA cores and 64 Tensor Cores @ 1 GHz DL Accelerator – 2x NVDLA v2.0 Vision Accelerator […]