e-con Systems Introduces a 4K Multi-Camera System for NVIDIA Jetson TX1/TX2 Boards

4K Camera Kit NVIDIA Jetson TX1 / TX2

Last year, e-con Systems launched a 360° Camera Kit for NVIDIA Jetson TX1/TX2 boards that featured 6 cameras capable of recording or streaming 1080p30 each in real-time. The company is now back with a multi-camera system with “only”  three cameras, but each can handle uncompressed video up to 4K UHD resolution at 30 fps. Meet e-CAM130_TRICUTX2 kit. Specification for the 4K Multi-camera system: Camera Modules – 3x e-CAM137_CUMI1335_MOD 13.0 MP Camera Module with S-mount lens holder Resolutions & frame rates (YUV422) VGA up to 30 fps (sync), up to 100 fps (async) HD (720p) up to 30 fps (sync), up to 72 fps (async) Full HD (1080p) up to 30 fps (sync), up to 72 fps (async) 4K up to 30 fps 13MP (4192 x 3120) up to 19 fps (async mode only) Baseboard with: 4-lane MIPI CSI-2 interface to connect with the CPU On board PWM generator circuit and external trigger option to trigger all three cameras synchronously Operating Voltage …

NVIDIA Introduces Jetson Xavier Devkit and Isaac Robotics Software

NVIDIA Jetson Xavier

NVIDIA Xavier was first unveiled in September 2016 as an artificial intelligence SoC with eight NVIDIA Custom 64-bit Arm cores, a 512-core Volta GPU,  8K video encoding and decoding, and a computer vision accelerator (CVA) now called NVDLA (NVIDIA Deep Learning Accelerator). Earlier this year, the company announced Xavier was sampling,  and DRIVE IX & DRIVE AR SDKs for the automotive market. On the eve of Computer 2018, NVIDIA has introduced Jetson Xavier development kit, as well as Isaac robotics software for autonomous machines. Jetson Xavier key specifications: SoC – NVIDIA Xavier with 8-core ARMv8.2 64-bit CPU, 8MB L2 + 4MB L3 512-core Volta GPU with Tensor Cores 2x NVDLA engines for deep learning 7-way VLIW Processor for vision acceleration VPU with dual 4Kp60 video decoding and encoding System Memory – 16GB 256-bit LPDDR4x | 137 GB/s Storage – 32GB eMMC 5.1 flash Display – 3x eDP/DP/HDMI at 4Kp60 | HDMI 2.0, DP HBR3 Camera 16x CSI-2 Lanes (40 Gbps …

Status of Embedded GPU Ecosystem – Linux/Mesa Upstream Support (ELC 2018 Video)

The Embedded Linux Confernce is on-going, and the Linux Foundation has been uploading videos about talks in a timely manner on YouTube. I checked out at RISC-V keynote yesterday, but today I’ve watched a talk by Robert Foss (his real name, not related to FOSS) from Collabora entitled “Progress in the Embedded GPU Ecosystem”, where he discusses open source software support in Linux/Mesa from companies and reverse-engineering support. The first part deals with the history of embedded GPU support, especially when it comes to company support. Intel was the first and offers very good support for their drivers, following by AMD who also is a good citizen. NVIDIA has the Nouveau driver but they did not really backed it up, and Tegra support is apparently sponsored by an aircraft supplier. Other companies have been slower to help, but Qualcomm has made progress since 2015 and now support all their hardware, Broadcom has a “one man team” handling VideoCore IV/V,  and …

Vulkan 1.1 and SPIR-V 1.3 Specifications Released

The Khronos Group released Vulkan 1.0 specifications in 2015 as a successor of OpenGL ES, compatible with OpenGL ES 3.1 or greater capable GPU, and taking less CPU resources thank to – for instance – better use of multi-core processors with support for multiple command buffers that can be created in parallel. A year later, we saw Vulkan efficiency in a demo, since then most vendors have implemented a Vulkan driver for their compatible hardware across multiple operating systems, including Imagination Technologies which recently released Vulkan drivers for Linux. The Khronos Group has now released Vulkan 1.1 and the associated SPIR-V 1.3 language specifications. New functionalities in Vulkan 1.1: Protected Content – Restrict access or copying from resources used for rendering and display, secure playback and display of protected multimedia content Subgroup Operations – Efficient mechanisms that enable parallel shader invocations to communicate, wide variety of parallel computation models supported Some Vulkan 1.0 extensions are now part of Vulkan 1.1 …

NVIDIA Xavier AI SoC Now Sampling, DRIVE IX & DRIVE AR SDKs Announced

Well over a year ago, NVIDIA introduced Xavier, their next generation self-driving and artificial intelligence processor, with eight custom ARM cores, a 512-core Volta GPU, and support for 8K video encoding and decode. A few months ago, the company provided some more details and unveiled NVIDIA DRIVE PX Pegasus A.I. computer for level 5 autonomous driving with two Xavier processors and two NVIDIA next-generation GPUs delivering a total 320 TOPS of computing power. For that it’s worth, 320 TOPS is about 3200 times more powerful than Intel Movidus Neural Network Compute Stick. CES 2018 has now started, and NVIDIA made several announcement related to gaming and automotive markets, and confirmed Xavier is now sampling to select customers. What’s really new from the announcement is the addition of two new SDKs (software development kits) for the processor beside the original NVIDIA DRIVE AV autonomous vehicle platform: DRIVE IX – Intelligent experience software development kit that will enable AI assistants for both …

What’s the Best Android TV Box (2017/2018 Edition)?

Since I was often asked which TV box to buy, I wrote a guide entitled “What’s the best Android TV box?” in April 2016. Time has passed, new products have launched, I tested more devices, and got further reader feedback, so it’s time for an update. There’s still no device that rules them all, and since everybody has different requirements and price points, what could the best Android TV box ever to one person, maybe be a piece of junk to another. Before purchasing a TV box, you should consider what you plan to do with it, and find the device with matches your needs and budget. So first, I’ll provide a list of things to look for – beside the SoC/RAM selection – before selecting three TV boxes that stand out (in no particular order), as well as alternatives worth looking at. Things to Look for The list is basically the same as last year, except I added two …

NVIDIA DRIVE PX Pegasus Platform is Designed for Fully Autonomous Vehicles

Many companies are now involved in the quest to develop self-driving cars, and getting there step by step with 6 levels of autonomous driving defined based on info from  Wikipedia: Level 0 – Automated system issues warnings but has no vehicle control. Level 1 (”hands on”) – Driver and automated system shares control over the vehicle. Examples include Adaptive Cruise Control (ACC), Parking Assistance, and Lane Keeping Assistance (LKA) Type II. Level 2 (”hands off”) – The automated system takes full control of the vehicle (accelerating, braking, and steering), but the driver is still expected to monitor the driving, and be prepared to immediately intervene at any time. You’ll actually have your hands on the steering wheel, just in case… Level 3 (”eyes off”) – The driver can safely turn their attention away from the driving tasks, e.g. the driver can text or watch a movie. The system may ask the driver to take over in some situations specified by …

NVIDIA Unveils Open Source Hardware NVDLA Deep Learning Accelerator

NVIDIA is not exactly known for their commitment to open source projects, but to be fair things have improved since Linus Torvalds gave them the finger a few years ago, although they don’t seem to help much with Nouveau drivers, I’ve usually read positive feedback for Linux for their Nvidia Jetson boards. So this morning I was quite surprised to read the company had launched NVDLA (NVIDIA Deep Learning Accelerator), “free and open architecture that promotes a standard way to design deep learning inference accelerators” The project is based on Xavier hardware architecture designed for automotive products, is scalable from small to large systems, and is said to be a complete solution with Verilog and C-model for the chip, Linux drivers, test suites, kernel- and user-mode software, and software development tools all available on Github’s NVDLA account. The project is not released under a standard open source license like MIT, BSD or GPL, but instead NVIDIA’s own Open NVDLA license. …