JellyFin adds support for Rockchip RK3588 MPP hardware acceleration

Jellyfin RK3588

Jellyfin open-source media server has recently added support for Rockchip RK3588 MPP hardware acceleration, which means the software supports video hardware decoding and encoding, hardware scalers, and other features. The GitHub request lists the following changes: Add full HWA transcoding pipeline for Rockchip RKMPP HW decoder (MPEG1, MPEG2, MPEG4, H264, HEVC, VP8, VP9, AV1) HW encoder (H264, HEVC) up to 1080p @ 480fps / 4k @ 120fps on RK3588 HW scaler, format conversion, and subtitle burn-in HW HDR-to-SDR tone-mapping (requires OpenCL, RK3588 only) The OpenCL runtime can be downloaded and installed from libmali-valhall-g610-g13p0-x11-wayland-gbm_1.9-1_arm64.deb Support lossless AFBC (Arm frame buffer compression) to save memory bandwidth and improve FPS Support async RGA filter and MPP encoder If indeed decoding and encoding can be performed simultaneously, that would mean video transcoding can be offloaded to the Rockchip RK3588’s VPU. The changes has been tested with Linux 5.10 and Linux 6.1, but do not […]

Firefly AIO-1684XQ motherboard features BM1684X AI SoC with up to 32 TOPS for video analytics, computer vision

Firefly AIO-1684XQ motherboard

Firefly AIO-1684XQ is a motherboard based on SOPHGO SOPHON BM1684X octa-core Cortex-A53 AI SoC delivering up to 32TOPS for AI inference, and designed for computer vision applications and video analytics. The headless machine vision board is equipped with 16GB RAM, 64GB eMMC flash, and 128MB SPI flash, and comes with a SATA 3.0 port, dual Gigabit Ethernet, optional 4G LTE or 5G modules, four USB 3.0 ports, and a terminal block with two RS485 interface, two relay outputs, and a few GPIOs. Firefly AIO-1684XQ specifications: SoC – SOPHGO SOPHON BM1684X CPU – Octa-core Arm Cortex-A53 processor @ up to 2.3 GHz TPU – Up to 32TOPS (INT8), 16 TFLOPS (FP16/BF16), 2 TFLOPS (FP32) VPU Up to 32-channel H.265/H.264 1080p25 video decoding Up to 32-channel 1080p25 HD video processing (decoding + AI analysis) Up to 12-channel H.265/H.264 1080p25fps video encoding System Memory – 16GB LPDDR4x Storage 64GB eMMC flash 128MB SPI […]

AMD Alveo MA35D media accelerator transcodes up to 32 1080p60 AV1 streams in real-time

AMD ALVEO MA350 AV1 real-time encoding card

AMD Alveo MA35D media accelerator PCIe card is based on a 5nm ASIC capable of transcoding up to 32 Full HD (1080p60) AV1 streams in real-time and designed for low-latency, high-volume interactive streaming applications such as watch parties, live shopping, online auctions, and social streaming. AMD says the Alveo MA35D utilizes a purpose-built VPU to accelerate the entire video pipeline, and the ASIC can also handle up to 8x 4Kp60, or 4x 8Kp30 AV1 streams per card. H.264 and H.265 codecs are also supported, and the company claims its “next-generation AV1 transcoder engines” deliver up to a 52% reduction in bitrate at the same video quality against “an open source x264 veryfast SW model”. AMD Alveo MA350 highlights: Auxiliary CPU – 2x 64-bit quad-core RISC-V to perform control and board management tasks AI Processor – 22 TOPS per card for AI-enabled “smart streaming” for video quality optimization Memory – 16GB […]

FOSDEM 2023 schedule – Open-source Embedded, Mobile, IoT, Arm, RISC-V, etc… projects

FOSDEM 2023

After two years of taking place exclusively online, FOSDEM 2023 is back in Brussels, Belgium with thousands expected to attend the 2023 version of the “Free and Open Source Developers’ European Meeting” both onsite and online. FOSDEM 2023 will take place on February 4-5 with 776 speakers, 762 events, and 63 tracks. As usual, I’ve made my own little virtual schedule below mostly with sessions from the Embedded, Mobile and Automotive devroom, but also other devrooms including “Open Media”, “FOSS Educational Programming Languages devroom”, “RISC-V”, and others. FOSDEM Day 1 – Saturday February 4, 2023 10:30 – 10:55 – GStreamer State of the Union 2023 by Olivier Crête GStreamer is a popular multimedia framework making it possible to create a large variety of applications dealing with audio and video. Since the last FOSDEM, it has received a lot of new features: its RTP & WebRTC stack has greatly improved, Rust […]

Kodi 20 “Nexus” Alpha 1 gets AV1 hardware decoding, DietPi 8.5 released

Kodi 20 Nexus

I’ll combine two unrelated short news about software releases for TV boxes, Raspberry Pi, and other SBCs: Kodi 20 “Nexus” Alpha 1 media center, and DietPi 8.5 lightweight Debian-based image for SBC’s. Kodi 20 “Nexus” Alpha 1 The first alpha release of Kodi 20 “Nexus” is out with one highlight being support for AV1 hardware video decoding in Android and x86 (VAAPI) platforms with AV1-capable GPU or VPU. Other notable changes include: FFMPEG upgraded to version 4.4 Plenty of subtitle related changes: Added Steam Deck built-in controller support Initial support for M1 native including native windowing/input handling Pipewire support in Linux Various PVR improvements including in terms of performance when a large number of channels is displayed You’ll find more details in the announcement. The RetroPlayer project based on Kodi, but adding some game-related features, has also released some test images based on Kodi 20. Note that since it’s an […]

Linux hardware video encoding on Amlogic A311D2 processor

amlogic a311d2 h265 hardware video encoding sample

I’ve spent a bit more time with Ubuntu 22.04 on Khadas VIM4 Amogic A311D2 SBC, and while the performance is generally good features like 3D graphics acceleration and hardware video decoding are missing. But I was pleased to see a Linux hardware video encoding section in the Wiki, as it’s not something we often see supported early on. So I’ve given it a try… First, we need to make a video in NV12 pixel format that’s commonly outputted from cameras. I downloaded a 45-second 1080p H.264 sample video from Linaro, and converted it with ffmpeg:

I did this on my laptop. As a raw video, it’s pretty big with 3.3GB of storage used for a 45-second video:

Now let’s try to encode the video to H.264 on Khadas VIM4 board using aml_enc_test hardware video encoding sample:

The output explains the parameters used. There are some error messages, […]

DirectFB2 project brings back DirectFB graphics library for Linux embedded systems

DirectFB2

DirectFB2 is a new open-source project that brings back DirectFB, a graphics library optimized for Linux-based embedded systems that was popular several years ago for 2D user interfaces but has since mostly faded away. DirectFB2 attempts to preserve the original DirectFB backend while adding new features such as modern 3D APIs like Vulkan and OpenGL ES. I personally used it in 2008-2009 while working with Sigma Designs media processors that relied on the DirectFB library to render the user interfaces for IPTV boxes, karaoke machines, and so on. I remember this forced me to switch from a MicroWindows + Framebuffer solution, but the DirectFB API was easy enough to use and allowed us to develop a nicer user interface. I found out about the new project while checking out the FOSDEM 2022 schedule and a talk entitled “Back to DirectFB! The revival of DirectFB with DirectFB2” which will be presented […]

Google Summer of Code 2020 Mentoring Organizations Announced

Google Summer of Code 2020

Every year Google organizes the Summer of Code inviting students to work on open-source projects and even get paid for it. The company first select mentoring organizations, before accepting applications from students. Google has now announced the 200 organizations/projects that have been selected for Summer of Code 2020. Many projects are higher-level software development such as web development or desktop programs development but there are also projects closer to the hardware-side of things with operating systems and multimedia projects. Some interesting organization and/or  projects part of the audio / graphics / video / multimedia category include: apertus Association developing AXIOM open-source hardware camera FFmpeg multimedia framework to decode, encode, transcode, de/mux, stream, filter & play audio and video stream found in many projects OpenCV Open Source Computer Vision Library for computer vision and deep learning applications. XOrg foundation for X Window System and related projects such as Mesa, DRI, Wayland, […]

Exit mobile version
Memfault IoT and embedded debugging platform