video News - CNX Software - Embedded Systems News

November 17, 2023November 17, 2023 by Jean-Luc Aufranc (CNXSoft) - 23 Comments

Allwinner VPU gets open-source Linux driver for its H.264 hardware video encoder

Allwinner V3s open source Linux video encoding driver

Long-time readers of CNX Software may remember Bootlin’s crowdfunding campaign launched in 2018 to bring open-source Allwinner VPU drivers to take care of hardware video encoding and decoding in mainline Linux. They managed to raise enough funds (over 30,000 Euros) from small donors and several companies (Olimex, Pine64, Libre Computer, FriendlyELEC, and Orange Pi) to work on open-source VPU drivers for mainline Linux, but only for MPEG2, H264, and H265 decoding for in a range of Allwinner SoCs such as the A20 and H5, but not quite enough to cover the cost of H264 video encoding. Five years later, Bootlin took it upon themselves to complete the work without backing or support from Allwinner and have now released an open-source Linux-kernel based V4L2 driver to support the H.264 video encoder found in Allwinner V3, V3s, and S3 camera SoCs. The new driver builds upon earlier work by the company to […]

April 7, 2023 by Jean-Luc Aufranc (CNXSoft) - 1 Comment

AMD Alveo MA35D media accelerator transcodes up to 32 1080p60 AV1 streams in real-time

AMD ALVEO MA350 AV1 real-time encoding card

AMD Alveo MA35D media accelerator PCIe card is based on a 5nm ASIC capable of transcoding up to 32 Full HD (1080p60) AV1 streams in real-time and designed for low-latency, high-volume interactive streaming applications such as watch parties, live shopping, online auctions, and social streaming. AMD says the Alveo MA35D utilizes a purpose-built VPU to accelerate the entire video pipeline, and the ASIC can also handle up to 8x 4Kp60, or 4x 8Kp30 AV1 streams per card. H.264 and H.265 codecs are also supported, and the company claims its “next-generation AV1 transcoder engines” deliver up to a 52% reduction in bitrate at the same video quality against “an open source x264 veryfast SW model”. AMD Alveo MA350 highlights: Auxiliary CPU – 2x 64-bit quad-core RISC-V to perform control and board management tasks AI Processor – 22 TOPS per card for AI-enabled “smart streaming” for video quality optimization Memory – 16GB […]

May 22, 2022 by Jean-Luc Aufranc (CNXSoft) - 9 Comments

Linux hardware video encoding on Amlogic A311D2 processor

amlogic a311d2 h265 hardware video encoding sample

I’ve spent a bit more time with Ubuntu 22.04 on Khadas VIM4 Amogic A311D2 SBC, and while the performance is generally good features like 3D graphics acceleration and hardware video decoding are missing. But I was pleased to see a Linux hardware video encoding section in the Wiki, as it’s not something we often see supported early on. So I’ve given it a try… First, we need to make a video in NV12 pixel format that’s commonly outputted from cameras. I downloaded a 45-second 1080p H.264 sample video from Linaro, and converted it with ffmpeg:

ffmpeg -i big_buck_bunny_1080p_H264_AAC_25fps_7200K.MP4 -pix_fmt nv12 big_buck_bunny_1080p_H264_AAC_25fps_7200K-nv12.yuv

1	ffmpeg -i big_buck_bunny_1080p_H264_AAC_25fps_7200K.MP4 -pix_fmt nv12 big_buck_bunny_1080p_H264_AAC_25fps_7200K-nv12.yuv

I did this on my laptop. As a raw video, it’s pretty big with 3.3GB of storage used for a 45-second video:

ls -lh
total 3.3G
-rw-rw-r-- 1 jaufranc jaufranc  40M Aug  5  2011 big_buck_bunny_1080p_H264_AAC_25fps_7200K.MP4
-rw-rw-r-- 1 jaufranc jaufranc 3.3G May 21 15:03 big_buck_bunny_1080p_H264_AAC_25fps_7200K-nv12.yuv

ls -lh

total 3.3G

-rw-rw-r-- 1 jaufranc jaufranc 40M Aug 5 2011 big_buck_bunny_1080p_H264_AAC_25fps_7200K.MP4

-rw-rw-r-- 1 jaufranc jaufranc 3.3G May 21 15:03 big_buck_bunny_1080p_H264_AAC_25fps_7200K-nv12.yuv

Now let’s try to encode the video to H.264 on Khadas VIM4 board using aml_enc_test hardware video encoding sample:

khadas@Khadas:~$ time aml_enc_test 1080p.nv12 dump.h264 1920 1080 30 25 6000000 1125 1 0 2 4
src_url is	: 1080p.nv12 ;
out_url is	: dump.h264 ;
width   is	: 1920 ;
height  is	: 1080 ;
gop     is	: 30 ;
frmrate is	: 25 ;
bitrate is	: 6000000 ;
frm_num is	: 1125 ;
fmt     is	: 1 ;
buf_type is	: 0 ;
num_planes is	: 2 ;
codec is	: 4 ;
codec is H264
Set log level to 4
[initEncParams:177] enc_feature_opts is 0x0 , GopPresetis 0x0 

[SetupEncoderOpenParam:513] GopPreset GOP format (2) period 30 LongTermRef 0

[vdi_sys_sync_inst_param:618] [VDI] fail to deliver sync instance param inst_idx=0

[AML_MultiEncInitialize:1378] VPU instance param sync with open param failed

[SetSequenceInfo:979] Required buffer fb_num=3, src_num=1, actual src=3 1920x1080

Encode End!width:1920

real	0m26.074s
user	0m1.832s
sys	0m4.883s

khadas@Khadas:~$ time aml_enc_test 1080p.nv12 dump.h264 1920 1080 30 25 6000000 1125 1 0 2 4

src_url is : 1080p.nv12 ;

out_url is : dump.h264 ;

width is : 1920 ;

height is : 1080 ;

gop is : 30 ;

frmrate is : 25 ;

bitrate is : 6000000 ;

frm_num is : 1125 ;

fmt is : 1 ;

buf_type is : 0 ;

num_planes is : 2 ;

codec is : 4 ;

codec is H264

Set log level to 4

[initEncParams:177] enc_feature_opts is 0x0 , GopPresetis 0x0

[SetupEncoderOpenParam:513] GopPreset GOP format (2) period 30 LongTermRef 0

[vdi_sys_sync_inst_param:618] [VDI] fail to deliver sync instance param inst_idx=0

[AML_MultiEncInitialize:1378] VPU instance param sync with open param failed

[SetSequenceInfo:979] Required buffer fb_num=3, src_num=1, actual src=3 1920x1080

Encode End!width:1920

real 0m26.074s

user 0m1.832s

sys 0m4.883s

The output explains the parameters used. There are some error messages, […]

June 22, 2021 by Jean-Luc Aufranc (CNXSoft) - 3 Comments

Software-based neural video decoder leverages AI accelerator on Snapdragon 888

Sometimes hardware blocks got to work on tasks they were not initially designed to handle. For example, AI inference used to be mostly offloaded to the GPU before neural network accelerators became more common in SoC’s. Qualcomm AI Research has now showcased a software-based neural video decoder that leverages both the CPU and AI engine in Snapdragon 888 processor to decode a 1280×704 HD video at over 30 fps without any help from the video decoding unit. The neural video decoder is still a work in progress as it only supports intra frame decoding, and inter frame decoding is being worked on. That means each frame is currently decoded independently without taking into account small changes between frames as all other video codecs do. The CPU handles parallel entropy decoding while the decoder network is accelerated on the 6th generation Qualcomm AI Engine found in Snapdragon 888 mobile platform. This […]

November 24, 2020November 24, 2020 by Abhishek Jadhav - 7 Comments

Hantro H1 hardware accelerated video encoding support in mainline Linux

With the increasing need for video encoding, there are some breakthrough developments in hardware-accelerated video encoding for Linux. Bootlin has been working on the implementation of Hantro H1 hardware accelerated video encoding to support H.264 encoding on Linux which follows the company’s work on the previously-released open-source VPU driver for Allwinner processors. Hantro H1 Hardware Hantro H1 is a common hardware H.264 encoder, it can also do VP8 and JPEG. It is found in a few ARM SoCs including a lot of Rockchip (RK3288, RK3328, RK3399, PX30, RK1808) and NXP (i.MX 8M Mini). Depending on the version, it can support up to 1080p at 30 or 60 fps. Here we can see different blocks used for encoding. Hantro H1 is a stateless hardware implementation which means it has no microcontroller or firmware running. As can be seen in the diagram, it has a pre-processor that can do things like cropping, […]

November 17, 2020November 20, 2020 by Sponsored Post - Comments Off

Wondershare Repairit Online, a free online video repair tool (Sponsored)

Videos may get corrupted due to issues during download, transfer to PC, or corrupted storage. But if that happens to you, don’t despair as there are tools to repair videos such as Wondershare Repairit Online. The free online video repair tool allows you to simply upload one of your damaged videos to the website, no signup required, and after processing, you’ll be able to download the repaired video directly from the website. The screenshot below shows a video uploaded anonymously from the latest Firefox browser in Ubuntu 20.04, so it really works with any browser and OS, and I did not need to provide any information like email or name. Repairit Online can repair damage to the video containers (metadata, index, header, parameters, etc.), quality issues (black screen, stuttering, out of sync audio), and various Windows video error codes (0xc00d36c, 0xc1010103, 0xc10100aa, etc..). Beyond videos stored on your computer, Repairit […]

October 22, 2020 by Jean-Luc Aufranc (CNXSoft) - 3 Comments

How to develop Gstreamer-based video conferencing apps for RDK & Linux set-top boxes

CNXSoft: This is a guest post by Promwad that explains the basic steps to develop a video conferencing app with Gstreamer on TV boxes running Linux. The COVID-19 pandemic has become a catalyst for new online services. For example, Zoom became so successful that it overtook IBM in terms of capitalization this month. The software engineers at Promwad were inspired by this success and decided to go even further: what about implementing video conferencing on Smart TV and STBs? Then the users of such an application will have an opportunity to communicate not only at work but also to enjoy remote meetings with friends, cheer for a soccer team, watch a movie together, or do sports with a coach. For some reason, most digital TV operators do not have such a service, although, from an engineering point of view, all these features can be implemented on set-top boxes based on […]

May 25, 2020May 25, 2020 by Sponsored Post - Comments Off