Software-based neural video decoder leverages AI accelerator on Snapdragon 888

Software video decoding ai accelerator

Sometimes hardware blocks got to work on tasks they were not initially designed to handle. For example, AI inference used to be mostly offloaded to the GPU before neural network accelerators became more common in SoC’s. Qualcomm AI Research has now showcased a software-based neural video decoder that leverages both the CPU and AI engine in Snapdragon 888 processor to decode a 1280×704 HD video at over 30 fps without any help from the video decoding unit. The neural video decoder is still a work in progress as it only supports intra frame decoding, and inter frame decoding is being worked on. That means each frame is currently decoded independently without taking into account small changes between frames as all other video codecs do. The CPU handles parallel entropy decoding while the decoder network is accelerated on the 6th generation Qualcomm AI Engine found in Snapdragon 888 mobile platform. This […]

Hantro H1 hardware accelerated video encoding support in mainline Linux

Hantro H1 Block diagram

With the increasing need for video encoding, there are some breakthrough developments in hardware-accelerated video encoding for Linux. Bootlin has been working on the implementation of Hantro H1 hardware accelerated video encoding to support H.264 encoding on Linux which follows the company’s work on the previously-released open-source VPU driver for Allwinner processors. Hantro H1 Hardware Hantro H1 is a common hardware H.264 encoder, it can also do VP8 and JPEG. It is found in a few ARM SoCs including a lot of Rockchip (RK3288, RK3328, RK3399, PX30, RK1808) and NXP (i.MX 8M Mini). Depending on the version, it can support up to 1080p at 30 or 60 fps. Here we can see different blocks used for encoding. Hantro H1 is a stateless hardware implementation which means it has no microcontroller or firmware running. As can be seen in the diagram, it has a pre-processor that can do things like cropping, […]

Wondershare Repairit Online, a free online video repair tool (Sponsored)

Online Video Repair Tool

Videos may get corrupted due to issues during download, transfer to PC, or corrupted storage. But if that happens to you, don’t despair as there are tools to repair videos such as Wondershare Repairit Online. The free online video repair tool allows you to simply upload one of your damaged videos to the website, no signup required, and after processing, you’ll be able to download the repaired video directly from the website. The screenshot below shows a video uploaded anonymously from the latest Firefox browser in Ubuntu 20.04, so it really works with any browser and OS, and I did not need to provide any information like email or name. Repairit Online can repair damage to the video containers (metadata, index, header, parameters, etc.), quality issues (black screen, stuttering, out of sync audio), and various Windows video error codes (0xc00d36c, 0xc1010103, 0xc10100aa, etc..). Beyond videos stored on your computer, Repairit […]

How to develop Gstreamer-based video conferencing apps for RDK & Linux set-top boxes

gstreamer zoom video conference

CNXSoft: This is a guest post by Promwad that explains the basic steps to develop a video conferencing app with Gstreamer on TV boxes running Linux. The COVID-19 pandemic has become a catalyst for new online services. For example, Zoom became so successful that it overtook IBM in terms of capitalization this month. The software engineers at Promwad were inspired by this success and decided to go even further: what about implementing video conferencing on Smart TV and STBs? Then the users of such an application will have an opportunity to communicate not only at work but also to enjoy remote meetings with friends, cheer for a soccer team, watch a movie together, or do sports with a coach. For some reason, most digital TV operators do not have such a service, although, from an engineering point of view, all these features can be implemented on set-top boxes based on […]

Sponsored: Wondershare UniConverter is an All-in-One Video Converter, Recorder and Editor

Uniconverter Video Editor

You may have multiple programs or plugins to manage your videos, one to download videos from the web, one to edit your own videos, a separate video converter, etc… and they may have incompatibilities, leading to some painful headaches. Available for both Windows and Mac OS, Wondershare UniConverter should make handling videos much easier as an all-in-all video suite that allows you to convert, edit, and download videos, as well as burn video DVDs and transfer videos to mobile phones and other devices. Key features of Wondershare UniConverter include: Video conversion of 1000 formats at up to 30x faster speed without quality loss, and with the ability to greatly reduce video size. Video Editing with support for Cropping & trimming Saturation, brightness & contrast adjustment Special effects such as BW filter, Raindrop, and many other filters Watermarks, either text or images Adding external subtitles from local files (.srt, .ass, or […]

AV1 Video Samples Now Available on YouTube & Netflix

Youtube AV1 Video

We first covered AV1 royalty-free, open source video codec in 2016, which with backing from companies like Google, Amazon, Intel, Microsoft, and many others with the aim to compete with H.265, and lower the cost of delivering video both thanks to a better compression ratio, and the lack of royalties. Since then progress has been made, with AV1 specifications released last March, and now both YouTube and Netflix are offering some beta AV1 video samples for testing. If you want to play some videos in AV1 format in YouTube as I did in the screenshot above, you’d need to install a very recent (beta) version of Chrome or Firefox, follow the other instructions as explained in YouTube’s AV1 beta playlist: Support for AV1 in MP4 within Media Source is available in Chrome 70, and Firefox 63 builds newer than September 13 with the media.av1.enabled pref set. Using a supported browser […]

Mozilla Adds HTML5 AV1 Video Support to Firefox 59 Nightly Builds

Last year, we wrote about AV1 royalty-free open source video codec managed by the Alliance for Open Media (AOMedia), a non-profit organization with members such as Amazon, Cisco, Google, Intel, Microsoft, Mozilla, and other companies. Eventually AV1 should be 25 to 35% more efficiency than H.265 or VP9, but encoding will be slower, and at the time, my AMD FX8350 based computer could encode CIF (352×288) video  at less than 0.5 fps, and I had to use command line tools to encode and decode/playback the videos. But thing are progressing nicely, and it’s now possible to stream AV1 video with HTML5 / in Firefox 59.0 (nightly) using Bitmovin Player. If you are using Ubuntu, you can also install Firefox nightly as follow:

Start it and visit the demo page to stream an AV1 MPEG-DASH/HLS stream in your web browser. It works from 360p @ 200 Kbps up to 720p […]

Xtream-Codes IPTV Panel Review – Part 3: Updates and New Features for Version 2.4.2

This is the third part of Xtream-Codes IPTV Panel review. IPTV Panel Professional Edition is a software to build your own IPTV Server from scratch. It supports all common Streaming Protocols as an Input and it is powered by FFmpeg & nginx. If you have not done so already, you may consider reading the first two parts: Review of Xtream-Codes IPTV Panel Professional Edition – Part 1: Introduction, Initial Setup, Adding Streams… Xtream Codes IPTV Panel Review – Part 2: Movie Data Editing, Security, Resellers, Users and Pricing Management Here are the major changes since Part 2: And part of the company’s announcement of the release: Why choose IPTV Panel Pro? IPTV Panel is powered by many Open Source Tools. These are only few reasons why we believe our software is different from our competitors: Stability: Our software is powered by FFmpeg to do the Restreaming & Transcoding of your streams. […]