AV1

I'm looking to use fastflix to convert my files into AV1 but the software is confusing the hell out of me. Most are HDR and HDR10+. Does anyone have any tutorials or know of additional software that can help with this? I've tried Handbrake but it doesn't seem to be encoding the HDR when I use the Hardware encode.

I know ffmpeg doesn't support rtp/rtsp streaming of av1. Gstreamer with rs plugin does, but I couldn't actually Playback it with vlc nor chrome.

Does anyone have a working file to rtp/rtsp/webrtcbin streaming pipeline with gstreamer that they menage to playback with chrome/vlc? Any tips on the matter? Ive tried preencode the av1 file using svt, streaming it to mediamtx using rtspclientsink and connecting to it via vlc with no joy. Meaning mediamtx accepted it, but clients connecting to the path wont show nothing.

I've have been pondering about it for some time now and there is a reason for it.

When I compare my animated encodes frame by frame, I see that some frames come out with blurry mess but others come out better than HEVC at equivalent quality. So am I supposed to compare not still frames but frames in motion to quantify the fidelity in AV1? Or is that an area where the encoder still need improvements?

I've also experimented with temporal filtering on and off, sometimes it looks better, other times it butchers the fidelity.

Overall it seems somewhat sane for dynamic gameplay while drastically reducing file sizes, but anytime there is little movement on the screen it absolutely crushes the quality beyond all reason. Is there a way to tune it/make it be normal about static-ish images?

I'm planning to encode some of my blu-ray discs to AV1 with maximum quality in mind. After thinking I had a good set of settings nailed down, I got sensitized to the topic of banding and found that in certain frames, my encodes were suffering from it quite badly.

I also found the biggest magnet for banding in an animated show: the very first episodes of "The Eminence in Shadow" shows a purple blanket that has crazy banding even at 10-bit with high bit rates.

Here's aom-av1-lavish, the "opmox mainline merge" branch as of November, 14th, 2023 with --arnr-strength=0 --enable-dnl-denoising=0 --denoise-noise-level=1

After seeing that another (x265) encode did it much better and even SVT-AV1 with mostly default settings performed well (see further down), I changed to --arnr-strength=1 --enable-dnl-denoising=0 --denoise-noise-level=6 and what a difference:

Finally, this is the result of SVT-AV1-psy as of January, 22nd, 2024. The settings are --film-grain 6 --film-grain-denoise 0:

So how does one estimate a video's noise / grain level? Do I just develop a feel for which setting corresponds to what look? That might involve quite a bunch of failed encodes, however.

In addition to giving streamers more control, this beta paves the way for future improvements such as new codec support, and experimenting with HEVC and AV1. AV1 is the next generation of video encoding technology — 40% more efficient than the current AVC standard — and it will improve visual quality, and reduce bandwidth.

Also: https://blogs.nvidia.com/blog/twitch-multiencode-av1-livestreaming/

Hello everyone. It's certainly been a while.

It may seem like there hasn't been a lot of movvement in the AV1 encoder world... but there's actually been a lot in this regard.

As you've already read from the title, this patchset adds in deltaq guided variance adaptive quantization. It's been made by our comrade u/juliobbv : https://gitlab.com/AOMediaCodec/SVT-AV1/-/issues/2105

It helps to improve coding performance and visual quality in harder to encode scenarios, where low entropy/frequency areas tend to be ignored by the encoder at multiple levels (RD metric, skip modes); this helps it tremendously in this area.

• Pure BD-rate increases for harder content range from 3.75-10%+!

It manages to finally eclipse the harshest aom-av1-psy-101/lavish settings that even I could muster up.

At this point, SVT-AV1-PSY is the best public AV1 video encoder we have today.

• Until it's avif of course. aomenc still wins there.

Yet, it's not done yet as there are still improvements to be had to improve the encoder performance through some more advanced (but more compute intensive) opts.

This feature is available at all speed presets.

It hasn't been integrated into mainline SVT-AV1 obviously; you'll need to build them from source for now using either of these two fork repositories¹:

https://github.com/gianni-rosato/svt-av1-psy

https://github.com/BlueSwordM/SVT-AV1

Any of these repositories are fine. Mine just has an extra "psy" opts patch that reigns in alt-ref frame temporal filtering strength a bit. Watch out for updates as they're updated as quickly with new working patches!

Here are the actual user settings:

--variance-boost-strength Variance boost strength, default is 3 [0-5]

--new-variance-octile Octile for new 8x8 variance algorithm. Set to 0 to use 64x64 variance algorithm, default is 4 (median) [0-8]

More detail can be found in the respective patchsets.

That'll be all from me for today. Questions and comments are appreciated.

¹ More links might be added to binary releases.

New audio container for spatial audio and ambisonics.

The attached screenshot is the mod of this community.

So far, it seems efforts to work on this community are going to cease due to shortcomings of both the Lemmy.world lemmy instance & the mod's frustration with these issues. So, I'd encourage you to check out the AV1 community on lemmy.ml until things change here either with lemmy.world as a whole or the mod's interests

I've been experimenting with AV1 using FFmpeg with SVT-AV1 for 2 years. I've encoded quite a lot of my videos in AV1 by now, mostly just animated content.

AV1 is really good for an open source project, no doubt about that. But after so long using it, I can safely say that it is really just good for storage saving with excellent quality-speed tradeoff, however, it lacks fidelity. My major discontent with AV1 has been how the encoder blurs some details completely out even when setting crf as low as 14 whereas HEVC doesn't at all. Edit: Also in some instances, particularly with non-animated videos, AV1 performed way worse than HEVC which I believe is due to it doing a poor job in varied and difficult scenes.

At first, I thought AV1 is only better for animated videos but later I found its really just any video so I've switched back to using HEVC for storage and decided to use AV1 only with preset 6 and fast decode on for mobile devices.

I don't mean to say that AV1 is bad, it does provide better quality than HEVC for sure but I wouldn't call that an upgrade when HEVC still has the major edge in fidelity.

It makes sense for VOD services to make use of it but personally, I wouldn't use it for anything except quick and super low bitrate encoding.... for now.

I'm trying to get some pictures onto my Android phone with >8bpp depth and without the large file sizes of png and the like.

Android 12 supports avif, and that's great: https://developer.android.com/about/versions/12/features

I'm using a Samsung phone with Android 13, that sounds great too concerning avif support. Unfortunately it doesn't seem to work, only web browsers and the basic, dedicated app "AVIF Viewer" are able to open the .avif files - every other viewer app, Samsung built-in or external, doesn't.

Alas, avif support seems to be on the same level as jpeg-xl (works in browsers and one dedicated app). 12-bit legacy jpeg doesn't seem to be supported either.

=> Has anyone managed to find a viewer app with browsing feature (swipe to change pictures) that supports avif, or to convince Samsung's built-in apps to display .avif files?

Ffmpeg AV1 is a fantastic codec. Open and promising a better compression ratio than HEVC / AVC.

However I am unclear right now about the possible CRF settings.

x264 defaults to a CRF of 23 x265 defaults to a CRF to 28

These two seem to have a similar visual quality for me.

What is the corresponding CRF for AV1 – what CRF has a similar quality and what is the default?

Please excuse if this question was asked before. I googled and searched reddit. However I only found complicated answers wits PSNR etc but no simply estimate answer.

I'm not going to link it here. But there's a recent article on Streaming Media dot com proclaiming that there is some 3rd parties claiming that AV1 infringes patents. And some how Sisvel conned 51 outfits out of licensing royalties. Some how this big vapor legal battle is supposed to unfold that never came.

https://gitlab.com/AOMediaCodec/avm/-/commit/6c74d9b1b2566e9b0c735dcb1a21858f24a00298

C076_inter_mode_ctx C076 inter mode contexts

https://gitlab.com/AOMediaCodec/avm/-/merge_requests/781 https://gitlab.com/AOMediaCodec/avm/-/issues/166

Tutorial to how encode a video https://www.nxrte.com/jishu/11119.html#group=nogroup&photo=0

01/06/2023 18:40 https://www.oxfordlearnersdictionaries.com/definition/english/trade-off_2?q=trade-off

01/06/2023 https://www.bloomberg.com/press-releases/2023-06-01/alliance-for-open-media-s-volumetric-visual-media-working-group-opens-call-for-proposals-on-static-polygonal-mesh-coding The important part is this High quality of the 3d graphics Will be downloaded here Will be they anonymezed until Junpstart Other words are just fillers

https://cloud.tencent.com/developer/user/1601916 tencent news about codecs

An Open Video Dataset for Screen Content Coding https://ieeexplore.ieee.org/document/10017995 https://cloud.tencent.com/developer/article/2260936?areaSource=&traceId= Y. Wang Daede 2022 IEE

https://codecwar.com/compare/summary?id=07f9479cf20536da0e46190033e71e08 Comparison page Codecs Comparative Report

https://www.nxrte.com/jishu/6022.html#group=nogroup&photo=0 8K OTT Source: Coal Mine Factory Technical Articles

https://ca.linkedin.com/in/danilovucetic

Software Engineering Intern, Masters Google

Sep 2022 - Dec 20224 months

Mountain View, California, United States

Researched lightweight deep learning approaches for video restoration in the AV2 codec, generating multiple models capable of increasing quality (PSNR gain) by up to 2.5%.

Developed a method to generate quantized weights for linear combinations of output channels, called encoder-guided restoration, leading to improvements in codec performance of up to 2%.

Investigated distillation as a method of achieving highly efficient and effective models for video restoration.

Explanation to VVC https://www.nxrte.com/jishu/10757.html#group=nogroup&photo=0 Codec • Source: Technical Articles

Evolution of codec, Ali266 unlocks new growth in the field of ultra-high-definition video Codec • Source: Video Cloud Technology • February 1, 2023 at 5:04 pm • Technical Articles

https://bloggeek.me/rtcscale-2023/#h-niklas-enbom-meta-av1-for-meta-rtc Sriram Srinivasan / Meta – Real-time audio at Meta Scale audio WebRTC Niklas Enbom / Meta – AV1 for Meta RTC An integrator's perspective. Meta will adopt AV2

livevideostack in the early 2017 https://www-livevideostack-cn.translate.goog/news/2023-codec/?_x_tr_sl=auto&_x_tr_tl=en&_x_tr_hl=it&_x_tr_pto=wapp https://vcgit.hhi.fraunhofer.de/ecm/ECM https://sh2022.livevideostack.cn/