The FFmpeg project has announced FFmpeg 9.1, codenamed “Gauss,” the latest version of the widely used open-source multimedia framework for recording, converting, and streaming audio and video.
One key improvement concerns FFmpeg’s native AAC encoder, which has undergone extensive enhancements. The release also introduces xHE-AAC encoding through the external libfdk-xhe-aac library, expanding audio encoding options. DVD-Audio LPCM decoding and demuxing are now supported, alongside a new DSD encoder.
On the video side, FFmpeg 9.1 adds a Vulkan-based encoder for Advanced Professional Video, following the introduction of APV Vulkan hardware-accelerated decoding in FFmpeg 9.0.
GPU-accelerated processing also sees several additions. NVIDIA users gain a new optical flow-accelerated frame interpolation filter, fruc_vulkan, for generating intermediate video frames. The release also introduces NVDEC CUARRAY hardware acceleration support.
For AMD hardware, the new vqe_amf filter provides access to the AMF Video Quality Enhancer. Meanwhile, the ONNX Runtime DNN backend gains D3D12 DirectML zero-copy inference support, allowing compatible Windows hardware to process data without extra memory transfers.
Image processing receives attention as well. FFmpeg can now encode and decode ASTC images using libastcenc, with muxers and demuxers for .astc files and KTX 1.0 containers. JPEG Multi-Picture Format muxing and demuxing are also available, along with a Panasonic RW2 decoder and a new gainmap filter.
Another area of development is Low Complexity Enhancement Video Coding. FFmpeg 9.1 introduces dual-track LCEVC handling in the command-line interface, LCEVC track muxing in MPEG-TS, and a dedicated payload-merging bitstream filter.
For developers and advanced users, the release includes a graph-based bitstream filtering API, alongside new trim, side_data, and jpegapp bitstream filters. H.264 data partitioning support has also been added.
Other additions include a libcurl protocol, an iTerm2 inline image protocol muxer, and improved AVFoundation input device selection using unique identifiers and USB serial numbers. New decoders cover Rhetorex ADPCM, ADPCM IMA Citrix, and Infinity IMM6 video, while the MVR demuxer and Windows handle protocol further expand format and platform support.
For additional details, see the changelog. The release notes are here. FFmpeg 9.1 source code is available from the project’s download page.
