February 2025 - ffmpeg-user - lists.ffmpeg.org

Would it be possible to load xattr-related media-files like a container?
by Peter B. 02 Aug '25

02 Aug '25

Hi everyone :) I'm working a lot with extended attributes on filesystems, and I'm amazed! I was wondering if it would be possible for ffmpeg to load "related media-streams" as related objects: Having a 0-Byte "videofile.aha": * video = /path/to/my_movie.h264 * audio = ./my_movie-DE_AT.flac * audio.1 = my_movie-EN_GB.mp3 * video.default = video * audio.default = audio.1 * dc.title = "My Movie" * dc.creator = "..." * ... Like an input demuxer which resolves the related objects and treats this like loading a container? I imagine this to be quite fun (and useful actually). One could then drag-and-drop to remux tracks, and right-click-edit metadata, I imagine. Feedback greatly appreciated :) Have a great day! Peter

1 1

has setpts filter been changed?
by William C Bonner 21 Mar '25

21 Mar '25

I use setpts to speed up some video that I'm concatenating from my car's dashcam. The process is consistent and hasn't changed recently. Here's an example command line: C:\Windows\ffmpeg.exe -hide_banner -i D:\ROAV\MOVIE\2024_0803_173613_229.MP4 -i D:\ROAV\MOVIE\2024_0803_173713_230.MP4 -i D:\ROAV\MOVIE\2024_0803_173813_231.MP4 -i D:\ROAV\MOVIE\2024_0803_173913_232.MP4 -i D:\ROAV\MOVIE\2024_0803_174013_233.MP4 -i D:\ROAV\MOVIE\2024_0803_174113_234.MP4 -i D:\ROAV\MOVIE\2024_0803_174213_235.MP4 -i D:\ROAV\MOVIE\2024_0803_174313_236.MP4 -i D:\ROAV\MOVIE\2024_0803_174413_237.MP4 -i D:\ROAV\MOVIE\2024_0803_174513_238.MP4 -i D:\ROAV\MOVIE\2024_0803_174613_239.MP4 -i D:\ROAV\MOVIE\2024_0803_174713_240.MP4 -i D:\ROAV\MOVIE\2024_0803_174813_241.MP4 -i D:\ROAV\MOVIE\2024_0803_174913_242.MP4 -i D:\ROAV\MOVIE\2024_0803_175013_243.MP4 -i D:\ROAV\MOVIE\2024_0803_175113_244.MP4 -i D:\ROAV\MOVIE\2024_0803_175213_245.MP4 -i D:\ROAV\MOVIE\2024_0803_175313_246.MP4 -i D:\ROAV\MOVIE\2024_0803_175413_247.MP4 -i D:\ROAV\MOVIE\2024_0803_175513_248.MP4 -i D:\ROAV\MOVIE\2024_0803_175613_249.MP4 -i D:\ROAV\MOVIE\2024_0803_175713_250.MP4 -i D:\ROAV\MOVIE\2024_0803_175813_251.MP4 -i D:\ROAV\MOVIE\2024_0803_175913_252.MP4 -i D:\ROAV\MOVIE\2024_0803_180013_253.MP4 -i D:\ROAV\MOVIE\2024_0803_180113_254.MP4 -i D:\ROAV\MOVIE\2024_0803_180213_255.MP4 -filter_complex [0:v][1:v][2:v][3:v][4:v][5:v][6:v][7:v][8:v][9:v][10:v][11:v][12:v][13:v][14:v][15:v][16:v][17:v][18:v][19:v][20:v][21:v][22:v][23:v][24:v][25:v][26:v]concat=n=27:v=1[v];[v]setpts=(1/60)*PTS,drawtext=fontfile=C\\:/Windows/Fonts/consola.ttf:fontcolor=white:fontsize=80:y=main_h-text_h-50:x=50:text=WimsWorld[o] -map [o] -map_metadata -1 -c:v libx265 -crf 23 -preset veryfast -movflags +faststart -bf 2 -g 15 -pix_fmt yuv420p -n D:\ROAV\20240803-BMW.mp4 The important part is setpts=(1/60)*PTS which should convert 1 minute of the source video to 1 second in the destination I noticed that watching recent videos strangely seemed much smoother, then realized that they were also significantly larger. https://trac.ffmpeg.org/wiki/How%20to%20speed%20up%20/%20slow%20down%20a%20… still says that using this method will drop frames, but when I ran ffprobe on the current file I got: C:\Users\Wim>ffprobe d:\ROAV\20240803-BMW.mp4 ffprobe version 2024-07-18-git-fa5a605542-full_build-www.gyan.dev Copyright (c) 2007-2024 the FFmpeg developers built with gcc 13.2.0 (Rev5, Built by MSYS2 project) configuration: --enable-gpl --enable-version3 --enable-static --disable-w32threads --disable-autodetect --enable-fontconfig --enable-iconv --enable-gnutls --enable-libxml2 --enable-gmp --enable-bzlib --enable-lzma --enable-libsnappy --enable-zlib --enable-librist --enable-libsrt --enable-libssh --enable-libzmq --enable-avisynth --enable-libbluray --enable-libcaca --enable-sdl2 --enable-libaribb24 --enable-libaribcaption --enable-libdav1d --enable-libdavs2 --enable-libopenjpeg --enable-libquirc --enable-libuavs3d --enable-libxevd --enable-libzvbi --enable-libqrencode --enable-librav1e --enable-libsvtav1 --enable-libvvenc --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxavs2 --enable-libxeve --enable-libxvid --enable-libaom --enable-libjxl --enable-libvpx --enable-mediafoundation --enable-libass --enable-frei0r --enable-libfreetype --enable-libfribidi --enable-libharfbuzz --enable-liblensfun --enable-libvidstab --enable-libvmaf --enable-libzimg --enable-amf --enable-cuda-llvm --enable-cuvid --enable-dxva2 --enable-d3d11va --enable-d3d12va --enable-ffnvcodec --enable-libvpl --enable-nvdec --enable-nvenc --enable-vaapi --enable-libshaderc --enable-vulkan --enable-libplacebo --enable-opencl --enable-libcdio --enable-libgme --enable-libmodplug --enable-libopenmpt --enable-libopencore-amrwb --enable-libmp3lame --enable-libshine --enable-libtheora --enable-libtwolame --enable-libvo-amrwbenc --enable-libcodec2 --enable-libilbc --enable-libgsm --enable-libopencore-amrnb --enable-libopus --enable-libspeex --enable-libvorbis --enable-ladspa --enable-libbs2b --enable-libflite --enable-libmysofa --enable-librubberband --enable-libsoxr --enable-chromaprint libavutil 59. 28.100 / 59. 28.100 libavcodec 61. 10.100 / 61. 10.100 libavformat 61. 5.101 / 61. 5.101 libavdevice 61. 2.100 / 61. 2.100 libavfilter 10. 2.102 / 10. 2.102 libswscale 8. 2.100 / 8. 2.100 libswresample 5. 2.100 / 5. 2.100 libpostproc 58. 2.100 / 58. 2.100 Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'd:\ROAV\20240803-BMW.mp4': Metadata: major_brand : isom minor_version : 512 compatible_brands: isomiso2mp41 encoder : Lavf61.5.101 Duration: 00:00:27.07, start: 0.000000, bitrate: 889896 kb/s Stream #0:0[0x1](und): Video: hevc (Main) (hev1 / 0x31766568), yuv420p(tv, progressive), 2560x1440, 889591 kb/s, 1800.04 fps, 1000k tbr, 1000k tbn (default) Metadata: handler_name : VideoHandler vendor_id : [0][0][0][0] encoder : Lavc61.10.100 libx265 Running it on an older file produced: C:\Users\Wim>ffprobe d:\ROAV\20240523-BMW.mp4 ffprobe version 2024-07-18-git-fa5a605542-full_build-www.gyan.dev Copyright (c) 2007-2024 the FFmpeg developers built with gcc 13.2.0 (Rev5, Built by MSYS2 project) configuration: --enable-gpl --enable-version3 --enable-static --disable-w32threads --disable-autodetect --enable-fontconfig --enable-iconv --enable-gnutls --enable-libxml2 --enable-gmp --enable-bzlib --enable-lzma --enable-libsnappy --enable-zlib --enable-librist --enable-libsrt --enable-libssh --enable-libzmq --enable-avisynth --enable-libbluray --enable-libcaca --enable-sdl2 --enable-libaribb24 --enable-libaribcaption --enable-libdav1d --enable-libdavs2 --enable-libopenjpeg --enable-libquirc --enable-libuavs3d --enable-libxevd --enable-libzvbi --enable-libqrencode --enable-librav1e --enable-libsvtav1 --enable-libvvenc --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxavs2 --enable-libxeve --enable-libxvid --enable-libaom --enable-libjxl --enable-libvpx --enable-mediafoundation --enable-libass --enable-frei0r --enable-libfreetype --enable-libfribidi --enable-libharfbuzz --enable-liblensfun --enable-libvidstab --enable-libvmaf --enable-libzimg --enable-amf --enable-cuda-llvm --enable-cuvid --enable-dxva2 --enable-d3d11va --enable-d3d12va --enable-ffnvcodec --enable-libvpl --enable-nvdec --enable-nvenc --enable-vaapi --enable-libshaderc --enable-vulkan --enable-libplacebo --enable-opencl --enable-libcdio --enable-libgme --enable-libmodplug --enable-libopenmpt --enable-libopencore-amrwb --enable-libmp3lame --enable-libshine --enable-libtheora --enable-libtwolame --enable-libvo-amrwbenc --enable-libcodec2 --enable-libilbc --enable-libgsm --enable-libopencore-amrnb --enable-libopus --enable-libspeex --enable-libvorbis --enable-ladspa --enable-libbs2b --enable-libflite --enable-libmysofa --enable-librubberband --enable-libsoxr --enable-chromaprint libavutil 59. 28.100 / 59. 28.100 libavcodec 61. 10.100 / 61. 10.100 libavformat 61. 5.101 / 61. 5.101 libavdevice 61. 2.100 / 61. 2.100 libavfilter 10. 2.102 / 10. 2.102 libswscale 8. 2.100 / 8. 2.100 libswresample 5. 2.100 / 5. 2.100 libpostproc 58. 2.100 / 58. 2.100 Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'd:\ROAV\20240523-BMW.mp4': Metadata: major_brand : isom minor_version : 512 compatible_brands: isomiso2mp41 encoder : Lavf61.3.103 Duration: 00:09:40.88, start: 0.000000, bitrate: 26675 kb/s Stream #0:0[0x1](und): Video: hevc (Main) (hev1 / 0x31766568), yuv420p(tv, progressive), 2560x1440, 26672 kb/s, 25 fps, 25 tbr, 12800 tbn (default) Metadata: handler_name : VideoHandler vendor_id : [0][0][0][0] encoder : Lavc61.5.104 libx265 The important difference is that the older file reports 2560x1440, 26672 kb/s, 25 fps, 25 tbr, 12800 tbn and the newer file reports 2560x1440, 889591 kb/s, 1800.04 fps, 1000k tbr, 1000k tbn. This seems that the new code speed up the reported fps without dropping any frames.

3 4

ffmpeg doesn't reconnect when capturing live connections
by arthurpeabody 16 Mar '25

16 Mar '25

It begins with: ffmpeg -i https://listen.wruu.org/stream -t 3720 -reconnect true -reconnect_streamed true -reconnect_on_network_error true -timelimit 3720 -loglevel warning wruu_JoeFrank-20250130-2100.mp3 ffmpeg version 7.1 Copyright (c) 2000-2024 the FFmpeg developers built with gcc 14.2.0 (GCC) configuration: --prefix=/usr --libdir=/usr/lib64 --shlibdir=/usr/lib64 --docdir=/usr/doc/ffmpeg-7.1/html --mandir=/usr/man --disable-debug --enable-shared --disable-static --enable-gpl --enable-version3 --arch=x86_64 --disable-encoder=aac --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-gnutls --enable-libass --enable-libbluray --enable-libcaca --enable-libcdio --enable-frei0r --enable-openal --enable-libopus --enable-libspeex --enable-libssh --enable-libtheora --enable-libv4l2 --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libmp3lame --enable-opencl --enable-opengl --enable-libopenjpeg --enable-libpulse --enable-libsmbclient --enable-libxml2 --enable-librsvg --enable-vulkan --enable-libdrm --enable-libaom --enable-libdav1d --enable-libshaderc --enable-gcrypt --enable-libplacebo --enable-lcms2 libavutil 59. 39.100 / 59. 39.100 libavcodec 61. 19.100 / 61. 19.100 libavformat 61. 7.100 / 61. 7.100 libavdevice 61. 3.100 / 61. 3.100 libavfilter 10. 4.100 / 10. 4.100 libswscale 8. 3.100 / 8. 3.100 libswresample 5. 3.100 / 5. 3.100 libpostproc 58. 3.100 / 58. 3.100 Splitting the commandline. Reading option '-i' ... matched as input url with argument 'https://listen.wruu.org/stream'. Reading option '-t' ... matched as option 't' (stop transcoding after specified duration) with argument '3720'. Reading option '-reconnect' ... matched as AVOption 'reconnect' with argument 'true'. Reading option '-reconnect_streamed' ... matched as AVOption 'reconnect_streamed' with argument 'true'. Reading option '-reconnect_on_network_error' ... matched as AVOption 'reconnect_on_network_error' with argument 'true'. Reading option '-timelimit' ... matched as option 'timelimit' (set max runtime in seconds in CPU user time) with argument '3720'. Reading option '-v' ... matched as option 'v' (set logging level) with argument '48'. Reading option 'wruu_JoeFrank-20250130-2100.mp3' ... matched as output url. Finished splitting the commandline. Parsing a group of options: global . Applying option timelimit (set max runtime in seconds in CPU user time) with argument 3720. Applying option v (set logging level) with argument 48. Successfully parsed a group of options. Parsing a group of options: input url https://listen.wruu.org/stream. Successfully parsed a group of options. Opening an input file: https://listen.wruu.org/stream. [AVFormatContext @ 0x36542540] Opening 'https://listen.wruu.org/stream' for reading [https @ 0x365388c0] Setting default whitelist 'http,https,tls,rtp,tcp,udp,crypto,httpproxy' size= 9984KiB time=00:10:48.15 bitrate= 126.2kbits/s speed=0.0019x [tcp @ 0x36542e00] Original list of addresses: [tcp @ 0x36542e00] Address 165.227.18.155 port 443 [tcp @ 0x36542e00] Interleaved list of addresses: [tcp @ 0x36542e00] Address 165.227.18.155 port 443 [tcp @ 0x36542e00] Starting connection attempt to 165.227.18.155 port 443 [tcp @ 0x36542e00] Successfully connected to 165.227.18.155 port 443 [https @ 0x365388c0] request: GET /stream HTTP/1.1 User-Agent: Lavf/61.7.100 Accept: */* Range: bytes=0- Connection: close Host: listen.wruu.org Icy-MetaData: 1 [mp3 @ 0x36542540] Format mp3 probed with size=4096 and score=51 [mp3 @ 0x36542540] Skipping 0 bytes of junk at 0. [mp3 @ 0x36542540] Before avformat_find_stream_info() pos: 0 bytes read:7569 seeks:0 nb_streams:1 [https @ 0x365388c0] Metadata update for StreamTitle: - WRUU-WRUU [mp3 @ 0x36542540] All info found [mp3 @ 0x36542540] After avformat_find_stream_info() pos: 31744 bytes read:32000 seeks:0 frames:50 Input #0, mp3, from 'https://listen.wruu.org/stream': Metadata: icy-br : 192 icy-channels : 2 icy-name : WRUU 2022 icy-pub : 1 icy-samplerate : 44100 StreamTitle : - WRUU-WRUU Duration: N/A, start: 0.000000, bitrate: 192 kb/s Stream #0:0, 50, 1/14112000: Audio: mp3 (mp3float), 44100 Hz, stereo, fltp, 192 kb/s Successfully opened the file. Parsing a group of options: output url wruu_JoeFrank-20250130-2100.mp3. Applying option t (stop transcoding after specified duration) with argument 3720. Successfully parsed a group of options. Opening an output file: wruu_JoeFrank-20250130-2100.mp3. [out#0/mp3 @ 0x36888b80] No explicit maps, mapping streams automatically... [aost#0:0/libmp3lame @ 0x36889c80] Created audio stream from input stream 0:0 [file @ 0x3689d1c0] Setting default whitelist 'file,crypto,data' Successfully opened the file. Stream mapping: Stream #0:0 -> #0:0 (mp3 (mp3float) -> mp3 (libmp3lame)) [aost#0:0/libmp3lame @ 0x36889c80] Starting thread... [af#0:0 @ 0x36546c00] Starting thread... [aist#0:0/mp3 @ 0x3655f340] [dec:mp3float @ 0x368786c0] Starting thread... [in#0/mp3 @ 0x36542280] Starting thread... Press [q] to stop, [?] for help detected 4 logical cores [graph_-1_in_0:0 @ 0x7fdb580022c0] Setting 'time_base' to value '1/44100' [graph_-1_in_0:0 @ 0x7fdb580022c0] Setting 'sample_rate' to value '44100' [graph_-1_in_0:0 @ 0x7fdb580022c0] Setting 'sample_fmt' to value 'fltp' [graph_-1_in_0:0 @ 0x7fdb580022c0] Setting 'channel_layout' to value 'stereo' [graph_-1_in_0:0 @ 0x7fdb580022c0] tb:1/44100 samplefmt:fltp samplerate:44100 chlayout:stereo [format_out_#0:0 @ 0x7fdb58002c80] Setting 'sample_fmts' to value 's32p|fltp|s16p' [format_out_#0:0 @ 0x7fdb58002c80] Setting 'sample_rates' to value '44100|48000|32000|22050|24000|16000|11025|12000|8000' [format_out_#0:0 @ 0x7fdb58002c80] Setting 'channel_layouts' to value 'mono|stereo' [AVFilterGraph @ 0x7fdb58001000] query_formats: 5 queried, 9 merged, 3 already done, 0 delayed Output #0, mp3, to 'wruu_JoeFrank-20250130-2100.mp3': Metadata: icy-br : 192 icy-channels : 2 icy-name : WRUU 2022 icy-pub : 1 icy-samplerate : 44100 StreamTitle : - WRUU-WRUU TSSE : Lavf61.7.100 Stream #0:0, 0, 1/44100: Audio: mp3, 44100 Hz, stereo, fltp, delay 1105 Metadata: encoder : Lavc61.19.100 libmp3lame [out#0/mp3 @ 0x36888b80] Starting thread... Then there are thousands of entries like this: out#0/mp3 @ 0x36888b80] sq: send 0 ts 0.0261224 [out#0/mp3 @ 0x36888b80] sq: receive 0 ts 0.0261224 queue head -1 ts N/A [out#0/mp3 @ 0x36888b80] sq: send 0 ts 0.0522449 [out#0/mp3 @ 0x36888b80] sq: receive 0 ts 0.0522449 queue head -1 ts N/A [out#0/mp3 @ 0x36888b80] sq: send 0 ts 0.0783673 Then thousands that look like this: size= 54272KiB time=00:58:02.98 bitrate= 127.6kbits/s speed=0.679x No error is reported. ffmpeg is still running after its specified time.

2 1

Issue with Delayed Packet Writing to MP4 Container Using Hardware Encoder (h264_v4l2m2m) in FFmpeg API
by Lisa 05 Mar '25

05 Mar '25

Hello. I am trying to store the encoded packets to a mp4 container file using av_interlenced_write_packet() ffmpeg api. With Hardware encoder[h264_v4l2m2m] there is an issue when I add 1 second delay to write encoded Packets to the mp4 container. While writing the packets there are no errors but the encoded video is not playing.When verified with *mediainfo* CLI, got some partial metadata about the video. NOTE: Without delay there is no issue with recorded video. - *Mediainfo output of video without delay* [image: mediainfo_of_no_delay.png] - *Mediainfo output of video with delay* [image: mediainfo_of_with_delay.png] The flow of my code is as described in the text and illustrated in the flow diagram. ... ->send packet to encode ->Receive packet ->then clone the packet with av_packet_clone(sourcePacket) ->modified the pts & dts and ->writing frames to disk using av_interleaved_write_frame <https://www.ffmpeg.org/doxygen/4.0/group__lavf__encoding.html#ga37352ed2c63…> (AVFormatContext <https://www.ffmpeg.org/doxygen/4.0/structAVFormatContext.html> *s <https://www.ffmpeg.org/doxygen/4.0/llviddspenc_8c.html#a517a4433fe5466cc6af…> , AVPacket <https://www.ffmpeg.org/doxygen/4.0/structAVPacket.html> *pkt <https://www.ffmpeg.org/doxygen/4.0/demuxing__decoding_8c.html#a3d4c6562f0b2…> ) ... [image: ffmpeg.png] 1. Why is the issue occurring with a delay of about 1 second? 2. How can this issue be resolved?

1 1

ffmpeg: undefined symbol: av_container_fifo_peek, version LIBAVUTIL_59
by Gianluca Cannata 04 Mar '25

04 Mar '25

Good morning, I have configured ffmpeg with the following configuration ./configure --prefix=/usr --disable-static --enable-shared --enable-gpl --enable-version3 --disable-programs --disable-doc --disable-avdevice --enable-swresample --disable-swscale --disable-postproc --disable-network --disable-everything --enable-protocol='file, subfile, pipe' --enable-demuxer='ogg' --enable-muxer=ogg --enable-decoder='vorbis,theora,opus,flac' --enable-ffprobe --enable-ffmpeg --enable-debug to enable debug symbols. Installation went ok but when I type ffmpeg command I get the the following: gdb ffmpeg_g GNU gdb (Ubuntu 12.1-0ubuntu1~22.04.2) 12.1 Copyright (C) 2022 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html > This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-linux-gnu". Type "show configuration" for configuration details. For bug reporting instructions, please see: <https://www.gnu.org/software/gdb/bugs/>. Find the GDB manual and other documentation resources online at: <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from ffmpeg_g... (gdb) r Starting program: /home/gianluca/Lavoro/FFmpeg/ffmpeg/ffmpeg_g /home/gianluca/Lavoro/FFmpeg/ffmpeg/ffmpeg_g: symbol lookup error: /home/gianluca/Lavoro/FFmpeg/ffmpeg/ffmpeg_g: undefined symbol: av_container_fifo_peek, version LIBAVUTIL_59 [Inferior 1 (process 2957287) exited with code 0177] (gdb) exit Did I do something wrong ? Gianluca

3 3

Re: [FFmpeg-user] overlay_qsv with hardware decode and encode
by Vladimir Mishonov 01 Mar '25

01 Mar '25

On 2025-02-28 22:00, Dragan Randjelovic wrote: > Hi Vladimir, > > I have noticed that you were strugling, try using the following: > > scale_vaapi=w=-1:h=-1 ensures hardware scaling before overlay (source > resolution is kept with -1) Thank you for your reply. I'm verry sorry to say, however, that it doesn't help me much, if at all: > ffmpeg -init_hw_device vaapi=hw -filter_hw_device hw \ > -i rtmp://localhost/stream1 \ > -i rtmp://localhost/stream2 \ > -filter_complex " > [0:v]format=nv12,hwupload=extra_hw_frames=20,scale_vaapi=w=-1:h=-1[i0]; > [1:v]format=nv12,hwupload=extra_hw_frames=20,scale_vaapi=w=-1:h=-1[i1]; > [i0][i1]overlay_vaapi" > -c:v h264_vaapi -global_quality 25 -g 50 -r 25 -an -f null - This command works perfectly already without any "scale_vaapi" filter regardless of the input streams' resolutions. However, it uses software decoding, which is evident by the lack of "-hwaccel vaapi -hwaccel_output_format vaapi" arguments for inputs, and also by the use of the hwupload filters. Setting extra_hw_frames=20 does reduce memory usage indeed. I've seen the recommendation to keep it relatively high (around 100) to reduce the risk of issues during encoding. But I don't much care about memory usage anyway since I have a lot of memory to spare. Just in case there's been a misunderstanding, let me repeat the command that uses a purely hardware transcoding pipeline, and which works only when input streams have the same resolution: ffmpeg \ -hwaccel vaapi -hwaccel_output_format vaapi -i rtmp://localhost/stream1 \ -hwaccel vaapi -hwaccel_output_format vaapi -i rtmp://localhost/stream2 \ -filter_complex "[0:v][1:v]overlay_vaapi=w=500" \ -c:v h264_vaapi -global_quality 25 -g 50 -r 25 -an -f null - And no, putting "scale_vaapi" before overlay here does not help. P.S. I'm wondering if this recommendation was written by AI, by the way. > Regards > Dragan Randelovic > > On Fri, Feb 28, 2025 at 6:37 PM Vladimir Mishonov via ffmpeg-user > <ffmpeg-user(a)ffmpeg.org> wrote: > >> On 2025-02-28 19:53, Greg Oliver wrote: >>> On Thu, Feb 27, 2025 at 11:49 PM Vladimir Mishonov via ffmpeg-user < >>> ffmpeg-user(a)ffmpeg.org> wrote: >>> >>> Sorry - that link I referenced actually did not have the whole >>> thread. >>> The >>> piece I intended to be included was: >>> >>> https://lists.ffmpeg.org/pipermail/ffmpeg-user/2024-September/058652.html >>> >> >> Unfortunately, the -noautoscale option does not work either, I've >> already tried that before. >> >> It is, however, not surprising that it has no effect because >> -noautoscale is an output option. And in my scenario, the output >> resolution does not change over time. >> >> As for the patch linked in that thread, I have yet to try it. Not sure >> if it's already been merged into master; if not, it means I have to >> compile a build myself, and setting everything up for that is likely >> going to take a while... >> >>> If that does not solve it - sorry - I do not use QSV (except in Plex) >>> for >>> anything - I just remembered seeing that email thread a while back, >>> so >>> looked it up. This one has a resolution, but I am unsure if it is >>> software >>> or hardware. >>> >> >> No problem. What I still cannot understand is whether this is some >> kind >> of fundamental limitation or an outright bug. For some reason, I could >> find very little information about this particular scenario. Whenever >> I >> search for that error message ("impossible to convert between..."), it >> always seems to concern a completely different use case. >> >>> >>> _______________________________________________ >>> ffmpeg-user mailing list >>> ffmpeg-user(a)ffmpeg.org >>> https://ffmpeg.org/mailman/listinfo/ffmpeg-user >>> >>> To unsubscribe, visit link above, or email >>> ffmpeg-user-request(a)ffmpeg.org with subject "unsubscribe". >> _______________________________________________ >> ffmpeg-user mailing list >> ffmpeg-user(a)ffmpeg.org >> https://ffmpeg.org/mailman/listinfo/ffmpeg-user >> >> To unsubscribe, visit link above, or email >> ffmpeg-user-request(a)ffmpeg.org with subject "unsubscribe".

2 5

overlay_qsv with hardware decode and encode
by Vladimir Mishonov 28 Feb '25

28 Feb '25

Greetings everyone. I am attempting to overlay 2 video streams in real-time with QuickSync hardware acceleration. I want to use both hardware decode and encode to make the most use out of the GPU and avoid excessive CPU usage. I've found an example command-line here: https://github.com/intel/vaapi-fits/issues/173 and adapted it: ./ffmpeg \ -hwaccel qsv -c:v h264_qsv -i rtmp://localhost/stream1 \ -hwaccel qsv -c:v h264_qsv -i rtmp://localhost/stream2 \ -filter_complex "[0:v][1:v]overlay_qsv=w=500" \ -c:v h264_qsv -global_quality 25 -g 50 -r 25 -an test.h264 However, this gives me the following error: ffmpeg version N-118510-gbc1a3bfd2c-20250220 Copyright (c) 2000-2025 the FFmpeg developers built with gcc 14.2.0 (crosstool-NG 1.26.0.120_4d36f27) configuration: --prefix=/ffbuild/prefix --pkg-config-flags=--static --pkg-config=pkg-config --cross-prefix=x86_64-ffbuild-linux-gnu- --arch=x86_64 --target-os=linux --enable-gpl --enable-version3 --disable-debug --enable-iconv --enable-zlib --enable-libfreetype --enable-libfribidi --enable-gmp --enable-libxml2 --enable-openssl --enable-lzma --enable-fontconfig --enable-libharfbuzz --enable-libvorbis --enable-opencl --enable-libpulse --enable-libvmaf --enable-libxcb --enable-xlib --enable-amf --enable-libaom --enable-libaribb24 --enable-avisynth --enable-chromaprint --enable-libdav1d --enable-libdavs2 --enable-libdvdread --enable-libdvdnav --disable-libfdk-aac --enable-ffnvcodec --enable-cuda-llvm --enable-frei0r --enable-libgme --enable-libkvazaar --enable-libaribcaption --enable-libass --enable-libbluray --enable-libjxl --enable-libmp3lame --enable-libopus --enable-librist --enable-libssh --enable-libtheora --enable-libvpx --enable-libwebp --enable-libzmq --enable-lv2 --enable-libvpl --enable-openal --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenh264 --enable-libopenjpeg --enable-libopenmpt --enable-librav1e --enable-librubberband --disable-schannel --enable-sdl2 --enable-libsnappy --enable-libsoxr --enable-libsrt --enable-libsvtav1 --enable-libtwolame --enable-libuavs3d --enable-libdrm --enable-vaapi --enable-libvidstab --enable-vulkan --enable-libshaderc --enable-libplacebo --disable-libvvenc --enable-libx264 --enable-libx265 --enable-libxavs2 --enable-libxvid --enable-libzimg --enable-libzvbi --extra-cflags=-DLIBTWOLAME_STATIC --extra-cxxflags= --extra-libs='-ldl -lgomp' --extra-ldflags=-pthread --extra-ldexeflags=-pie --cc=x86_64-ffbuild-linux-gnu-gcc --cxx=x86_64-ffbuild-linux-gnu-g++ --ar=x86_64-ffbuild-linux-gnu-gcc-ar --ranlib=x86_64-ffbuild-linux-gnu-gcc-ranlib --nm=x86_64-ffbuild-linux-gnu-gcc-nm --extra-version=20250220 libavutil 59. 57.100 / 59. 57.100 libavcodec 61. 33.102 / 61. 33.102 libavformat 61. 9.107 / 61. 9.107 libavdevice 61. 4.100 / 61. 4.100 libavfilter 10. 9.100 / 10. 9.100 libswscale 8. 13.100 / 8. 13.100 libswresample 5. 4.100 / 5. 4.100 libpostproc 58. 4.100 / 58. 4.100 [vist#0:1/h264 @ 0x562c70e48780] WARNING: defaulting hwaccel_output_format to qsv for compatibility with old commandlines. This behaviour is DEPRECATED and will be removed in the future. Please explicitly set "-hwaccel_output_format qsv". Input #0, flv, from 'rtmp://localhost/stream1': Metadata: |RtmpSampleAccess: true Server : NGINX RTMP (github.com/arut/nginx-rtmp-module) displayWidth : 2560 displayHeight : 1440 fps : 25 profile : level : Duration: 00:00:00.00, start: 138266.736000, bitrate: N/A Stream #0:0: Audio: aac (LC), 48000 Hz, stereo, fltp, 128 kb/s Stream #0:1: Video: h264 (Main), yuvj420p(pc, bt709, progressive), 2560x1440, 25 fps, 25 tbr, 1k tbn [vist#1:1/h264 @ 0x562c70ef3b00] WARNING: defaulting hwaccel_output_format to qsv for compatibility with old commandlines. This behaviour is DEPRECATED and will be removed in the future. Please explicitly set "-hwaccel_output_format qsv". Input #1, flv, from 'rtmp://localhost/stream2': Metadata: |RtmpSampleAccess: true Server : NGINX RTMP (github.com/arut/nginx-rtmp-module) displayWidth : 2688 displayHeight : 1520 fps : 26 profile : level : Duration: 00:00:00.00, start: 138268.361000, bitrate: N/A Stream #1:0: Audio: aac (LC), 48000 Hz, stereo, fltp, 128 kb/s Stream #1:1: Video: h264 (High), yuvj420p(pc, progressive), 2688x1520 [SAR 1:1 DAR 168:95], 26 fps, 26 tbr, 1k tbn Stream mapping: Stream #0:1 (h264_qsv) -> overlay_qsv Stream #1:1 (h264_qsv) -> overlay_qsv overlay_qsv:default -> Stream #0:0 (h264_qsv) Press [q] to stop, [?] for help Impossible to convert between the formats supported by the filter 'graph 0 input from stream 1:1' and the filter 'auto_scale_0' [fc#0 @ 0x562c70e30a40] Error reinitializing filters! [fc#0 @ 0x562c70e30a40] Task finished with error code: -38 (Function not implemented) [fc#0 @ 0x562c70e30a40] Terminating thread with return code -38 (Function not implemented) [vost#0:0/h264_qsv @ 0x562c70ede940] [enc:h264_qsv @ 0x562c70edec40] Could not open encoder before EOF [vost#0:0/h264_qsv @ 0x562c70ede940] Task finished with error code: -22 (Invalid argument) [vost#0:0/h264_qsv @ 0x562c70ede940] Terminating thread with return code -22 (Invalid argument) [out#0/h264 @ 0x562c70e31240] Nothing was written into output file, because at least one of its streams received no packets. frame= 0 fps=0.0 q=0.0 Lsize= 0KiB time=N/A bitrate=N/A speed=N/A Conversion failed! If I remove the filter_complex and use just one input stream, it works without issue: ./ffmpeg \ -hwaccel qsv -c:v h264_qsv -i rtmp://localhost/stream1 \ -c:v h264_qsv -global_quality 25 -g 50 -r 25 -an test.h264 Could anyone please tell me what I'm doing wrong? Thank you very much. -- Kind regards, Vladimir

2 5

way to reencode corrupted video
by BloodMan 27 Feb '25

27 Feb '25

Hello, wetransfer mp4 test file: https://we.tl/t-BJKuiAHTKQ The video plays using VLC with glitches and drops (with sound until the end) but reencoding generally failed (silence after the first drop). How to survive? How to reencode with "ignore errors like play in vlc"? I tested many ffmpeg commands and tricks and nothing :/ Anyone? ps. ffmpeg from git (N-118536-g4ff1d1f3d6) of course -- BloodMan bloodman(a)gmail.com

5 7

Re: [FFmpeg-user] A query on FFmpeg's s12m timecode in H264 NVENC
by Dennis Mungai 26 Feb '25

26 Feb '25

On Sun, 23 Feb 2025 at 03:48, Timo Rothenpieler <timo(a)rothenpieler.org> wrote: > On 22.02.2025 21:32, Dennis Mungai wrote: > > On Sat, 22 Feb 2025 at 23:15, Timo Rothenpieler <timo(a)rothenpieler.org > > <mailto:timo@rothenpieler.org>> wrote: > > > > On 17.02.2025 23:45, Dennis Mungai wrote: > > > Hello there, > > > > > > In FFmpeg's HEVC & AV1 encoder wrappers, the private codec option > - > > > s12m_tc , documented as "Use timecode (if available)", is > > present, but > > > unmapped in the H.264 encode wrapper. > > > > > > This, however, should also be present in h264_nvenc, as indicated > in > > > ffnvcodec's https://github.com/FFmpeg/nv-codec-headers/blob/ > > master/ <https://github.com/FFmpeg/nv-codec-headers/blob/master/> > > > include/ffnvcodec/nvEncodeAPI.h#L2432 <https://github.com/FFmpeg/ > > nv- <https://github.com/FFmpeg/nv-> > > > codec-headers/blob/master/include/ffnvcodec/nvEncodeAPI.h#L2432> > > > > > > Is there a reason why this timecode SEI is omitted in h264_nvenc? > > > > Those time codes are not S12M side data, they'd be a completely new > > thing to implement, of which I'm not sure where to source the data > for. > > Not sure what exactly they are or what the difference is, but h264 > does > > not seem to support S12M time code sitedata, at least from looking at > > the lavc code. > > > > > > > > This is well noted. > > FFmpeg 4.1 (as per the changelog) https://github.com/FFmpeg/FFmpeg/ > > blob/master/Changelog <https://github.com/FFmpeg/FFmpeg/blob/master/ > > Changelog> does support decoding S12M timecode in h264. > > > > Circling back to the original question(s) with your additions above: > > 1. Can h264_nvenc be likewise configured to emit the equivalent "s12m > > timecode(s)" with a similar option as the av1 & hevc_nvenc encoder > wrappers? > > 2. Is pic timing SEI signalling implemented in h264_nvenc? > > Are you able to test this? > I pushed patches to https://github.com/BtbN/FFmpeg that should in theory > write those h264 picture timing SEI messages, but I can't find a single > sample that includes such time codes. > I can test the pic-timing SEI insertion(s) in NVENC, will run a build and report back shortly.

1 0

Re: [FFmpeg-user] A query on FFmpeg's s12m timecode in H264 NVENC
by Dennis Mungai 22 Feb '25

22 Feb '25

On Sat, 22 Feb 2025 at 23:15, Timo Rothenpieler <timo(a)rothenpieler.org> wrote: > On 17.02.2025 23:45, Dennis Mungai wrote: > > Hello there, > > > > In FFmpeg's HEVC & AV1 encoder wrappers, the private codec option - > > s12m_tc , documented as "Use timecode (if available)", is present, but > > unmapped in the H.264 encode wrapper. > > > > This, however, should also be present in h264_nvenc, as indicated in > > ffnvcodec's https://github.com/FFmpeg/nv-codec-headers/blob/master/ > > include/ffnvcodec/nvEncodeAPI.h#L2432 <https://github.com/FFmpeg/nv- > > codec-headers/blob/master/include/ffnvcodec/nvEncodeAPI.h#L2432> > > > > Is there a reason why this timecode SEI is omitted in h264_nvenc? > > Those time codes are not S12M side data, they'd be a completely new > thing to implement, of which I'm not sure where to source the data for. > Not sure what exactly they are or what the difference is, but h264 does > not seem to support S12M time code sitedata, at least from looking at > the lavc code. > This is well noted. FFmpeg 4.1 (as per the changelog) https://github.com/FFmpeg/FFmpeg/blob/master/Changelog does support decoding S12M timecode in h264. Circling back to the original question(s) with your additions above: 1. Can h264_nvenc be likewise configured to emit the equivalent "s12m timecode(s)" with a similar option as the av1 & hevc_nvenc encoder wrappers? 2. Is pic timing SEI signalling implemented in h264_nvenc?

1 0