December 2020 - ffmpeg-user - lists.ffmpeg.org

Re: [FFmpeg-user] JPGs->video1 ; MOV -> Mp4 video2 ; Concatenate - video2 audio OK but video is slow . .
by Philip Rhoades 18 Mar '23

18 Mar '23

Carl, There has been some improvement - I will top-post for clarity but the slow motion video has disappeared and the only remaining problem is that the audio and video are out of sync: I stuck with concat because it alllows me to specify image files more conveniently in the concat_demuxer?.txt file: ffmpeg -f concat -i concat_demuxer1.txt -vf scale=1024:576 -r 30000/1001 output1.mp4 ffmpeg -f concat -i concat_demuxer2.txt -vf scale=1024:576 -r 30000/1001 output2.mp4 ffmpeg -f concat -i concat_demuxer3.txt -vf scale=1024:576 -r 30000/1001 output3.mp4 - see attached output. for i in 1 2 3 do ffmpeg -ar 44100 -acodec pcm_s16le -f s16le -ac 2 -i /dev/zero \ -i output${i}.mp4 \ -vcodec copy \ -acodec aac \ -shortest output${i}_silent.mp4 done - see attached output. #!/bin/sh ffmpeg -f concat -i inputs.txt -vcodec copy -acodec copy 2019-03-22_#1_XR_ClimateEmergencyDeclarationDayNSW_LoRes.mp4 - see attached output. On 2019-03-27 10:48, Carl Eugen Hoyos wrote: > 2019-03-27 0:23 GMT+01:00, Philip Rhoades <phil(a)pricom.com.au>: > >> On 2019-03-27 07:22, Carl Eugen Hoyos wrote: >>> 2019-03-26 21:15 GMT+01:00, Philip Rhoades <phil(a)pricom.com.au>: >>> >>>> I converted 21 JPGs to a video with: >>> >>> Usually, converting jpgs with the image2 input works better than >>> concat. >> >> Right - I will try that. > > This is probably not your issue but the concat demuxer > has the disadvantage that the console output is not > very helpful. > >>>> ffmpeg -f concat -i concat_demuxer1.txt -vf scale=1024:576 -r >>>> 29.97 >>> >>> This framerate is never correct, a possible frame rate is 30000/1001 >> >> Hmm . . I was just using what was reported for the frame for the MOVs >> . >> . so using: >> >> "-r 30000/1001" >> >> is OK? > > It is better if that is the framerate of the mov (as I assume). > >>> You can add the audio already in this step. >> >> I did have a few attempts at that but couldn't get it working so I >> resorted to a two-step process - I will have another look. >> >> >>>> output1.mp4 >>>> >>>> I then added a silent audio track with: >>>> >>>> ffmpeg -ar 44100 -acodec pcm_s16le -f s16le -ac 2 -channel_layout >>>> 2.1 >>> >>> The channel number and layout do not match. >> >> Should it be just "stereo"? > > Or drop channel_layout, for -ac 2 it should not be needed. > >>>> -i /dev/zero \ >>>> -i output${i}.mp4 \ >>>> -vcodec copy \ >>>> -acodec aac \ >>>> -shortest output${i}_silent.mp4 >>> >>>> I had another MOV file (fr=29.97) that I converted with: >>>> >>>> newfn=`basename $fn .MOV` >>>> ffmpeg -i $fn -vf scale=1024:576 ./${newfn}.mp4 >>>> >>>> When I concatenate them with (and other converted JPGs and MOVS on >>>> the >>>> end) using: >>>> >>>> ffmpeg -f concat -i inputs.txt -vcodec copy -acodec copy \ >>>> 2019-03-22_#1_XR_ClimateEmergencyDeclarationDayNSW_LoRes.mp4 >>>> >>>> the concat succeeds OK but when I play the video, the audio is OK >>>> but >>>> then when it gets to the converted MOV section, people are moving in >>>> slow motion . . >>>> >>>> Another odd thing, the first 21 converted JPGs at 4 sec each >>>> correctly >>>> shows 84 sec when viewed with mpv but when the converted MOV starts >>>> it >>>> jumps to ~3m 50s . . >>>> >>>> So there is at least one problem but maybe two? Can anyone tell me >>>> what >>>> I am missing? >>> >>> You may have to re-encode, feel free to provide the complete, uncut >>> console output. > > ..feel free to provide the complete, uncut console output for the > command line you already tried and also ffmpeg -i output for > the input files (as concat doesn't show it). > > Carl Eugen -- Philip Rhoades PO Box 896 Cowra NSW 2794 Australia E-mail: phil(a)pricom.com.au

2 2

V360 stabilization
by Michael Koch 22 Nov '22

22 Nov '22

Hello all, I've programmed a C# workaround for stabilization of 360° videos. The procedure is as follows: 1. FFmpeg: From each frame of the equirectangular input video, extract two small images which are 90° apart in the input video. I call them A and B images. 2. C# code: Analyze the x and y image shift from subsequent A and B images. Calculate how the equirectangular frames must be rotated (yaw, pitch, roll) to compensate the image shifts. This part wasn't easy. Two rotation matrices and one matrix multiplication are required. Write the results to a *.cmd file. 3. FFmpeg: Read the *.cmd file and apply the rotations with the v360 filter. The output video is stabilized. For details and source code please have a look at chapter 2.78 in my book: http://www.astro-electronic.de/FFmpeg_Book.pdf If anyone wants to implement this in FFmpeg, please feel free to do it. Michael

4 22

asubboost and asupercut
by Michael Koch 01 Jul '22

01 Jul '22

Hello, I have a few questions about the asubboost and asupercut filters. -- In asubboost it's not yet clear how the block diagram of the filter looks like. Especially the "decay" and "feedback" options are unclear. What's the input of the the delay line? Before or after the low pass filter? Where does the feedback go to? Before or after the lowpass filter? I have attached a sketch of a possible block diagram, but it's only a wild guess. -- What's the unit of "delay"? Is it milliseconds? Or is it audio samples? -- Is it correct that the "slope" parameter effectively changes the cutoff frequency, but doesn't change the steepness (dB / octave) of the filter? -- What's the difference between "asupercut" and "lowpass" filter? What's the filter steepness of the asupercut filter? Michael

3 23

OVERLAY_CUDA and PGS Subtitle burn
by Panda Sing Cool 23 Nov '21

23 Nov '21

Hi everyone, i'm trying to use the OVERLAY_CUDA function to burn PGS titles over a video and the result is not working. i might misunderstand the usage of this function, so some help is welcome. The result of this command is a black screen with audio, using 'standard' overlay filter is working fine, but slow ... Notice this message at the end of the log file (ffmpeg version N-99194-g142ae27b1d ( compiled myself from git) ): *Error while add the frame to buffer source(Internal bug, should not have happened).* Thanks for any help. *************************************************************************************************************** ./ffmpeg -threads 1 -loglevel info -nostdin -y -fflags +genpts-fastseek \ -ss 00:00:00 -t 00:01:00 \ -extra_hw_frames 3 -vsync 0 -async 0 -filter_threads 1 -filter_complex_threads 1 \ -init_hw_device cuda=cuda -hwaccel cuda -filter_hw_device cuda -hwaccel_output_format cuda \ -i input.mkv \ -filter_complex \ * "[0:v]scale_npp=w=-1:h=720:interp_algo=lanczos:format=nv12[vid]; \ [0:s]format=nv12,hwupload_cuda[sub]; \ [vid][sub]overlay_cuda[v]" \* -map "[v]" -map 0:a \ -force_key_frames "expr:gte(t,n_forced*5)" \ -c:v h264_nvenc -preset:v slow -profile:v high -level:v 51 \ -rc:v cbr_hq -rc-lookahead:v 32 -refs:v 16 -cq:v 16 -bf:v 3 -b:v 2000K -minrate:v 2000K -maxrate:v 2000k -bufsize:v 8M -coder:v cabac -b_ref_mode:v middle \ -c:a libfdk_aac -ac 2 -ar 48000 -b:a 128k \ output.mkv ***** LOG **** f*fmpeg version N-99194-g142ae27b1d *Copyright (c) 2000-2020 the FFmpeg developers built with gcc 10 (GCC) configuration: --prefix=/home/users/work/ffmpeg_build --pkg-config-flags=--static --extra-libs=-lpthread --extra-libs=-lm --bindir=/home/users/work/ffmpeg_build/bin --enable-gpl --enable-libfdk_aac --enable-libfreetype --enable-libmp3lame --enable-libopus --enable-libvpx --enable-libx264 --enable-libx265 --enable-vulkan --enable-nonfree --enable-libnpp --enable-nvenc --enable-cuvid --enable-libass --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-cuda libavutil 56. 59.100 / 56. 59.100 libavcodec 58.106.100 / 58.106.100 libavformat 58. 56.100 / 58. 56.100 libavdevice 58. 11.102 / 58. 11.102 libavfilter 7. 87.100 / 7. 87.100 libswscale 5. 8.100 / 5. 8.100 libswresample 3. 8.100 / 3. 8.100 libpostproc 55. 8.100 / 55. 8.100 Input #0, matroska,webm, from 'input.mkv': Metadata: encoder : libebml v1.3.10 + libmatroska v1.5.2 creation_time : 2020-08-13T06:58:46.000000Z Duration: 00:57:53.06, start: 0.000000, bitrate: 12993 kb/s Chapter #0:0: start 0.000000, end 508.424583 Metadata: title : Chapter 01 Chapter #0:1: start 508.424583, end 1037.202833 Metadata: title : Chapter 02 Chapter #0:2: start 1037.202833, end 1510.175333 Metadata: title : Chapter 03 Chapter #0:3: start 1510.175333, end 2231.896333 Metadata: title : Chapter 04 Chapter #0:4: start 2231.896333, end 2908.530625 Metadata: title : Chapter 05 Chapter #0:5: start 2908.530625, end 3473.052917 Metadata: title : Chapter 06 Stream #0:0: Video: h264 (High), yuv420p(progressive), 1920x1080, SAR 1:1 DAR 16:9, 23.98 fps, 23.98 tbr, 1k tbn, 47.95 tbc (default) Metadata: BPS-eng : 10946248 DURATION-eng : 00:57:53.053000000 NUMBER_OF_FRAMES-eng: 83270 NUMBER_OF_BYTES-eng: 4752112489 _STATISTICS_WRITING_APP-eng: mkvmerge v46.0.0 ('No Deeper Escape') 64-bit _STATISTICS_WRITING_DATE_UTC-eng: 2020-08-13 06:58:46 _STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES Stream #0:1(eng): Audio: dts (DTS-HD MA), 48000 Hz, 5.1(side), s16p Metadata: BPS-eng : 2022940 DURATION-eng : 00:57:53.056000000 NUMBER_OF_FRAMES-eng: 325599 NUMBER_OF_BYTES-eng: 878223124 _STATISTICS_WRITING_APP-eng: mkvmerge v46.0.0 ('No Deeper Escape') 64-bit _STATISTICS_WRITING_DATE_UTC-eng: 2020-08-13 06:58:46 _STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES Stream #0:2(eng): Subtitle: hdmv_pgs_subtitle, 1920x1080 Metadata: BPS-eng : 44076 DURATION-eng : 00:56:53.660000000 NUMBER_OF_FRAMES-eng: 1450 NUMBER_OF_BYTES-eng: 18807980 _STATISTICS_WRITING_APP-eng: mkvmerge v46.0.0 ('No Deeper Escape') 64-bit _STATISTICS_WRITING_DATE_UTC-eng: 2020-08-13 06:58:46 _STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES Stream mapping: Stream #0:0 (h264) -> scale_npp (graph 0) Stream #0:2 (pgssub) -> format (graph 0) overlay_cuda (graph 0) -> Stream #0:0 (h264_nvenc) Stream #0:1 -> #0:1 (dts (dca) -> aac (libfdk_aac)) [matroska,webm @ 0x3a39bc0] sub2video: using 1920x1080 canvas Output #0, matroska, to 'output.mkv': Metadata: encoder : Lavf58.56.100 Chapter #0:0: start 0.000000, end 508.424583 Metadata: title : Chapter 01 Chapter #0:1: start 508.424583, end 1037.202833 Metadata: title : Chapter 02 Chapter #0:2: start 1037.202833, end 1510.175333 Metadata: title : Chapter 03 Chapter #0:3: start 1510.175333, end 2231.896333 Metadata: title : Chapter 04 Chapter #0:4: start 2231.896333, end 2908.530625 Metadata: title : Chapter 05 Chapter #0:5: start 2908.530625, end 3473.052917 Metadata: title : Chapter 06 Stream #0:0: Video: h264 (h264_nvenc) (High) (H264 / 0x34363248), cuda, 1280x720 [SAR 1:1 DAR 16:9], q=-1--1, 23.98 fps, 1k tbn, 23.98 tbc (default) Metadata: encoder : Lavc58.106.100 h264_nvenc Side data: cpb: bitrate max/min/avg: 2000000/0/0 buffer size: 8000000 vbv_delay: N/A Stream #0:1(eng): Audio: aac (libfdk_aac) ([255][0][0][0] / 0x00FF), 48000 Hz, stereo, s16, 128 kb/s Metadata: BPS-eng : 2022940 DURATION-eng : 00:57:53.056000000 NUMBER_OF_FRAMES-eng: 325599 NUMBER_OF_BYTES-eng: 878223124 _STATISTICS_WRITING_APP-eng: mkvmerge v46.0.0 ('No Deeper Escape') 64-bit _STATISTICS_WRITING_DATE_UTC-eng: 2020-08-13 06:58:46 _STATISTICS_TAGS-eng: BPS DURATION NUMBER_OF_FRAMES NUMBER_OF_BYTES encoder : Lavc58.106.100 libfdk_aac *Error while add the frame to buffer source(Internal bug, should not have happened).* frame= 360 fps=241 q=11.0 Lsize= 3813kB time=00:00:15.01 bitrate=2079.9kbits/s speed=10.1x video:3568kB audio:236kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.243563% ************************ Infos: ******** lspci ******* 0e:00.0 VGA compatible controller: NVIDIA Corporation TU102 [*GeForce RTX 2080 Ti Rev. A]* (rev a1) (prog-if 00 [VGA controller]) Subsystem: ZOTAC International (MCO) Ltd. Device 1503 Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+ Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx- *Kernel driver in use: nvidia* Kernel modules: nouveau, nvidia_drm, nvidia ********************** ******** nvidia-smi ******* +-----------------------------------------------------------------------------+ | NVIDIA-SMI *450.66 Driver Version: 450.66 CUDA Version: 11.0* | |-------------------------------+----------------------+----------------------+ **********************

3 8

FFmpeg on Apple Silicon (Success)
by Aleksid 29 Oct '21

29 Oct '21

Hi, Just for information. Today I successfully compiled FFmpeg 4.3.1 for Apple Silicon (macOS 11 Beta Big Sur) on Apple Developer Transition Kit. Also I was able to include FFmpeg shared libraries for my test app. I used basic configure options to make sure that FFmpeg works on arm64: ./configure --prefix=/usr/local/Cellar/ffmpeg/4.3.1 --enable-shared --extra-cflags="-fno-stack-check" --enable-gpl --enable-version3 --enable-hardcoded-tables --enable-pthreads --enable-nonfree I discovered only one issue (probably my mistake). dylibs work only when I put them to /usr/local/Cellar/ffmpeg/4.3.1/lib folder If I put dylibs into my APP bundle /Contents/Frameworks these dylibs fail to load, despite the fact that I load dylib using absolute file path from my folder.

2 3

Recording audio from mic and speakers from commandline
by Mohan G 28 Sep '21

28 Sep '21

Hi, I am using ffmpeg version 2.4.7 on Fedora-21 workstation. I want to record audio, simultaneously from mic and speakers as separate streams. I am using the following command for it. ffmpeg -f alsa -i pulse -f alsa -i default -acodec libmp3lame -map 0:0 -map 1:0 outfile.mkv But after executing this command in terminal, I have to goto "Volume Control" settings in GUI, then goto "Recording" tab, change the "capture from" of one channel to "Built-in Audio Analog Stereo" (i.e., Mic) and the "capture from" of another channel to "Monitor of Built-in Audio Analog Stereo" (i.e., Speakers). But how can this be done completely from command-line, for automating it to use in scripts. - Mohan

3 10

libaom - first frame not lossless when > 7 frames in source
by Kieran O Leary 21 Mar '21

21 Mar '21

Hi, I was doing some tests with libaom and lossness encoding and with synthetic files and some real world files, I kept finding that the framemd5s for the first frame was different than the source, but every other libaom encoded frame produced matching framemd5s for source and output. I then tried with smaller frame counts, and with synthetic files, I found that all frames would produce matching framemd5s when there was between 1 and 7 frames in the input. Once you went to 8 frames and above, the first frame would produce a framemd5 mismatch. here's a bunch of commands using ffmpeg git-master and what I assume to be libaom git master, or whatever the Ubuntu ffmpeg compilation wiki is using: 0) framemd5 output of the 8fr source - note the first frame value 1) Make a 8frame v210 via testsrc 2) Turn into av1 with -crf 0 3) get framemd5 of av1 output - note that first framemd5 value is different 4-6 - same as 1 to 3 but with a 7 frame testsrc file Any idea what's happening? Will I get the libx264-style answer: 'this is googles issue, not ffmpeg'0b1ae3e77528dcdacfab21761076d2b0b1ae3e77528dcdacfab21761076d2b /ffmpeg -i 8fr.mkv -f framemd5 - ffmpeg version N-98060-g1c32d7d Copyright (c) 2000-2020 the FFmpeg developers built with gcc 9 (Ubuntu 9.3.0-10ubuntu2) configuration: --prefix=/home/kieranjol/ffmpeg_build --pkg-config-flags=--static --extra-cflags=-I/home/kieranjol/ffmpeg_build/include --extra-ldflags=-L/home/kieranjol/ffmpeg_build/lib --extra-libs='-lpthread -lm' --bindir=/home/kieranjol/bin --enable-libaom libavutil 56. 50.100 / 56. 50.100 libavcodec 58. 90.100 / 58. 90.100 libavformat 58. 44.100 / 58. 44.100 libavdevice 58. 9.103 / 58. 9.103 libavfilter 7. 84.100 / 7. 84.100 libswscale 5. 6.101 / 5. 6.101 libswresample 3. 6.100 / 3. 6.100 Input #0, matroska,webm, from '8fr.mkv': Metadata: ENCODER : Lavf58.44.100 Duration: 00:00:00.32, start: 0.000000, bitrate: 43031 kb/s Stream #0:0: Video: v210 (v210 / 0x30313276), yuv422p10le, 320x240, SAR 1:1 DAR 4:3, 25 fps, 25 tbr, 1k tbn, 1k tbc (default) Metadata: ENCODER : Lavc58.90.100 v210 DURATION : 00:00:00.320000000 Stream mapping: Stream #0:0 -> #0:0 (v210 (native) -> rawvideo (native)) Press [q] to stop, [?] for help #format: frame checksums #version: 2 #hash: MD5 #software: Lavf58.44.100 #tb 0: 1/25 #media_type 0: video #codec_id 0: rawvideo #dimensions 0: 320x240 #sar 0: 1/1 #stream#, dts, pts, duration, size, hash Output #0, framemd5, to 'pipe:': Metadata: encoder : Lavf58.44.100 Stream #0:0: Video: rawvideo (Y3[10][10] / 0xA0A3359), yuv422p10le, 320x240 [SAR 1:1 DAR 4:3], q=2-31, 38400 kb/s, 25 fps, 25 tbn, 25 tbc (default) Metadata: DURATION : 00:00:00.320000000 encoder : Lavc58.90.100 rawvideo 0, 0, 0, 1, 307200, 50b1ae3e77528dcdacfab21761076d2b 0, 1, 1, 1, 307200, 8213a857506c099160fffb2f606f3590 0, 2, 2, 1, 307200, a5e0786c6d9d152c45e2d3a0122c8987 0, 3, 3, 1, 307200, fd93af578482e418d1378f6d9cd94f14 0, 4, 4, 1, 307200, abfca35c7aae65d1dcddee1ce370479f 0, 5, 5, 1, 307200, da151dbf22f7e818344d5efd0cbb6f09 0, 6, 6, 1, 307200, b87bdb747fbd80060f71585e7d2c6ac9 0, 7, 7, 1, 307200, af69163b6455654da3a37cf52cfc4525 frame= 8 fps=0.0 q=-0.0 Lsize= 1kB time=00:00:00.32 bitrate= 21.4kbits/s speed=33.1x video:2400kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown ./ffmpeg -f lavfi -i testsrc -c:v v210 -vframes 8 8fr.mkv ffmpeg version N-98060-g1c32d7d Copyright (c) 2000-2020 the FFmpeg developers built with gcc 9 (Ubuntu 9.3.0-10ubuntu2) configuration: --prefix=/home/kieranjol/ffmpeg_build --pkg-config-flags=--static --extra-cflags=-I/home/kieranjol/ffmpeg_build/include --extra-ldflags=-L/home/kieranjol/ffmpeg_build/lib --extra-libs='-lpthread -lm' --bindir=/home/kieranjol/bin --enable-libaom libavutil 56. 50.100 / 56. 50.100 libavcodec 58. 90.100 / 58. 90.100 libavformat 58. 44.100 / 58. 44.100 libavdevice 58. 9.103 / 58. 9.103 libavfilter 7. 84.100 / 7. 84.100 libswscale 5. 6.101 / 5. 6.101 libswresample 3. 6.100 / 3. 6.100 Input #0, lavfi, from 'testsrc': Duration: N/A, start: 0.000000, bitrate: N/A Stream #0:0: Video: rawvideo (RGB[24] / 0x18424752), rgb24, 320x240 [SAR 1:1 DAR 4:3], 25 tbr, 25 tbn, 25 tbc Stream mapping: Stream #0:0 -> #0:0 (rawvideo (native) -> v210 (native)) Press [q] to stop, [?] for help Output #0, matroska, to '8fr.mkv': Metadata: encoder : Lavf58.44.100 Stream #0:0: Video: v210 (v210 / 0x30313276), yuv422p, 320x240 [SAR 1:1 DAR 4:3], q=2-31, 40960 kb/s, 25 fps, 1k tbn, 25 tbc Metadata: encoder : Lavc58.90.100 v210 frame= 8 fps=0.0 q=-0.0 Lsize= 1681kB time=00:00:00.28 bitrate=49003.7kbits/s speed=39.4x video:1680kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.054408% kieranjol@POWERVIRUS:~/ffmpeg_sources/ffmpeg$ ./ffmpeg -i 8fr.mkv -c:v av1 -crf 0 8fr_av1.mkv ffmpeg version N-98060-g1c32d7d Copyright (c) 2000-2020 the FFmpeg developers built with gcc 9 (Ubuntu 9.3.0-10ubuntu2) configuration: --prefix=/home/kieranjol/ffmpeg_build --pkg-config-flags=--static --extra-cflags=-I/home/kieranjol/ffmpeg_build/include --extra-ldflags=-L/home/kieranjol/ffmpeg_build/lib --extra-libs='-lpthread -lm' --bindir=/home/kieranjol/bin --enable-libaom libavutil 56. 50.100 / 56. 50.100 libavcodec 58. 90.100 / 58. 90.100 libavformat 58. 44.100 / 58. 44.100 libavdevice 58. 9.103 / 58. 9.103 libavfilter 7. 84.100 / 7. 84.100 libswscale 5. 6.101 / 5. 6.101 libswresample 3. 6.100 / 3. 6.100 Input #0, matroska,webm, from '8fr.mkv': Metadata: ENCODER : Lavf58.44.100 Duration: 00:00:00.32, start: 0.000000, bitrate: 43031 kb/s Stream #0:0: Video: v210 (v210 / 0x30313276), yuv422p10le, 320x240, SAR 1:1 DAR 4:3, 25 fps, 25 tbr, 1k tbn, 1k tbc (default) Metadata: ENCODER : Lavc58.90.100 v210 DURATION : 00:00:00.320000000 Stream mapping: Stream #0:0 -> #0:0 (v210 (native) -> av1 (libaom-av1)) Press [q] to stop, [?] for help [libaom-av1 @ 0x5620559e0600] v2.0.0 Output #0, matroska, to '8fr_av1.mkv': Metadata: encoder : Lavf58.44.100 Stream #0:0: Video: av1 (libaom-av1) (AV01 / 0x31305641), yuv422p10le, 320x240 [SAR 1:1 DAR 4:3], q=-1--1, 25 fps, 1k tbn, 25 tbc (default) Metadata: DURATION : 00:00:00.320000000 encoder : Lavc58.90.100 libaom-av1 Side data: cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A frame= 8 fps=3.7 q=0.0 Lsize= 29kB time=00:00:00.28 bitrate= 837.3kbits/s speed=0.129x video:28kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 2.188944% kieranjol@POWERVIRUS:~/ffmpeg_sources/ffmpeg$ ./ffmpeg -i 8fr_av1.mkv -f framemd5 - ffmpeg version N-98060-g1c32d7d Copyright (c) 2000-2020 the FFmpeg developers built with gcc 9 (Ubuntu 9.3.0-10ubuntu2) configuration: --prefix=/home/kieranjol/ffmpeg_build --pkg-config-flags=--static --extra-cflags=-I/home/kieranjol/ffmpeg_build/include --extra-ldflags=-L/home/kieranjol/ffmpeg_build/lib --extra-libs='-lpthread -lm' --bindir=/home/kieranjol/bin --enable-libaom libavutil 56. 50.100 / 56. 50.100 libavcodec 58. 90.100 / 58. 90.100 libavformat 58. 44.100 / 58. 44.100 libavdevice 58. 9.103 / 58. 9.103 libavfilter 7. 84.100 / 7. 84.100 libswscale 5. 6.101 / 5. 6.101 libswresample 3. 6.100 / 3. 6.100 [libaom-av1 @ 0x558d1646b740] v2.0.0 Input #0, matroska,webm, from '8fr_av1.mkv': Metadata: ENCODER : Lavf58.44.100 Duration: 00:00:00.32, start: 0.000000, bitrate: 735 kb/s Stream #0:0: Video: av1 (Professional), yuv422p10le(tv), 320x240, SAR 1:1 DAR 4:3, 25 fps, 25 tbr, 1k tbn, 1k tbc (default) Metadata: ENCODER : Lavc58.90.100 libaom-av1 DURATION : 00:00:00.320000000 [libaom-av1 @ 0x558d16479800] v2.0.0 Stream mapping: Stream #0:0 -> #0:0 (av1 (libaom-av1) -> rawvideo (native)) Press [q] to stop, [?] for help #format: frame checksums #version: 2 #hash: MD5 #software: Lavf58.44.100 #tb 0: 1/25 #media_type 0: video #codec_id 0: rawvideo #dimensions 0: 320x240 #sar 0: 1/1 #stream#, dts, pts, duration, size, hash Output #0, framemd5, to 'pipe:': Metadata: encoder : Lavf58.44.100 Stream #0:0: Video: rawvideo (Y3[10][10] / 0xA0A3359), yuv422p10le, 320x240 [SAR 1:1 DAR 4:3], q=2-31, 38400 kb/s, 25 fps, 25 tbn, 25 tbc (default) Metadata: DURATION : 00:00:00.320000000 encoder : Lavc58.90.100 rawvideo 0, 0, 0, 1, 307200, e790aa300c6bdd6bad6770c6c6346585 0, 1, 1, 1, 307200, 8213a857506c099160fffb2f606f3590 0, 2, 2, 1, 307200, a5e0786c6d9d152c45e2d3a0122c8987 0, 3, 3, 1, 307200, fd93af578482e418d1378f6d9cd94f14 0, 4, 4, 1, 307200, abfca35c7aae65d1dcddee1ce370479f 0, 5, 5, 1, 307200, da151dbf22f7e818344d5efd0cbb6f09 0, 6, 6, 1, 307200, b87bdb747fbd80060f71585e7d2c6ac9 0, 7, 7, 1, 307200, af69163b6455654da3a37cf52cfc4525 frame= 8 fps=0.0 q=-0.0 Lsize= 1kB time=00:00:00.32 bitrate= 21.4kbits/s speed=15.7x video:2400kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown kieranjol@POWERVIRUS:~/ffmpeg_sources/ffmpeg$ ./ffmpeg -f lavfi -i testsrc -c:v v210 -vframes 7 7fr.mkv ffmpeg version N-98060-g1c32d7d Copyright (c) 2000-2020 the FFmpeg developers built with gcc 9 (Ubuntu 9.3.0-10ubuntu2) configuration: --prefix=/home/kieranjol/ffmpeg_build --pkg-config-flags=--static --extra-cflags=-I/home/kieranjol/ffmpeg_build/include --extra-ldflags=-L/home/kieranjol/ffmpeg_build/lib --extra-libs='-lpthread -lm' --bindir=/home/kieranjol/bin --enable-libaom libavutil 56. 50.100 / 56. 50.100 libavcodec 58. 90.100 / 58. 90.100 libavformat 58. 44.100 / 58. 44.100 libavdevice 58. 9.103 / 58. 9.103 libavfilter 7. 84.100 / 7. 84.100 libswscale 5. 6.101 / 5. 6.101 libswresample 3. 6.100 / 3. 6.100 Input #0, lavfi, from 'testsrc': Duration: N/A, start: 0.000000, bitrate: N/A Stream #0:0: Video: rawvideo (RGB[24] / 0x18424752), rgb24, 320x240 [SAR 1:1 DAR 4:3], 25 tbr, 25 tbn, 25 tbc Stream mapping: Stream #0:0 -> #0:0 (rawvideo (native) -> v210 (native)) Press [q] to stop, [?] for help Output #0, matroska, to '7fr.mkv': Metadata: encoder : Lavf58.44.100 Stream #0:0: Video: v210 (v210 / 0x30313276), yuv422p, 320x240 [SAR 1:1 DAR 4:3], q=2-31, 40960 kb/s, 25 fps, 1k tbn, 25 tbc Metadata: encoder : Lavc58.90.100 v210 frame= 7 fps=0.0 q=-0.0 Lsize= 1471kB time=00:00:00.24 bitrate=49997.4kbits/s speed=37.6x video:1470kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.059258% kieranjol@POWERVIRUS:~/ffmpeg_sources/ffmpeg$ ./ffmpeg -i 7fr.mkv -c:v av1 -crf 0 7fr_av1.mkv ffmpeg version N-98060-g1c32d7d Copyright (c) 2000-2020 the FFmpeg developers built with gcc 9 (Ubuntu 9.3.0-10ubuntu2) configuration: --prefix=/home/kieranjol/ffmpeg_build --pkg-config-flags=--static --extra-cflags=-I/home/kieranjol/ffmpeg_build/include --extra-ldflags=-L/home/kieranjol/ffmpeg_build/lib --extra-libs='-lpthread -lm' --bindir=/home/kieranjol/bin --enable-libaom libavutil 56. 50.100 / 56. 50.100 libavcodec 58. 90.100 / 58. 90.100 libavformat 58. 44.100 / 58. 44.100 libavdevice 58. 9.103 / 58. 9.103 libavfilter 7. 84.100 / 7. 84.100 libswscale 5. 6.101 / 5. 6.101 libswresample 3. 6.100 / 3. 6.100 Input #0, matroska,webm, from '7fr.mkv': Metadata: ENCODER : Lavf58.44.100 Duration: 00:00:00.28, start: 0.000000, bitrate: 43033 kb/s Stream #0:0: Video: v210 (v210 / 0x30313276), yuv422p10le, 320x240, SAR 1:1 DAR 4:3, 25 fps, 25 tbr, 1k tbn, 1k tbc (default) Metadata: ENCODER : Lavc58.90.100 v210 DURATION : 00:00:00.280000000 Stream mapping: Stream #0:0 -> #0:0 (v210 (native) -> av1 (libaom-av1)) Press [q] to stop, [?] for help [libaom-av1 @ 0x5613e4bb0600] v2.0.0 Output #0, matroska, to '7fr_av1.mkv': Metadata: encoder : Lavf58.44.100 Stream #0:0: Video: av1 (libaom-av1) (AV01 / 0x31305641), yuv422p10le, 320x240 [SAR 1:1 DAR 4:3], q=-1--1, 25 fps, 1k tbn, 25 tbc (default) Metadata: DURATION : 00:00:00.280000000 encoder : Lavc58.90.100 libaom-av1 Side data: cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A frame= 7 fps=4.2 q=0.0 Lsize= 23kB time=00:00:00.24 bitrate= 793.4kbits/s speed=0.143x video:23kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 2.685054% kieranjol@POWERVIRUS:~/ffmpeg_sources/ffmpeg$ ./ffmpeg -i 7fr_av1.mkv -f framemd5 - ffmpeg version N-98060-g1c32d7d Copyright (c) 2000-2020 the FFmpeg developers built with gcc 9 (Ubuntu 9.3.0-10ubuntu2) configuration: --prefix=/home/kieranjol/ffmpeg_build --pkg-config-flags=--static --extra-cflags=-I/home/kieranjol/ffmpeg_build/include --extra-ldflags=-L/home/kieranjol/ffmpeg_build/lib --extra-libs='-lpthread -lm' --bindir=/home/kieranjol/bin --enable-libaom libavutil 56. 50.100 / 56. 50.100 libavcodec 58. 90.100 / 58. 90.100 libavformat 58. 44.100 / 58. 44.100 libavdevice 58. 9.103 / 58. 9.103 libavfilter 7. 84.100 / 7. 84.100 libswscale 5. 6.101 / 5. 6.101 libswresample 3. 6.100 / 3. 6.100 [libaom-av1 @ 0x5632da787740] v2.0.0 Input #0, matroska,webm, from '7fr_av1.mkv': Metadata: ENCODER : Lavf58.44.100 Duration: 00:00:00.28, start: 0.000000, bitrate: 682 kb/s Stream #0:0: Video: av1 (Professional), yuv422p10le(tv), 320x240, SAR 1:1 DAR 4:3, 25 fps, 25 tbr, 1k tbn, 1k tbc (default) Metadata: ENCODER : Lavc58.90.100 libaom-av1 DURATION : 00:00:00.280000000 [libaom-av1 @ 0x5632da78cf00] v2.0.0 Stream mapping: Stream #0:0 -> #0:0 (av1 (libaom-av1) -> rawvideo (native)) Press [q] to stop, [?] for help #format: frame checksums #version: 2 #hash: MD5 #software: Lavf58.44.100 #tb 0: 1/25 #media_type 0: video #codec_id 0: rawvideo #dimensions 0: 320x240 #sar 0: 1/1 #stream#, dts, pts, duration, size, hash Output #0, framemd5, to 'pipe:': Metadata: encoder : Lavf58.44.100 Stream #0:0: Video: rawvideo (Y3[10][10] / 0xA0A3359), yuv422p10le, 320x240 [SAR 1:1 DAR 4:3], q=2-31, 38400 kb/s, 25 fps, 25 tbn, 25 tbc (default) Metadata: DURATION : 00:00:00.280000000 encoder : Lavc58.90.100 rawvideo 0, 0, 0, 1, 307200, 50b1ae3e77528dcdacfab21761076d2b 0, 1, 1, 1, 307200, 8213a857506c099160fffb2f606f3590 0, 2, 2, 1, 307200, a5e0786c6d9d152c45e2d3a0122c8987 0, 3, 3, 1, 307200, fd93af578482e418d1378f6d9cd94f14 0, 4, 4, 1, 307200, abfca35c7aae65d1dcddee1ce370479f 0, 5, 5, 1, 307200, da151dbf22f7e818344d5efd0cbb6f09 0, 6, 6, 1, 307200, b87bdb747fbd80060f71585e7d2c6ac9 frame= 7 fps=0.0 q=-0.0 Lsize= 1kB time=00:00:00.28 bitrate= 22.1kbits/s speed=15.3x video:2100kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown0b1ae3e77528dcdacfab21761076d2b Best, Kieran O'Leary Irish Film Institute

3 9

SCTE-35 implementation already (bounty)
by MediaStream 02 Feb '21

02 Feb '21

Looking for SCTE-35 pass through implementation: 1. Extract SCTE-35 from MPEG-TS. 2. Translate timing of the original SCTE-35 events to match timing in the output file appropriately or keep timing as is. 3. Signal encoder to force key frames at the boundaries of the SCTE-35 event. 4. Inject SCTE-35 messaging into output MP4 files as emsg and into MPD and M3U8 manifests if/as needed. More info: https://www.w3.org/TR/media-timed-events/#scte-35 https://www.tvtechnology.com/opinions/scte10435-and-beyond-a-look-at-ad-ins… source TS file with SCTE-35 also saved as ES and XML: https://www.mediafire.com/folder/zv20csqeo1ixt/ Bounty of $2,500.00 USD (up to Oct 2020)

5 6

Audio out of sync after many Non-monotonous DTS in output stream warning
by Yang Zhang 02 Feb '21

02 Feb '21

when I transcoding some live stream that comes from DVB, I got many warnings bellow and after a few hours, the audio out of sync. [tee @ 0x2998780] Non-monotonous DTS in output stream 0:0; previous: 27931, current: 27929; changing to 27932. This may result in incorrect timestamps in the output file. [tee @ 0x2998780] Non-monotonous DTS in output stream 0:0; previous: 27935, current: 27933; changing to 27936. This may result in incorrect timestamps in the output file. And here is the ffmpeg command we used. Any suggestions for how to solve the audio out of sync issue? ffmpeg -vsync passthrough -copytb 1 -hwaccel cuvid -hwaccel_device 3 -probesize 10000000 -analyzeduration 10000000 -c:v h264_cuvid -gpu 3 -deint adaptive -drop_second_field 1 -fifo_size 713924 -overrun_nonfatal 1 -buffer_size 67108864 -i udp://127.0.0.1:48210 -filter_complex [0:i:0xab]split=outputs=1[map:v:0] -map [map:v:0] -c:v:0 h264_nvenc -g 250 -flags:v +global_header+cgop -preset:v medium -profile:v:0 high -gpu 3 -b:v:0 3500k -maxrate:v:0 5000k -bufsize:v:0 10000k -map 0:i:0x92 -c:a:0 aac -ac 2 -ar 44100 -b:a:0 128k -metadata service_name="LA 1 HD" -metadata service_provider="Movisrta+" -max_muxing_queue_size 512 -f tee [select=\'v:0,a:0\':bsfs/v=dump_extra=freq=keyframe:f=hls:hls_time=5:hls_list_size=10:hls_flags=delete_segments:var_stream_map=\'v:0,a:0\':hls_segment_filename=cache/hls /2/playlist_%v_%d.ts]cache/hls/2/index.m3u8

3 2

Discussion on API and infrastructure enhancement projects
by Nicolas George 31 Dec '20

31 Dec '20

Hi. I have started discussions on ffmpeg-devel about possible enhancement for the API and the infrastructure of the project that I have. Since they relate to the public API of the libraries, I would appreciate not only the feedback of other FFmpeg developers, but also the feedback of people who develop with the FFmpeg libraries: please tell us if you think this kind of new APIs would be helpful to you. The discussions are: - Global introduction https://ffmpeg.org/pipermail/ffmpeg-devel/2020-December/274167.html - Global state into structure https://ffmpeg.org/pipermail/ffmpeg-devel/2020-December/274168.html - Unified string / stream API https://ffmpeg.org/pipermail/ffmpeg-devel/2020-December/274169.html - Type descriptors https://ffmpeg.org/pipermail/ffmpeg-devel/2020-December/274170.html - Internal error messages https://ffmpeg.org/pipermail/ffmpeg-devel/2020-December/274171.html - Event loop https://ffmpeg.org/pipermail/ffmpeg-devel/2020-December/274172.html Regards, -- Nicolas George

1 0