February 2015 - FFmpeg-trac - lists.ffmpeg.org

#4048(avformat:new): segment: Handle WebVTT as per HLS spec
by FFmpeg 01 Nov '21

01 Nov '21

#4048: segment: Handle WebVTT as per HLS spec ----------------------------------+--------------------------------------- Reporter: 11rcombs | Type: enhancement Status: new | Priority: normal Component: avformat | Version: git-master Keywords: | Blocked By: Blocking: | Reproduced by developer: 0 Analyzed by developer: 0 | ----------------------------------+--------------------------------------- As per the [http://tools.ietf.org/html/draft-pantos-http-live- streaming-13#section-4 HLS spec]: {{{ Subtitle segments MUST be formatted as WebVTT [WebVTT] files. Each subtitle segment MUST contain all subtitle cues that are intended to be displayed during the period indicated by the segment EXTINF duration. The start time offset and end time offset of each cue MUST indicate the total display time for that cue, even if that time range extends beyond the EXTINF duration. A WebVTT segment MAY contain no cues; this indicates that no subtitles are to be displayed during that period. }}} This means that the segment (or HLS) muxer needs to handle two particular cases, when muxing WebVTT for HLS: 1. No frames exist during a segment's duration, so a blank segment should be written. 2. A frame spans two or more different segments, so it should be written in all of them. This behavior could be triggered by an option, or automatically when the underlying format is WebVTT. Relatedly, the WebVTT muxer should provide an option to write the X -TIMESTAMP-MAP header for HLS synchronization. -- Ticket URL: <https://trac.ffmpeg.org/ticket/4048> FFmpeg <https://ffmpeg.org> FFmpeg issue tracker

1 6

#3389(ffmpeg:new): Feature Request - Isolate and normalize video content
by FFmpeg 29 Aug '21

29 Aug '21

#3389: Feature Request - Isolate and normalize video content -------------------------------------+------------------------------------- Reporter: Rafajafar | Type: Status: new | enhancement Component: ffmpeg | Priority: wish Keywords: feature | Version: request normalize video | unspecified Blocking: | Blocked By: Analyzed by developer: 0 | Reproduced by developer: 0 -------------------------------------+------------------------------------- Hey, I have an interesting problem and I'm solving it with OpenCV. It's be great if the solution could come straight from ffmpeg, though! I need to: 1) cropdetect 2) crop surrounding borders from a video 3) resize video to normalize its dimensions In other words, all I want is one command that will detect the frame-by- frame borders and in the same step, crop it, and also resize it. And I want this done for the entire video, not a single frame. It's gotta be possible, right? The applications are very useful in video analysis. I've spoken to colleagues of mine and they are doing this manually themselves. It would be great to be able to work this feature into the automation surrounding ffmpeg in our tools. My personal application, for instance, is in detecting videos that are similar using content perceptual hashing. Another colleague of mine works for the Center for Missing and Exploited Children. He does similar work, but with pHashing. I can see applications for ContentID type systems across the board. I'm sure this is a low on the totem pole request, but if you have any spare cycles, this would really rock in the world of computer vision and video analysis! Thanks for your consideration, --Collin -- Ticket URL: <https://trac.ffmpeg.org/ticket/3389> FFmpeg <https://ffmpeg.org> FFmpeg issue tracker

1 4

#3692(avcodec:new): dpx samples (possibly broken) look broken with FFmpeg, work fine with ImageMagick
by FFmpeg 07 May '21

07 May '21

#3692: dpx samples (possibly broken) look broken with FFmpeg, work fine with ImageMagick --------------------------------------+--------------------------------- Reporter: cehoyos | Owner: Type: defect | Status: new Priority: normal | Component: avcodec Version: git-master | Keywords: dpx Blocked By: | Blocking: Reproduced by developer: 0 | Analyzed by developer: 0 --------------------------------------+--------------------------------- http://www.simplesystems.org/users/bfriesen/dpx/ contains three dpx samples, one (16 bit) looks ugly with FFmpeg, ImageMagick and GraphicsMagick, the other two (8 bit) only look broken with FFmpeg. {{{ $ ffmpeg -i DLAD_8b_1c_big.dpx ffmpeg version N-63624-g4ba8560 Copyright (c) 2000-2014 the FFmpeg developers built on May 31 2014 12:24:49 with gcc 4.7 (SUSE Linux) configuration: --enable-gpl libavutil 52. 87.100 / 52. 87.100 libavcodec 55. 65.100 / 55. 65.100 libavformat 55. 42.100 / 55. 42.100 libavdevice 55. 13.101 / 55. 13.101 libavfilter 4. 5.100 / 4. 5.100 libswscale 2. 6.100 / 2. 6.100 libswresample 0. 19.100 / 0. 19.100 libpostproc 52. 3.100 / 52. 3.100 Input #0, image2, from 'DLAD_8b_1c_big.dpx': Duration: 00:00:00.04, start: 0.000000, bitrate: N/A Stream #0:0: Video: dpx, gray, 255x185 [SAR 1:1 DAR 51:37], 25 tbr, 25 tbn, 25 tbc At least one output file must be specified }}} {{{ $ ffmpeg -i DLAD_8b_3c_big.dpx ffmpeg version N-63624-g4ba8560 Copyright (c) 2000-2014 the FFmpeg developers built on May 31 2014 12:24:49 with gcc 4.7 (SUSE Linux) configuration: --enable-gpl libavutil 52. 87.100 / 52. 87.100 libavcodec 55. 65.100 / 55. 65.100 libavformat 55. 42.100 / 55. 42.100 libavdevice 55. 13.101 / 55. 13.101 libavfilter 4. 5.100 / 4. 5.100 libswscale 2. 6.100 / 2. 6.100 libswresample 0. 19.100 / 0. 19.100 libpostproc 52. 3.100 / 52. 3.100 Input #0, image2, from 'DLAD_8b_3c_big.dpx': Duration: 00:00:00.04, start: 0.000000, bitrate: N/A Stream #0:0: Video: dpx, rgb24, 255x185 [SAR 1:1 DAR 51:37], 25 tbr, 25 tbn, 25 tbc At least one output file must be specified }}} -- Ticket URL: <https://trac.ffmpeg.org/ticket/3692> FFmpeg <https://ffmpeg.org> FFmpeg issue tracker

1 3

#3785(undetermined:new): SWSCALE: in_range, in_color_matrix, out_range, out_color_matrix incorrect
by FFmpeg 24 Apr '21

24 Apr '21

#3785: SWSCALE: in_range, in_color_matrix, out_range, out_color_matrix incorrect -------------------------------------+------------------------------------- Reporter: troy_s | Type: defect Status: new | Priority: normal Component: | Version: git- undetermined | master Keywords: | Blocked By: colormanagement colorspace 709 | Reproduced by developer: 0 601 | Blocking: | Analyzed by developer: 0 | -------------------------------------+------------------------------------- '''Summary of the bug''': Seems that swscale is still sadly mangling RGB to YCbCr and vice versa transforms. Disabled all ASM speedups to avoid code path issues, as were previously hard coded to 601 coefficents etc. '''How to reproduce''': Encode a test chart and check values. Test chart available from http://www .belle-nuit.com/test-chart. '''Expected versus Results''': BT.709 and sRGB share identical luminance coefficients. An sRGB image, encoded at full range using BT.709 primaries should decode to a perfect 1:1 regarding RGB values, compression notwithstanding. Sampling the upper row of colors using the provided test chart, we can see some issues with the encoding / decoding step, when using FFPLAY with the corresponding scale commands. For example, an encode using {{{ ./ffmpeg -loop 1 -i ~/Downloads/testchart.tif -t 3 -c:v h264 -vf "scale=in_range=full:in_color_matrix=bt709:out_range=full:out_color_matrix=bt709" out709-full.mp4 }}} Should produce a perfect 1:1 when played back with {{{ ./ffplay -vf "scale=in_range=full:in_color_matrix=bt709:out_range=full:out_color_matrix=bt709" out709-full.mp4 }}} When we sample the sRGB / 709 values using an image editor, the top row should result in RGB values as follows: {{{ Name R G B Yellow: 180 180 16 Cyan: 16 180 180 Magenta: 180 16 180 Green: 16 180 16 Red: 180 16 16 Blue: 16 16 180 }}} Given that 709 and sRGB share identical primaries, and broadcast scaling is set to full range, there should be a perfect 1:1 result with the values. However, what we find with playback via the ffmpeg command set with proper values is: {{{ Name R G B Yellow: 179 190 22 Cyan: 31 197 180 Magenta: 167 0 176 Green: 30 209 21 Red: 166 0 19 Blue: 17 5 173 }}} There appears to be breakage with regard to the application of the coefficients, as well as possibly misinterpretation of the full range settings. The are some transforms that yield vaguely close values. However, these suffer from quantization issues where no such should occur. It would seem that all transformations are likely being performed at the relative bit depth for performance. Sadly, this corrupts the values quite significantly. {{{ ./ffmpeg -loop 1 -i ~/Downloads/testchart.tif -t 3 -c:v h264 -vf "scale=in_range=full:in_color_matrix=bt601:out_range=full:out_color_matrix=bt601" out601-full.mp4 }}} The following, despite being 601 coefficients, should yield perfect 1:1 with RGB values (RGB being a relative color space) but quantization issues again result. {{{ ./ffplay -vf "scale=in_range=full:in_color_matrix=bt601:out_range=full:out_color_matrix=bt601" out601-full.mp4 }}} Further testing of the in_range and out_range specifics will be conducted when the basic color coefficients issue is corrected. '''Conclusion''': Some mangling is still present in the color handling in FFMPEG. Quantization issues can likely be expected until a float (likely non- realtime) option is introduced for higher quality frame by frame encoding / decoding. However, even with quantization issues, the encoding / decoding coefficients are not responding / respected in correct fashion for 709 to 709 (1:1 with sRGB content). -- Ticket URL: <https://trac.ffmpeg.org/ticket/3785> FFmpeg <https://ffmpeg.org> FFmpeg issue tracker

1 30

#3794(swscale:new): SWSCALE: Quantization Errors in Y Studio Range
by FFmpeg 19 Apr '21

19 Apr '21

#3794: SWSCALE: Quantization Errors in Y Studio Range ------------------------------------+-------------------------------------- Reporter: troy_s | Type: defect Status: new | Priority: normal Component: swscale | Version: git-master Keywords: 709 Y luma | Blocked By: Blocking: | Reproduced by developer: 0 Analyzed by developer: 0 | ------------------------------------+-------------------------------------- Summary of the bug: It appears FFMPEG has some +/- single unit quantization errors in the YCbCr transform. How to reproduce: Generate a raw YCbCr image and diff against theoretically correct values. {{{ ./ffmpeg -i ~/Documents/FFMPEG\ Color\ Research/ARIB_STD-B28.png -pix_fmt yuv444p -vcodec rawvideo -f rawvideo -vf scale="in_range=full:in_color_matrix=bt709:out_range=full:out_color_matrix=bt709" test.yuv ffmpeg version N-64815-gb53bdae Copyright (c) 2000-2014 the FFmpeg developers built on Jul 19 2014 16:33:49 with gcc 4.8 (Ubuntu 4.8.2-19ubuntu1) configuration: --enable-gpl --enable-libx264 --disable-asm libavutil 52. 92.101 / 52. 92.101 libavcodec 55. 69.100 / 55. 69.100 libavformat 55. 48.101 / 55. 48.101 libavdevice 55. 13.102 / 55. 13.102 libavfilter 4. 11.102 / 4. 11.102 libswscale 2. 6.100 / 2. 6.100 libswresample 0. 19.100 / 0. 19.100 libpostproc 52. 3.100 / 52. 3.100 Input #0, image2, from '/home/aphorism/Documents/FFMPEG Color Research/ARIB_STD-B28.png': Duration: 00:00:00.04, start: 0.000000, bitrate: N/A Stream #0:0: Video: png, rgb24, 1920x1080 [SAR 2835:2835 DAR 16:9], 25 tbr, 25 tbn, 25 tbc Output #0, rawvideo, to 'test.yuv': Metadata: encoder : Lavf55.48.101 Stream #0:0: Video: rawvideo (444P / 0x50343434), yuv444p, 1920x1080 [SAR 1:1 DAR 16:9], q=2-31, 200 kb/s, 25 fps, 25 tbn, 25 tbc Metadata: encoder : Lavc55.69.100 rawvideo Stream mapping: Stream #0:0 -> #0:0 (png (native) -> rawvideo (native)) Press [q] to stop, [?] for help frame= 1 fps=0.0 q=0.0 Lsize= 6075kB time=00:00:00.04 bitrate=1244160.0kbits/s video:6075kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.000000% }}} Diff'd versions of the theoretically ideal values versus FFMPEG's output. Lowest red stripe is due to theoretical version preserving the -2% patch, and not relevant. -- Ticket URL: <https://trac.ffmpeg.org/ticket/3794> FFmpeg <https://ffmpeg.org> FFmpeg issue tracker

1 16

#3623(undetermined:new): Mixed results writing M4A metadata
by FFmpeg 15 Apr '21

15 Apr '21

#3623: Mixed results writing M4A metadata -------------------------------------+------------------------------------- Reporter: svnpenn | Type: defect Status: new | Priority: normal Component: | Version: undetermined | unspecified Keywords: | Blocked By: Blocking: | Reproduced by developer: 0 Analyzed by developer: 0 | -------------------------------------+------------------------------------- Given this file http://bitbucket.org/svnpenn/a/downloads/superuser.mp4 I am having mixed results writing metadata. For example these commands {{{ ffmpeg -i superuser.mp4 -c copy good.aac ffmpeg -i good.aac -c copy -bsf aac_adtstoasc -metadata title=Confetti \ -movflags faststart good.m4a }}} Will generate an M4A file that plays correctly with metadata that is recognized. However this command {{{ ffmpeg -i superuser.mp4 -c copy -vn -movflags faststart \ -metadata title=Confetti bad.m4a }}} Generates a file that plays correctly, but my player does not recognize the metadata. Note I also tried adding `-bsf aac_adtstoasc` to the bad command to no avail. How can I tweak the second command to get it working? Command-line output http://gist.github.com/svnpenn/82e7f7685084759c7483 Source question http://superuser.com/q/750627 -- Ticket URL: <https://trac.ffmpeg.org/ticket/3623> FFmpeg <https://ffmpeg.org> FFmpeg issue tracker

1 17

#3586(avcodec:new): [discrepancy with libav] avcodec_encode_video2 merges packet side data with the packet body
by FFmpeg 10 Apr '21

10 Apr '21

#3586: [discrepancy with libav] avcodec_encode_video2 merges packet side data with the packet body -------------------------------------+------------------------------------- Reporter: Lastique | Type: defect Status: new | Priority: normal Component: avcodec | Version: 2.2.1 Keywords: libav | Blocked By: avcodec_encode_video2 avpacket | Reproduced by developer: 0 av_packet_merge_side_data | Blocking: | Analyzed by developer: 0 | -------------------------------------+------------------------------------- We have an application which uses ffmpeg to encode video in h263. The application requests h263_mb_info side data by setting the "mb_info" option on the encoder context: {{{ av_opt_set_int(av_ctx, "mb_info", 1400, AV_OPT_SEARCH_CHILDREN) }}} Later we call avcodec_encode_video2() to encode frames. The problem is that ffmpeg avcodec_encode_video2() returns AVPackets with the encoded frame and some amount of junk at the end. From the source code I can see that the junk is actually the encoded side data (mb_info) appended to the h263 packet by av_packet_merge_side_data() which is called by avcodec_encode_video2(). This appended side data prevents the packets from being decoded by ffmpeg 2.2.1 (I tried both decoding through the API and ffplay). Decoding results in many messages such as: {{{ slice end not reached but screenspace end (399 left 019CE3, score= -7) concealing 88 DC, 88 AC, 88 MV errors in P frame }}} and corrupted image. This is also different from libav behavior. At least 9.x and 10.x versions don't merge side data into the packet body, and when using libav we don't have the decoding problem. Looking at the libavcodec code I don't really understand why the call to av_packet_merge_side_data() is needed. Side data, at least mb_info in case of h263, is not the part of the encoded media and thus should not be part of the packet body. Since the packet size (AVPacket::size) includes the appended side data, there is no way to obtain the size of the actual media. I suspect, av_packet_split_side_data() can be used to restore the original un-merged packet, but (a) it is not documented and (b) doing av_packet_merge_side_data() and av_packet_split_side_data() is a waste of memory and CPU (note: we pre-allocate packet data buffer to optimize performance). Therefore my preferred solution would be to remove the call to av_packet_merge_side_data() from avcodec_encode_video2(). If that call cannot be removed then what is the correct way to obtain the actual media from the merged packet? -- Ticket URL: <https://trac.ffmpeg.org/ticket/3586> FFmpeg <https://ffmpeg.org> FFmpeg issue tracker

1 11

#3516(undetermined:new): mjpeg: wrong colors (CMYK with subsampling)
by FFmpeg 22 Mar '21

22 Mar '21

#3516: mjpeg: wrong colors (CMYK with subsampling) -------------------------------------+------------------------------------- Reporter: ami_stuff | Owner: Type: defect | Status: new Priority: normal | Component: Version: | undetermined unspecified | Keywords: Blocked By: | Blocking: Reproduced by developer: 0 | Analyzed by developer: 0 -------------------------------------+------------------------------------- attached file decodes with wrong colors {{{ C:\>ffmpeg3 -i YCbCrK.jpg out.bmp ffmpeg version 2.2.git-0f714ab Copyright (c) 2000-2014 the FFmpeg developers built on Mar 31 2014 22:26:54 with gcc 4.6.2 (GCC) configuration: --disable-ffprobe --disable-pthreads --enable-gpl libavutil 52. 70.100 / 52. 70.100 libavcodec 55. 55.106 / 55. 55.106 libavformat 55. 36.100 / 55. 36.100 libavdevice 55. 11.100 / 55. 11.100 libavfilter 4. 3.100 / 4. 3.100 libswscale 2. 5.102 / 2. 5.102 libswresample 0. 18.100 / 0. 18.100 libpostproc 52. 3.100 / 52. 3.100 [mjpeg @ 01d76580] Warning: not compiled with thread support, using thread emula tion Input #0, image2, from 'YCbCrK.jpg': Duration: 00:00:00.04, start: 0.000000, bitrate: N/A Stream #0:0: Video: mjpeg, yuva420p(pc), 1024x768, 25 tbr, 25 tbn, 25 tbc [bmp @ 01d78c00] Warning: not compiled with thread support, using thread emulati on [mjpeg @ 01d76580] Warning: not compiled with thread support, using thread emula tion Output #0, image2, to 'out.bmp': Metadata: encoder : Lavf55.36.100 Stream #0:0: Video: bmp, bgra, 1024x768, q=2-31, 200 kb/s, 90k tbn, 25 tbc Stream mapping: Stream #0:0 -> #0:0 (mjpeg -> bmp) Press [q] to stop, [?] for help frame= 1 fps=0.0 q=0.0 Lsize=N/A time=00:00:00.04 bitrate=N/A video:3072kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 586396112781312.000000% }}} -- Ticket URL: <https://trac.ffmpeg.org/ticket/3516> FFmpeg <https://ffmpeg.org> FFmpeg issue tracker

1 4

#3424(avcodec:new): JPEG Decoder fails to decode valid jpeg file (all other major implementations work)
by FFmpeg 22 Mar '21

22 Mar '21

#3424: JPEG Decoder fails to decode valid jpeg file (all other major implementations work) --------------------------------------+--------------------------------- Reporter: dbuitenh | Owner: Type: defect | Status: new Priority: normal | Component: avcodec Version: git-master | Keywords: jpeg Blocked By: | Blocking: Reproduced by developer: 0 | Analyzed by developer: 0 --------------------------------------+--------------------------------- How to reproduce: $ ffmpeg -loglevel debug -i bug.jpg decoded.png git HEAD has the same issue and output. Output: {{{ ffmpeg version N-60776-gd089e9a Copyright (c) 2000-2014 the FFmpeg developers built on Feb 20 2014 11:17:04 with gcc 4.4.7 (GCC) 20120313 (Red Hat 4.4.7-3) configuration: --enable-gpl --enable-version3 --enable-nonfree --disable-decoder=dirac --enable-libopencore-amrnb --enable-libopencore- amrwb --disable-decoder=amrnb --disable-decoder=amrwb --enable-libopus --enable-libx264 --enable-libschroedinger --disable-static --enable-shared --disable-ffplay --disable-ffserver --enable-libfdk-aac --enable-libspeex --enable-avresample --enable-openssl --enable-pic libavutil 52. 65.100 / 52. 65.100 libavcodec 55. 52.102 / 55. 52.102 libavformat 55. 33.100 / 55. 33.100 libavdevice 55. 10.100 / 55. 10.100 libavfilter 4. 1.103 / 4. 1.103 libavresample 1. 1. 0 / 1. 1. 0 libswscale 2. 5.101 / 2. 5.101 libswresample 0. 17.104 / 0. 17.104 libpostproc 52. 3.100 / 52. 3.100 Splitting the commandline. Reading option '-loglevel' ... matched as option 'loglevel' (set logging level) with argument 'debug'. Reading option '-i' ... matched as input file with argument 'bug.jpg'. Reading option 'decoded.png' ... matched as output file. Finished splitting the commandline. Parsing a group of options: global . Applying option loglevel (set logging level) with argument debug. Successfully parsed a group of options. Parsing a group of options: input file bug.jpg. Successfully parsed a group of options. Opening an input file: bug.jpg. [AVIOContext @ 0x23bcdc0] Statistics: 1129716 bytes read, 0 seeks [mjpeg @ 0x23bb060] marker=d8 avail_size_in_buf=1129714 [mjpeg @ 0x23bb060] marker parser used 0 bytes (0 bits) [mjpeg @ 0x23bb060] marker=e0 avail_size_in_buf=1129712 [mjpeg @ 0x23bb060] marker parser used 16 bytes (128 bits) [mjpeg @ 0x23bb060] marker=ee avail_size_in_buf=1129694 [mjpeg @ 0x23bb060] marker parser used 14 bytes (112 bits) [mjpeg @ 0x23bb060] marker=e1 avail_size_in_buf=1129678 [mjpeg @ 0x23bb060] marker parser used 6005 bytes (48040 bits) [mjpeg @ 0x23bb060] marker=e2 avail_size_in_buf=1123670 [mjpeg @ 0x23bb060] marker parser used 65534 bytes (524272 bits) [mjpeg @ 0x23bb060] marker=e2 avail_size_in_buf=1058133 [mjpeg @ 0x23bb060] marker parser used 65534 bytes (524272 bits) [mjpeg @ 0x23bb060] marker=e2 avail_size_in_buf=992596 [mjpeg @ 0x23bb060] marker parser used 65534 bytes (524272 bits) [mjpeg @ 0x23bb060] marker=e2 avail_size_in_buf=927059 [mjpeg @ 0x23bb060] marker parser used 65534 bytes (524272 bits) [mjpeg @ 0x23bb060] marker=e2 avail_size_in_buf=861522 [mjpeg @ 0x23bb060] marker parser used 65534 bytes (524272 bits) [mjpeg @ 0x23bb060] marker=e2 avail_size_in_buf=795985 [mjpeg @ 0x23bb060] marker parser used 65534 bytes (524272 bits) [mjpeg @ 0x23bb060] marker=e2 avail_size_in_buf=730448 [mjpeg @ 0x23bb060] marker parser used 65534 bytes (524272 bits) [mjpeg @ 0x23bb060] marker=e2 avail_size_in_buf=664911 [mjpeg @ 0x23bb060] marker parser used 65534 bytes (524272 bits) [mjpeg @ 0x23bb060] marker=e2 avail_size_in_buf=599374 [mjpeg @ 0x23bb060] marker parser used 33031 bytes (264248 bits) [mjpeg @ 0x23bb060] marker=ed avail_size_in_buf=566340 [mjpeg @ 0x23bb060] marker parser used 43 bytes (344 bits) [mjpeg @ 0x23bb060] marker=e1 avail_size_in_buf=566294 [mjpeg @ 0x23bb060] marker parser used 3898 bytes (31184 bits) [mjpeg @ 0x23bb060] marker=db avail_size_in_buf=562393 [mjpeg @ 0x23bb060] index=0 [mjpeg @ 0x23bb060] qscale[0]: 2 [mjpeg @ 0x23bb060] marker parser used 67 bytes (536 bits) [mjpeg @ 0x23bb060] marker=c0 avail_size_in_buf=562324 [mjpeg @ 0x23bb060] sof0: picture: 1280x720 [mjpeg @ 0x23bb060] component 0 1:1 id: 66 quant:0 [mjpeg @ 0x23bb060] component 1 1:1 id: 76 quant:0 [mjpeg @ 0x23bb060] component 2 1:1 id: 88 quant:0 [mjpeg @ 0x23bb060] component 3 1:1 id: 74 quant:0 [mjpeg @ 0x23bb060] pix fmt id 11111111 [mjpeg @ 0x23bb060] marker parser used 20 bytes (160 bits) [mjpeg @ 0x23bb060] marker=c4 avail_size_in_buf=562302 [mjpeg @ 0x23bb060] class=0 index=0 nb_codes=10 [mjpeg @ 0x23bb060] marker parser used 29 bytes (232 bits) [mjpeg @ 0x23bb060] marker=c4 avail_size_in_buf=562271 [mjpeg @ 0x23bb060] class=1 index=0 nb_codes=242 [mjpeg @ 0x23bb060] marker parser used 78 bytes (624 bits) [mjpeg @ 0x23bb060] escaping removed 1699 bytes [mjpeg @ 0x23bb060] marker=da avail_size_in_buf=562191 [mjpeg @ 0x23bb060] component: 66 [mjpeg @ 0x23bb060] component: 76 [mjpeg @ 0x23bb060] component: 88 [mjpeg @ 0x23bb060] component: 74 [mjpeg @ 0x23bb060] marker parser used 560491 bytes (4483924 bits) [mjpeg @ 0x23bb060] marker=d9 avail_size_in_buf=0 [mjpeg @ 0x23bb060] decode frame unused 0 bytes Input #0, image2, from 'bug.jpg': Duration: 00:00:00.04, start: 0.000000, bitrate: N/A Stream #0:0, 1, 1/25: Video: mjpeg, yuva444p(pc), 1280x720 [SAR 300:300 DAR 16:9], 1/25, 25 tbr, 25 tbn, 25 tbc Successfully opened the file. Parsing a group of options: output file decoded.png. Successfully parsed a group of options. Opening an output file: decoded.png. Successfully opened the file. detected 24 logical cores [graph 0 input from stream 0:0 @ 0x23a4760] Setting 'video_size' to value '1280x720' [graph 0 input from stream 0:0 @ 0x23a4760] Setting 'pix_fmt' to value '299' [graph 0 input from stream 0:0 @ 0x23a4760] Setting 'time_base' to value '1/25' [graph 0 input from stream 0:0 @ 0x23a4760] Setting 'pixel_aspect' to value '300/300' [graph 0 input from stream 0:0 @ 0x23a4760] Setting 'sws_param' to value 'flags=2' [graph 0 input from stream 0:0 @ 0x23a4760] Setting 'frame_rate' to value '25/1' [graph 0 input from stream 0:0 @ 0x23a4760] w:1280 h:720 pixfmt:yuva444p tb:1/25 fr:25/1 sar:300/300 sws_param:flags=2 [format @ 0x23a49c0] compat: called with args=[rgb24|rgba|rgb48be|rgba64be|pal8|gray|gray8a|gray16be|monob] [format @ 0x23a49c0] Setting 'pix_fmts' to value 'rgb24|rgba|rgb48be|rgba64be|pal8|gray|gray8a|gray16be|monob' [auto-inserted scaler 0 @ 0x23a5c80] Setting 'flags' to value '0x4' [auto-inserted scaler 0 @ 0x23a5c80] w:iw h:ih flags:'0x4' interl:0 [format @ 0x23a49c0] auto-inserting filter 'auto-inserted scaler 0' between the filter 'Parsed_null_0' and the filter 'format' [AVFilterGraph @ 0x23be4a0] query_formats: 4 queried, 2 merged, 1 already done, 0 delayed [auto-inserted scaler 0 @ 0x23a5c80] picking rgba out of 8 ref:yuva444p alpha:1 [swscaler @ 0x23ab020] Forcing full internal H chroma due to input having non subsampled chroma [auto-inserted scaler 0 @ 0x23a5c80] w:1280 h:720 fmt:yuva444p sar:300/300 -> w:1280 h:720 fmt:rgba sar:1/1 flags:0x4 Output #0, image2, to 'decoded.png': Metadata: encoder : Lavf55.33.100 Stream #0:0, 0, 1/90000: Video: png, rgba, 1280x720 [SAR 1:1 DAR 16:9], 1/25, q=2-31, 200 kb/s, 90k tbn, 25 tbc Stream mapping: Stream #0:0 -> #0:0 (mjpeg -> png) Press [q] to stop, [?] for help [mjpeg @ 0x23bb060] marker=d8 avail_size_in_buf=1129714 [mjpeg @ 0x23bb060] marker parser used 0 bytes (0 bits) [mjpeg @ 0x23bb060] marker=e0 avail_size_in_buf=1129712 [mjpeg @ 0x23bb060] marker parser used 16 bytes (128 bits) [mjpeg @ 0x23bb060] marker=ee avail_size_in_buf=1129694 [mjpeg @ 0x23bb060] marker parser used 14 bytes (112 bits) [mjpeg @ 0x23bb060] marker=e1 avail_size_in_buf=1129678 [mjpeg @ 0x23bb060] marker parser used 6005 bytes (48040 bits) [mjpeg @ 0x23bb060] marker=e2 avail_size_in_buf=1123670 [mjpeg @ 0x23bb060] marker parser used 65534 bytes (524272 bits) [mjpeg @ 0x23bb060] marker=e2 avail_size_in_buf=1058133 [mjpeg @ 0x23bb060] marker parser used 65534 bytes (524272 bits) [mjpeg @ 0x23bb060] marker=e2 avail_size_in_buf=992596 [mjpeg @ 0x23bb060] marker parser used 65534 bytes (524272 bits) [mjpeg @ 0x23bb060] marker=e2 avail_size_in_buf=927059 [mjpeg @ 0x23bb060] marker parser used 65534 bytes (524272 bits) [mjpeg @ 0x23bb060] marker=e2 avail_size_in_buf=861522 [mjpeg @ 0x23bb060] marker parser used 65534 bytes (524272 bits) [mjpeg @ 0x23bb060] marker=e2 avail_size_in_buf=795985 [mjpeg @ 0x23bb060] marker parser used 65534 bytes (524272 bits) [mjpeg @ 0x23bb060] marker=e2 avail_size_in_buf=730448 [mjpeg @ 0x23bb060] marker parser used 65534 bytes (524272 bits) [mjpeg @ 0x23bb060] marker=e2 avail_size_in_buf=664911 [mjpeg @ 0x23bb060] marker parser used 65534 bytes (524272 bits) [mjpeg @ 0x23bb060] marker=e2 avail_size_in_buf=599374 [mjpeg @ 0x23bb060] marker parser used 33031 bytes (264248 bits) [mjpeg @ 0x23bb060] marker=ed avail_size_in_buf=566340 [mjpeg @ 0x23bb060] marker parser used 43 bytes (344 bits) [mjpeg @ 0x23bb060] marker=e1 avail_size_in_buf=566294 [mjpeg @ 0x23bb060] marker parser used 3898 bytes (31184 bits) [mjpeg @ 0x23bb060] marker=db avail_size_in_buf=562393 [mjpeg @ 0x23bb060] index=0 [mjpeg @ 0x23bb060] qscale[0]: 2 [mjpeg @ 0x23bb060] marker parser used 67 bytes (536 bits) [mjpeg @ 0x23bb060] marker=c0 avail_size_in_buf=562324 [mjpeg @ 0x23bb060] sof0: picture: 1280x720 [mjpeg @ 0x23bb060] component 0 1:1 id: 66 quant:0 [mjpeg @ 0x23bb060] component 1 1:1 id: 76 quant:0 [mjpeg @ 0x23bb060] component 2 1:1 id: 88 quant:0 [mjpeg @ 0x23bb060] component 3 1:1 id: 74 quant:0 [mjpeg @ 0x23bb060] pix fmt id 11111111 [mjpeg @ 0x23bb060] marker parser used 20 bytes (160 bits) [mjpeg @ 0x23bb060] marker=c4 avail_size_in_buf=562302 [mjpeg @ 0x23bb060] class=0 index=0 nb_codes=10 [mjpeg @ 0x23bb060] marker parser used 29 bytes (232 bits) [mjpeg @ 0x23bb060] marker=c4 avail_size_in_buf=562271 [mjpeg @ 0x23bb060] class=1 index=0 nb_codes=242 [mjpeg @ 0x23bb060] marker parser used 78 bytes (624 bits) [mjpeg @ 0x23bb060] escaping removed 1699 bytes [mjpeg @ 0x23bb060] marker=da avail_size_in_buf=562191 [mjpeg @ 0x23bb060] component: 66 [mjpeg @ 0x23bb060] component: 76 [mjpeg @ 0x23bb060] component: 88 [mjpeg @ 0x23bb060] component: 74 [mjpeg @ 0x23bb060] marker parser used 560491 bytes (4483924 bits) [mjpeg @ 0x23bb060] marker=d9 avail_size_in_buf=0 [mjpeg @ 0x23bb060] decode frame unused 0 bytes [output stream 0:0 @ 0x23a4e60] EOF on sink link output stream 0:0:default. No more output streams to write to, finishing. [AVIOContext @ 0x240ec20] Statistics: 0 seeks, 50 writeouts frame= 1 fps=0.0 q=0.0 Lsize=N/A time=00:00:00.04 bitrate=N/A video:1569kB audio:0kB subtitle:0 data:0 global headers:0kB muxing overhead -100.001370% 1 frames successfully decoded, 0 decoding errors }}} -- Ticket URL: <https://trac.ffmpeg.org/ticket/3424> FFmpeg <https://ffmpeg.org> FFmpeg issue tracker

1 24

#4076(undetermined:new): Poor performance when using unsharp filter on multiple outputs
by FFmpeg 14 Feb '21

14 Feb '21

#4076: Poor performance when using unsharp filter on multiple outputs -------------------------------------+------------------------------------- Reporter: speaker219 | Type: defect Status: new | Priority: normal Component: | Version: undetermined | unspecified Keywords: | Blocked By: Blocking: | Reproduced by developer: 0 Analyzed by developer: 0 | -------------------------------------+------------------------------------- Summary of the bug: When using FFmpeg to encode two seperate video outputs from a single video source, performance drops significantly when using the "unsharp" video filter on BOTH outputs. If only used on one of the two outputs, performance appears normal. This is a problem particularly when using a DirectShow source, since the real-time buffer will almost immediately fill and cause dropped frames/out of sync audio making it impossible to stream from a live video source. First sample, showing the issue, notice the poor fps (input framerate is 59.94 fps) and real-time buffer errors causing frame drops, CPU usage is 40% or lower. {{{ cmd> ffmpeg -rtbufsize 902000k -f dshow -r 60000/1001 -video_size 1280x720 -pixel_format uyvy422 -i video="Decklink Video Capture":audio="Decklink Audio Capture" -vcodec libx264 -vf "unsharp=5:5:0.2:5:5:0.0" -preset medium -profile main -maxrate 1600k -bufsize 2000k -s 960x540 -pix_fmt yuv420p -acodec aac -strict -2 -ab 96k -ar 44100 -af "volume=3" -f flv -y "hd.flv" -vcodec libx264 -vf "unsharp=5:5:0.2:5:5:0.0,fps=fps=30" -preset medium -profile main -maxrate 900k -bufsize 2000k -s 854x480 -pix_fmt yuv420p -acodec aac -strict -2 -ab 96k -ar 44100 -af "volume=3" -f flv -y "sd.flv" ffmpeg version N-66809-g20df026 Copyright (c) 2000-2014 the FFmpeg developers built on Oct 11 2014 23:42:02 with gcc 4.9.1 (GCC) configuration: --enable-gpl --enable-version3 --disable-w32threads --enable-avisynth --enable-bzlib --enable-fontconfig --enable-frei0r --enable-gnutls --enable-iconv --enable-li bass --enable-libbluray --enable-libbs2b --enable-libcaca --enable- libfreetype --enable-libgme --enable-libgsm --enable-libilbc --enable- libmodplug --enable-libmp3lame --enable-lib opencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable- libopus --enable-librtmp --enable-libschroedinger --enable-libsoxr --enable-libspeex --enable-libtheora --en able-libtwolame --enable-libvidstab --enable-libvo-aacenc --enable-libvo- amrwbenc --enable-libvorbis --enable-libvpx --enable-libwavpack --enable- libwebp --enable-libx264 --enable- libx265 --enable-libxavs --enable-libxvid --enable-zlib libavutil 54. 10.100 / 54. 10.100 libavcodec 56. 4.101 / 56. 4.101 libavformat 56. 9.100 / 56. 9.100 libavdevice 56. 1.100 / 56. 1.100 libavfilter 5. 1.103 / 5. 1.103 libswscale 3. 1.101 / 3. 1.101 libswresample 1. 1.100 / 1. 1.100 libpostproc 53. 1.100 / 53. 1.100 Guessed Channel Layout for Input Stream #0.1 : stereo Input #0, dshow, from 'video=Decklink Video Capture:audio=Decklink Audio Capture': Duration: N/A, start: 1799667.924000, bitrate: 1536 kb/s Stream #0:0: Video: rawvideo (HDYC / 0x43594448), uyvy422(tv), 1280x720, 59.94 tbr, 10000k tbn, 59.94 tbc Stream #0:1: Audio: pcm_s16le, 48000 Hz, 2 channels, s16, 1536 kb/s Please use -profile:a or -profile:v, -profile is ambiguous Last message repeated 1 times [libx264 @ 0000000002b451c0] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX [libx264 @ 0000000002b451c0] profile Main, level 3.2 [libx264 @ 0000000002b451c0] 264 - core 142 r2479 dd79a61 - H.264/MPEG-4 AVC codec - Copyleft 2003-2014 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 a nalyse=0x1:0x111 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=0 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=12 looka head_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 ke yint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 vbv_maxrate=1600 vbv_bufsize=2000 crf_max=0.0 nal_h rd=none filler=0 ip_ratio=1.40 aq=1:1.00 [libx264 @ 0000000002b510c0] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX [libx264 @ 0000000002b510c0] profile Main, level 3.1 [libx264 @ 0000000002b510c0] 264 - core 142 r2479 dd79a61 - H.264/MPEG-4 AVC codec - Copyleft 2003-2014 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 a nalyse=0x1:0x111 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=0 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=12 looka head_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 ke yint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 vbv_maxrate=900 vbv_bufsize=2000 crf_max=0.0 nal_hr d=none filler=0 ip_ratio=1.40 aq=1:1.00 Output #0, flv, to 'hd.flv': Metadata: encoder : Lavf56.9.100 Stream #0:0: Video: h264 (libx264) ([7][0][0][0] / 0x0007), yuv420p, 960x540, q=-1--1, max. 1600 kb/s, 59.94 fps, 1k tbn, 59.94 tbc Metadata: encoder : Lavc56.4.101 libx264 Stream #0:1: Audio: aac ([10][0][0][0] / 0x000A), 44100 Hz, stereo, fltp, 96 kb/s Metadata: encoder : Lavc56.4.101 aac Output #1, flv, to 'sd.flv': Metadata: encoder : Lavf56.9.100 Stream #1:0: Video: h264 (libx264) ([7][0][0][0] / 0x0007), yuv420p, 854x480, q=-1--1, max. 900 kb/s, 30 fps, 1k tbn, 30 tbc Metadata: encoder : Lavc56.4.101 libx264 Stream #1:1: Audio: aac ([10][0][0][0] / 0x000A), 44100 Hz, stereo, fltp, 96 kb/s Metadata: encoder : Lavc56.4.101 aac Stream mapping: Stream #0:0 -> #0:0 (rawvideo (native) -> h264 (libx264)) Stream #0:1 -> #0:1 (pcm_s16le (native) -> aac (native)) Stream #0:0 -> #1:0 (rawvideo (native) -> h264 (libx264)) Stream #0:1 -> #1:1 (pcm_s16le (native) -> aac (native)) Press [q] to stop, [?] for help [dshow @ 0000000002b42600] real-time buffer[Decklink Video Capture] too full (62% of size: 902000000)! frame dropped! Last message repeated 3 times [dshow @ 0000000002b42600] real-time buffer[Decklink Video Capture] too full (62% of size: 902000000)! frame dropped! Last message repeated 1 times [dshow @ 0000000002b42600] real-time buffer[Decklink Video Capture] too full (62% of size: 902000000)! frame dropped! Last message repeated 2 times [dshow @ 0000000002b42600] real-time buffer[Decklink Video Capture] too full (62% of size: 902000000)! frame dropped! Last message repeated 4 times [dshow @ 0000000002b42600] real-time buffer[Decklink Video Capture] too full (62% of size: 902000000)! frame dropped! Last message repeated 4 times [dshow @ 0000000002b42600] real-time buffer[Decklink Video Capture] too full (62% of size: 902000000)! frame dropped! Last message repeated 3 times [dshow @ 0000000002b42600] real-time buffer[Decklink Video Capture] too full (62% of size: 902000000)! frame dropped! Last message repeated 3 times [dshow @ 0000000002b42600] real-time buffer[Decklink Video Capture] too full (62% of size: 902000000)! frame dropped! Last message repeated 2 times [dshow @ 0000000002b42600] real-time buffer[Decklink Video Capture] too full (62% of size: 902000000)! frame dropped! Last message repeated 4 times [dshow @ 0000000002b42600] real-time buffer[Decklink Video Capture] too full (62% of size: 902000000)! frame dropped! Last message repeated 4 times [dshow @ 0000000002b42600] real-time buffer[Decklink Video Capture] too full (62% of size: 902000000)! frame dropped! Last message repeated 2 times [dshow @ 0000000002b42600] real-time buffer[Decklink Video Capture] too full (62% of size: 902000000)! frame dropped! Last message repeated 3 times [dshow @ 0000000002b42600] real-time buffer[Decklink Video Capture] too full (62% of size: 902000000)! frame dropped! Last message repeated 1 times [dshow @ 0000000002b42600] real-time buffer[Decklink Video Capture] too full (62% of size: 902000000)! frame dropped! Last message repeated 4 times [dshow @ 0000000002b42600] real-time buffer[Decklink Video Capture] too full (62% of size: 902000000)! frame dropped! Last message repeated 3 times [dshow @ 0000000002b42600] real-time buffer[Decklink Video Capture] too full (62% of size: 902000000)! frame dropped! Last message repeated 2 times [dshow @ 0000000002b42600] real-time buffer[Decklink Video Capture] too full (62% of size: 902000000)! frame dropped! Last message repeated 1 times [dshow @ 0000000002b42600] real-time buffer[Decklink Video Capture] too full (62% of size: 902000000)! frame dropped! Last message repeated 5 times [dshow @ 0000000002b42600] real-time buffer[Decklink Video Capture] too full (62% of size: 902000000)! frame dropped! Last message repeated 4 times [dshow @ 0000000002b42600] real-time buffer[Decklink Video Capture] too full (62% of size: 902000000)! frame dropped! Last message repeated 2 times [dshow @ 0000000002b42600] real-time buffer[Decklink Video Capture] too full (63% of size: 902000000)! frame dropped! [dshow @ 0000000002b42600] real-time buffer[Decklink Video Capture] too full (62% of size: 902000000)! frame dropped! Last message repeated 1 times [dshow @ 0000000002b42600] real-time buffer[Decklink Video Capture] too full (62% of size: 902000000)! frame dropped! Last message repeated 4 times [dshow @ 0000000002b42600] real-time buffer[Decklink Video Capture] too full (63% of size: 902000000)! frame dropped! Last message repeated 3 times [dshow @ 0000000002b42600] real-time buffer[Decklink Video Capture] too full (63% of size: 902000000)! frame dropped! Last message repeated 2 times [dshow @ 0000000002b42600] real-time buffer[Decklink Video Capture] too full (62% of size: 902000000)! frame dropped! Last message repeated 2 times [dshow @ 0000000002b42600] real-time buffer[Decklink Video Capture] too full (62% of size: 902000000)! frame dropped! frame= 3421 fps= 54 q=-1.0 Lq=-1.0 size= 4735kB time=00:00:57.84 bitrate= 670.6kbits/s video:6905kB audio:1361kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown [libx264 @ 0000000002b451c0] frame I:14 Avg QP:23.09 size: 64400 [libx264 @ 0000000002b451c0] frame P:867 Avg QP:25.62 size: 2697 [libx264 @ 0000000002b451c0] frame B:2540 Avg QP:33.32 size: 315 [dshow @ 0000000002b42600] real-time buffer[Decklink Video Capture] too full (66% of size: 902000000)! frame dropped! [libx264 @ 0000000002b451c0] consecutive B-frames: 0.8% 0.2% 1.1% 97.9% [libx264 @ 0000000002b451c0] mb I I16..4: 17.0% 0.0% 83.0% [libx264 @ 0000000002b451c0] mb P I16..4: 0.3% 0.0% 0.3% P16..4: 17.2% 5.8% 4.0% 0.0% 0.0% skip:72.4% [libx264 @ 0000000002b451c0] mb B I16..4: 0.0% 0.0% 0.0% B16..8: 12.1% 0.3% 0.1% direct: 0.1% skip:87.4% L0:28.8% L1:69.4% BI: 1.8% [libx264 @ 0000000002b451c0] coded y,uvDC,uvAC intra: 68.4% 68.0% 47.3% inter: 1.6% 2.3% 0.1% [libx264 @ 0000000002b451c0] i16 v,h,dc,p: 12% 75% 2% 11% [libx264 @ 0000000002b451c0] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 24% 31% 9% 5% 6% 7% 7% 6% 6% [libx264 @ 0000000002b451c0] i8c dc,h,v,p: 39% 36% 19% 6% [libx264 @ 0000000002b451c0] Weighted P-Frames: Y:0.0% UV:0.0% [libx264 @ 0000000002b451c0] ref P L0: 71.7% 14.5% 11.0% 2.8% [libx264 @ 0000000002b451c0] ref B L0: 91.3% 7.9% 0.8% [libx264 @ 0000000002b451c0] ref B L1: 94.5% 5.5% [libx264 @ 0000000002b451c0] kb/s:566.24 [libx264 @ 0000000002b510c0] frame I:7 Avg QP:21.65 size: 62974 [libx264 @ 0000000002b510c0] frame P:527 Avg QP:23.57 size: 3940 [libx264 @ 0000000002b510c0] frame B:1178 Avg QP:30.14 size: 435 [libx264 @ 0000000002b510c0] consecutive B-frames: 6.9% 1.3% 8.4% 83.4% [libx264 @ 0000000002b510c0] mb I I16..4: 12.8% 0.0% 87.2% [dshow @ 0000000002b42600] real-time buffer[Decklink Video Capture] too full (67% of size: 902000000)! frame dropped! [libx264 @ 0000000002b510c0] mb P I16..4: 0.3% 0.0% 0.5% P16..4: 22.9% 9.1% 6.6% 0.0% 0.0% skip:60.6% [libx264 @ 0000000002b510c0] mb B I16..4: 0.0% 0.0% 0.0% B16..8: 15.3% 1.1% 0.2% direct: 0.3% skip:83.1% L0:27.4% L1:68.4% BI: 4.2% [libx264 @ 0000000002b510c0] coded y,uvDC,uvAC intra: 72.0% 71.9% 53.0% inter: 3.6% 5.2% 0.4% [libx264 @ 0000000002b510c0] i16 v,h,dc,p: 14% 73% 2% 11% [libx264 @ 0000000002b510c0] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 22% 33% 9% 5% 6% 7% 7% 6% 7% [libx264 @ 0000000002b510c0] i8c dc,h,v,p: 36% 36% 20% 7% [libx264 @ 0000000002b510c0] Weighted P-Frames: Y:0.0% UV:0.0% [libx264 @ 0000000002b510c0] ref P L0: 72.2% 13.4% 11.1% 3.3% [libx264 @ 0000000002b510c0] ref B L0: 92.7% 5.7% 1.5% [libx264 @ 0000000002b510c0] ref B L1: 94.4% 5.6% [libx264 @ 0000000002b510c0] kb/s:424.71 [dshow @ 0000000002b42600] real-time buffer[Decklink Video Capture] too full (68% of size: 902000000)! frame dropped! Received signal 2: terminating. }}} When using the "unsharp" filter on only one of the single outputs, performance is as expected, encoding in real-time at the input framerate without any real-time buffer errors: {{{ cmd>ffmpeg -rtbufsize 902000k -f dshow -r 60000/1001 -video_size 1280x720 -pixel_format uyvy422 -i video="Decklink Video Capture":audio="Decklink Audio Capture" -vcodec libx264 -vf "unsharp=5:5:0.2:5:5:0.0" -preset medium -profile main -maxrate 1600k -bufsize 2000k -s 960x540 -pix_fmt yuv420p -acodec aac -strict -2 -ab 96k -ar 44100 -af "volume=3" -f flv -y "hd.flv" -vcodec libx264 -vf "fps=fps=30" -preset medium -profile main -maxrate 900k -bufsize 2000k -s 854x480 -pix_fmt yuv420p -acodec aac -strict -2 -ab 96k -ar 44100 -af "volume=3" -f flv -y "sd.flv" ffmpeg version N-66809-g20df026 Copyright (c) 2000-2014 the FFmpeg developers built on Oct 11 2014 23:42:02 with gcc 4.9.1 (GCC) configuration: --enable-gpl --enable-version3 --disable-w32threads --enable-avisynth --enable-bzlib --enable-fontconfig --enable-frei0r --enable-gnutls --enable-iconv --enable-li bass --enable-libbluray --enable-libbs2b --enable-libcaca --enable- libfreetype --enable-libgme --enable-libgsm --enable-libilbc --enable- libmodplug --enable-libmp3lame --enable-lib opencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable- libopus --enable-librtmp --enable-libschroedinger --enable-libsoxr --enable-libspeex --enable-libtheora --en able-libtwolame --enable-libvidstab --enable-libvo-aacenc --enable-libvo- amrwbenc --enable-libvorbis --enable-libvpx --enable-libwavpack --enable- libwebp --enable-libx264 --enable- libx265 --enable-libxavs --enable-libxvid --enable-zlib libavutil 54. 10.100 / 54. 10.100 libavcodec 56. 4.101 / 56. 4.101 libavformat 56. 9.100 / 56. 9.100 libavdevice 56. 1.100 / 56. 1.100 libavfilter 5. 1.103 / 5. 1.103 libswscale 3. 1.101 / 3. 1.101 libswresample 1. 1.100 / 1. 1.100 libpostproc 53. 1.100 / 53. 1.100 Guessed Channel Layout for Input Stream #0.1 : stereo Input #0, dshow, from 'video=Decklink Video Capture:audio=Decklink Audio Capture': Duration: N/A, start: 1799894.202000, bitrate: 1536 kb/s Stream #0:0: Video: rawvideo (HDYC / 0x43594448), uyvy422(tv), 1280x720, 59.94 tbr, 10000k tbn, 59.94 tbc Stream #0:1: Audio: pcm_s16le, 48000 Hz, 2 channels, s16, 1536 kb/s Please use -profile:a or -profile:v, -profile is ambiguous Last message repeated 1 times [libx264 @ 0000000002b441c0] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX [libx264 @ 0000000002b441c0] profile Main, level 3.2 [libx264 @ 0000000002b441c0] 264 - core 142 r2479 dd79a61 - H.264/MPEG-4 AVC codec - Copyleft 2003-2014 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 a nalyse=0x1:0x111 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=0 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=12 looka head_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 ke yint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 vbv_maxrate=1600 vbv_bufsize=2000 crf_max=0.0 nal_h rd=none filler=0 ip_ratio=1.40 aq=1:1.00 [libx264 @ 0000000002b4ff00] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX [libx264 @ 0000000002b4ff00] profile Main, level 3.1 [libx264 @ 0000000002b4ff00] 264 - core 142 r2479 dd79a61 - H.264/MPEG-4 AVC codec - Copyleft 2003-2014 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 a nalyse=0x1:0x111 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=0 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=12 looka head_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 ke yint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 vbv_maxrate=900 vbv_bufsize=2000 crf_max=0.0 nal_hr d=none filler=0 ip_ratio=1.40 aq=1:1.00 Output #0, flv, to 'hd.flv': Metadata: encoder : Lavf56.9.100 Stream #0:0: Video: h264 (libx264) ([7][0][0][0] / 0x0007), yuv420p, 960x540, q=-1--1, max. 1600 kb/s, 59.94 fps, 1k tbn, 59.94 tbc Metadata: encoder : Lavc56.4.101 libx264 Stream #0:1: Audio: aac ([10][0][0][0] / 0x000A), 44100 Hz, stereo, fltp, 96 kb/s Metadata: encoder : Lavc56.4.101 aac Output #1, flv, to 'sd.flv': Metadata: encoder : Lavf56.9.100 Stream #1:0: Video: h264 (libx264) ([7][0][0][0] / 0x0007), yuv420p, 854x480, q=-1--1, max. 900 kb/s, 30 fps, 1k tbn, 30 tbc Metadata: encoder : Lavc56.4.101 libx264 Stream #1:1: Audio: aac ([10][0][0][0] / 0x000A), 44100 Hz, stereo, fltp, 96 kb/s Metadata: encoder : Lavc56.4.101 aac Stream mapping: Stream #0:0 -> #0:0 (rawvideo (native) -> h264 (libx264)) Stream #0:1 -> #0:1 (pcm_s16le (native) -> aac (native)) Stream #0:0 -> #1:0 (rawvideo (native) -> h264 (libx264)) Stream #0:1 -> #1:1 (pcm_s16le (native) -> aac (native)) Press [q] to stop, [?] for help frame= 1036 fps= 60 q=-1.0 Lq=-1.0 size= 1582kB time=00:00:17.27 bitrate= 750.1kbits/s video:2322kB audio:408kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown [libx264 @ 0000000002b441c0] frame I:5 Avg QP:24.63 size: 59927 [libx264 @ 0000000002b441c0] frame P:264 Avg QP:25.97 size: 3013 [libx264 @ 0000000002b441c0] frame B:767 Avg QP:33.48 size: 367 [libx264 @ 0000000002b441c0] consecutive B-frames: 1.1% 0.0% 2.0% 96.9% [libx264 @ 0000000002b441c0] mb I I16..4: 18.8% 0.0% 81.2% [libx264 @ 0000000002b441c0] mb P I16..4: 0.4% 0.0% 0.7% P16..4: 20.6% 6.3% 4.0% 0.0% 0.0% skip:68.0% [libx264 @ 0000000002b441c0] mb B I16..4: 0.0% 0.0% 0.0% B16..8: 15.4% 0.4% 0.1% direct: 0.1% skip:84.1% L0:32.1% L1:66.6% BI: 1.3% [libx264 @ 0000000002b441c0] coded y,uvDC,uvAC intra: 67.4% 66.8% 42.3% inter: 1.9% 2.6% 0.1% [libx264 @ 0000000002b441c0] i16 v,h,dc,p: 20% 63% 4% 12% [libx264 @ 0000000002b441c0] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 25% 30% 10% 5% 6% 7% 6% 5% 6% [libx264 @ 0000000002b441c0] i8c dc,h,v,p: 42% 33% 20% 5% [libx264 @ 0000000002b441c0] Weighted P-Frames: Y:0.0% UV:0.0% [libx264 @ 0000000002b441c0] ref P L0: 69.8% 14.7% 12.7% 2.8% [libx264 @ 0000000002b441c0] ref B L0: 92.8% 6.1% 1.0% [libx264 @ 0000000002b441c0] ref B L1: 94.1% 5.9% [libx264 @ 0000000002b441c0] kb/s:637.10 [libx264 @ 0000000002b4ff00] frame I:3 Avg QP:23.69 size: 55129 [libx264 @ 0000000002b4ff00] frame P:169 Avg QP:24.13 size: 3987 [libx264 @ 0000000002b4ff00] frame B:346 Avg QP:29.59 size: 465 [libx264 @ 0000000002b4ff00] consecutive B-frames: 10.2% 0.8% 4.1% 84.9% [libx264 @ 0000000002b4ff00] mb I I16..4: 15.9% 0.0% 84.1% [libx264 @ 0000000002b4ff00] mb P I16..4: 0.5% 0.0% 1.2% P16..4: 25.3% 9.0% 6.0% 0.0% 0.0% skip:58.0% [libx264 @ 0000000002b4ff00] mb B I16..4: 0.0% 0.0% 0.0% B16..8: 18.4% 1.0% 0.2% direct: 0.2% skip:80.2% L0:28.6% L1:67.8% BI: 3.6% [libx264 @ 0000000002b4ff00] coded y,uvDC,uvAC intra: 71.2% 71.6% 49.1% inter: 3.9% 5.6% 0.4% [libx264 @ 0000000002b4ff00] i16 v,h,dc,p: 21% 62% 4% 13% [libx264 @ 0000000002b4ff00] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 25% 30% 10% 5% 6% 7% 6% 5% 6% [libx264 @ 0000000002b4ff00] i8c dc,h,v,p: 38% 34% 21% 7% [libx264 @ 0000000002b4ff00] Weighted P-Frames: Y:0.0% UV:0.0% [libx264 @ 0000000002b4ff00] ref P L0: 71.2% 13.8% 11.8% 3.2% [libx264 @ 0000000002b4ff00] ref B L0: 91.3% 6.9% 1.9% [libx264 @ 0000000002b4ff00] ref B L1: 93.9% 6.1% [libx264 @ 0000000002b4ff00] kb/s:463.26 }}} I tested the issue using file input (instead of a DirectShow source) and the same issue seems to be present. As expected, there are no "real-time buffer errors" - but performance is still drastically reduced. -- Ticket URL: <https://trac.ffmpeg.org/ticket/4076> FFmpeg <https://ffmpeg.org> FFmpeg issue tracker

1 6