I'm batch transcoding h264 ts streams to h265. Lately, I replaced ffmpeg 3.2.4 with 3.3, and noticed that the average frame rate for transcoding dropped from about 2.4 to 1.0. For testing purposes, I have switched back to 3.2.4 for the next file, and the frame rate went up to 3.2.4 again.
Command line:
ffmpeg -analyzeduration 200M -probesize 200M -i "$LOCAL_SOURCE" -vf yadif=1 -map 0 -c:a copy -c:v libx265 -preset veryslow -x265-params crf=19 -strict experimental "$LOCAL_TARGET"
I looked through the release notes, but couldn't really find anything that might be related. The machine is a server, i.e. a CPU without GPU, and an ASPEED VGA controller.
Any idea for what this could be related to? Full uncut command line output missing.
Transcoding a file takes many hours, and the command line output is multiple MBs. Is the below sufficient? ffmpeg version 3.2.4-static http://johnvansickle.com/ffmpeg/ Copyright (c) 2000-2017 the FFmpeg developers built with gcc 5.4.1 (Debian 5.4.1-5) 20170205 configuration: --enable-gpl --enable-version3 --enable-static --disable-debug --disable-ffplay --disable-indev=sndio --disable-outdev=sndio --cc=gcc-5 --enable-fontconfig --enable-frei0r --enable-gnutls --enable-gray --enable-libass --enable-libfreetype --enable-libfribidi --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libopus --enable-librtmp --enable-libsoxr --enable-libspeex --enable-libtheora --enable-libvidstab --enable-libvo-amrwbenc --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxvid --enable-libzimg libavutil 55. 34.101 / 55. 34.101 libavcodec 57. 64.101 / 57. 64.101 libavformat 57. 56.101 / 57. 56.101 libavdevice 57. 1.100 / 57. 1.100 libavfilter 6. 65.100 / 6. 65.100 libswscale 4. 2.100 / 4. 2.100 libswresample 2. 3.100 / 2. 3.100 libpostproc 54. 1.100 / 54. 1.100 [h264 @ 0x3fd3a20] number of reference frames (0+4) exceeds max (3; probably corrupt input), discarding one [h264 @ 0x3fd3a20] mmco: unref short failure Last message repeated 1 times [h264 @ 0x3fd3a20] number of reference frames (0+4) exceeds max (3; probably corrupt input), discarding one [mpegts @ 0x3fcf080] Invalid timestamps stream=0, pts=7295473793, dts=7295473843, size=8979 [mpegts @ 0x3fcf080] Invalid timestamps stream=0, pts=7295473793, dts=7295473843, size=8839 [h264 @ 0x3fd3a20] Increasing reorder buffer to 2 [mpegts @ 0x3fcf080] Invalid timestamps stream=0, pts=7295502593, dts=7295502643, size=10655 [mpegts @ 0x3fcf080] Invalid timestamps stream=0, pts=7295502593, dts=7295502643, size=10567 [mpegts @ 0x3fcf080] Invalid timestamps stream=0, pts=7295560193, dts=7295560243, size=11363 [mpegts @ 0x3fcf080] Invalid timestamps stream=0, pts=7295560193, dts=7295560243, size=11847 [mpegts @ 0x3fcf080] Invalid timestamps stream=0, pts=7295588993, dts=7295589043, size=14275 [mpegts @ 0x3fcf080] Invalid timestamps stream=0, pts=7295588993, dts=7295589043, size=13979 [mpegts @ 0x3fcf080] PES packet size mismatch Input #0, mpegts, from '/mnt/zfs/Video/001.ts': Duration: 00:20:14.02, start: 81060.780100, bitrate: 8813 kb/s Program 132 Stream #0:0[0xff]: Video: h264 (High) ([27][0][0][0] / 0x001B), yuv420p(tv, bt709, top first), 1920x1080 [SAR 1:1 DAR 16:9], 25 fps, 50 tbr, 90k tbn, 50 tbc Stream #0:1[0x103](deu): Audio: ac3 ([6][0][0][0] / 0x0006), 48000 Hz, 5.1(side), fltp, 384 kb/s Stream #0:2[0x104](eng): Audio: ac3 ([6][0][0][0] / 0x0006), 48000 Hz, stereo, fltp, 384 kb/s x265 [info]: HEVC encoder version 2.2+35-fe2f2dd96f8c x265 [info]: build info [Linux][GCC 5.4.1][64 bit] 8bit+10bit+12bit x265 [info]: using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX AVX2 FMA3 LZCNT BMI2 x265 [info]: Main profile, Level-4.1 (Main tier) x265 [info]: Thread pool created using 12 threads x265 [info]: Slices : 1 x265 [info]: frame threads / pool features : 3 / wpp(17 rows) x265 [info]: Coding QT: max CU size, min CU size : 64 / 8 x265 [info]: Residual QT: max TU size, max depth : 32 / 3 inter / 3 intra x265 [info]: ME / range / subpel / merge : star / 57 / 4 / 4 x265 [info]: Keyframe min / max / scenecut / bias: 25 / 250 / 40 / 5.00 x265 [info]: Lookahead / bframes / badapt : 40 / 8 / 2 x265 [info]: b-pyramid / weightp / weightb : 1 / 1 / 1 x265 [info]: References / ref-limit cu / depth : 5 / off / on x265 [info]: AQ: mode / str / qg-size / cu-tree : 1 / 1.0 / 32 / 1 x265 [info]: Rate Control / qCompress : CRF-19.0 / 0.60 x265 [info]: tools: rect amp limit-modes rd=6 psy-rd=2.00 rdoq=2 psy-rdoq=1.00 x265 [info]: tools: rskip signhide tmvp b-intra strong-intra-smoothing deblock x265 [info]: tools: sao Output #0, matroska, to '/mnt/zfs/Video/001.mkv': Metadata: encoder : Lavf57.56.101 Stream #0:0: Video: hevc (libx265), yuv420p, 1920x1080 [SAR 1:1 DAR 16:9], q=2-31, 50 fps, 1k tbn, 50 tbc Metadata: encoder : Lavc57.64.101 libx265 Stream #0:1(deu): Audio: ac3 ([0] [0][0] / 0x2000), 48000 Hz, 5.1(side), 384 kb/s Stream #0:2(eng): Audio: ac3 ([0] [0][0] / 0x2000), 48000 Hz, stereo, 384 kb/s Stream mapping: Stream #0:0 -> #0:0 (h264 (native) -> hevc (libx265)) Stream #0:1 -> #0:1 (copy) Stream #0:2 -> #0:2 (copy) Press [q] to stop, [?] for help [h264 @ 0x4059a40] number of reference frames (0+4) exceeds max (3; probably corrupt input), discarding one [h264 @ 0x40bce40] mmco: unref short failure Last message repeated 1 times [h264 @ 0x40bce40] number of reference frames (0+4) exceeds max (3; probably corrupt input), discarding one [mpegts @ 0x3fcf080] Invalid timestamps stream=0, pts=7295473793, dts=7295473843, size=8979 [mpegts @ 0x3fcf080] Invalid timestamps stream=0, pts=7295473793, dts=7295473843, size=8839 [mpegts @ 0x3fcf080] Invalid timestamps stream=0, pts=7295502593, dts=7295502643, size=10655 [mpegts @ 0x3fcf080] Invalid timestamps stream=0, pts=7295502593, dts=7295502643, size=10567 frame= 24 fps=0.0 q=0.0 size= 0kB time=00:00:00.00 bitrate=N/A speed= 0x [mpegts @ 0x3fcf080] Invalid timestamps stream=0, pts=7295560193, dts=7295560243, size=11363 [mpegts @ 0x3fcf080] Invalid timestamps stream=0, pts=7295560193, dts=7295560243, size=11847 frame= 46 fps= 46 q=0.0 size= 0kB time=00:00:00.32 bitrate= 0.0kbits/s speed=0.325x [mpegts @ 0x3fcf080] Invalid timestamps stream=0, pts=7295588993, dts=7295589043, size=14275 frame= 52 fps= 30 q=0.0 size= 0kB time=00:00:00.42 bitrate= 0.0kbits/s speed=0.248x [mpegts @ 0x3fcf080] Invalid timestamps stream=0, pts=7295588993, dts=7295589043, size=13979 frame= 54 fps= 24 q=-0.0 size= 3kB time=00:00:00.48 bitrate= 44.8kbits/s speed=0.213x frame= 56 fps= 18 q=-0.0 size= 3kB time=00:00:00.64 bitrate= 33.7kbits/s speed=0.213x frame= 58 fps= 15 q=-0.0 size= 3kB time=00:00:00.64 bitrate= 33.7kbits/s speed=0.171x frame= 60 fps= 14 q=-0.0 size= 3kB time=00:00:00.64 bitrate= 33.7kbits/s speed=0.146x frame= 64 fps= 11 q=-0.0 size= 3kB time=00:00:00.74 bitrate= 29.1kbits/s speed=0.13x frame= 66 fps= 10 q=-0.0 size= 3kB time=00:00:00.80 bitrate= 27.0kbits/s speed=0.123x frame= 68 fps=9.4 q=-0.0 size= 3kB time=00:00:00.80 bitrate= 27.0kbits/s speed=0.112x ffmpeg version 3.3-static http://johnvansickle.com/ffmpeg/ Copyright (c) 2000-2017 the FFmpeg developers built with gcc 5.4.1 (Debian 5.4.1-8) 20170304 configuration: --enable-gpl --enable-version3 --enable-static --disable-debug --disable-ffplay --disable-indev=sndio --disable-outdev=sndio --cc=gcc-5 --enable-fontconfig --enable-frei0r --enable-gnutls --enable-gray --enable-libass --enable-libfreetype --enable-libfribidi --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libopus --enable-librtmp --enable-libsoxr --enable-libspeex --enable-libtheora --enable-libvidstab --enable-libvo-amrwbenc --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxvid --enable-libzimg libavutil 55. 58.100 / 55. 58.100 libavcodec 57. 89.100 / 57. 89.100 libavformat 57. 71.100 / 57. 71.100 libavdevice 57. 6.100 / 57. 6.100 libavfilter 6. 82.100 / 6. 82.100 libswscale 4. 6.100 / 4. 6.100 libswresample 2. 7.100 / 2. 7.100 libpostproc 54. 5.100 / 54. 5.100 [h264 @ 0x4385a20] number of reference frames (0+4) exceeds max (3; probably corrupt input), discarding one [h264 @ 0x4385a20] mmco: unref short failure Last message repeated 1 times [h264 @ 0x4385a20] number of reference frames (0+4) exceeds max (3; probably corrupt input), discarding one [mpegts @ 0x4381020] Invalid timestamps stream=0, pts=7295473793, dts=7295473843, size=8979 [mpegts @ 0x4381020] Invalid timestamps stream=0, pts=7295473793, dts=7295473843, size=8839 [h264 @ 0x4385a20] Increasing reorder buffer to 2 [mpegts @ 0x4381020] Invalid timestamps stream=0, pts=7295502593, dts=7295502643, size=10655 [mpegts @ 0x4381020] Invalid timestamps stream=0, pts=7295502593, dts=7295502643, size=10567 [mpegts @ 0x4381020] Invalid timestamps stream=0, pts=7295560193, dts=7295560243, size=11363 [mpegts @ 0x4381020] Invalid timestamps stream=0, pts=7295560193, dts=7295560243, size=11847 [mpegts @ 0x4381020] Invalid timestamps stream=0, pts=7295588993, dts=7295589043, size=14275 [mpegts @ 0x4381020] Invalid timestamps stream=0, pts=7295588993, dts=7295589043, size=13979 [mpegts @ 0x4381020] PES packet size mismatch Input #0, mpegts, from '/mnt/zfs/Video/001.ts': Duration: 00:20:14.02, start: 81060.780100, bitrate: 8813 kb/s Program 132 Stream #0:0[0xff]: Video: h264 (High) ([27][0][0][0] / 0x001B), yuv420p(tv, bt709, top first), 1920x1080 [SAR 1:1 DAR 16:9], 25 fps, 50 tbr, 90k tbn, 50 tbc Stream #0:1[0x103](deu): Audio: ac3 ([6][0][0][0] / 0x0006), 48000 Hz, 5.1(side), fltp, 384 kb/s Stream #0:2[0x104](eng): Audio: ac3 ([6][0][0][0] / 0x0006), 48000 Hz, stereo, fltp, 384 kb/s Stream mapping: Stream #0:0 -> #0:0 (h264 (native) -> hevc (libx265)) Stream #0:1 -> #0:1 (copy) Stream #0:2 -> #0:2 (copy) Press [q] to stop, [?] for help [h264 @ 0x440bf40] number of reference frames (0+4) exceeds max (3; probably corrupt input), discarding one [h264 @ 0x446da60] mmco: unref short failure Last message repeated 1 times [h264 @ 0x446da60] number of reference frames (0+4) exceeds max (3; probably corrupt input), discarding one [mpegts @ 0x4381020] Invalid timestamps stream=0, pts=7295473793, dts=7295473843, size=8979 [mpegts @ 0x4381020] Invalid timestamps stream=0, pts=7295473793, dts=7295473843, size=8839 x265 [info]: HEVC encoder version 2.3+33-0b7d54dbb71a x265 [info]: build info [Linux][GCC 5.4.1][64 bit] 8bit+10bit+12bit x265 [info]: using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX AVX2 FMA3 LZCNT BMI2 x265 [info]: Main profile, Level-4.1 (Main tier) x265 [info]: Thread pool created using 12 threads x265 [info]: Slices : 1 x265 [info]: frame threads / pool features : 3 / wpp(17 rows) x265 [info]: Coding QT: max CU size, min CU size : 64 / 8 x265 [info]: Residual QT: max TU size, max depth : 32 / 3 inter / 3 intra x265 [info]: ME / range / subpel / merge : star / 57 / 4 / 4 x265 [info]: Keyframe min / max / scenecut / bias: 25 / 250 / 40 / 5.00 x265 [info]: Lookahead / bframes / badapt : 40 / 8 / 2 x265 [info]: b-pyramid / weightp / weightb : 1 / 1 / 1 x265 [info]: References / ref-limit cu / depth : 5 / off / on x265 [info]: AQ: mode / str / qg-size / cu-tree : 1 / 1.0 / 32 / 1 x265 [info]: Rate Control / qCompress : CRF-19.0 / 0.60 x265 [info]: tools: rect amp limit-modes rd=6 psy-rd=2.00 rdoq=2 psy-rdoq=1.00 x265 [info]: tools: rskip limit-tu=4 signhide tmvp b-intra x265 [info]: tools: strong-intra-smoothing deblock sao Output #0, matroska, to '/mnt/zfs/Video/001.mkv': Metadata: encoder : Lavf57.71.100 Stream #0:0: Video: hevc (libx265), yuv420p, 1920x1080 [SAR 1:1 DAR 16:9], q=2-31, 50 fps, 1k tbn, 50 tbc Metadata: encoder : Lavc57.89.100 libx265 Stream #0:1(deu): Audio: ac3 ([0] [0][0] / 0x2000), 48000 Hz, 5.1(side), fltp, 384 kb/s Stream #0:2(eng): Audio: ac3 ([0] [0][0] / 0x2000), 48000 Hz, stereo, fltp, 384 kb/s [mpegts @ 0x4381020] Invalid timestamps stream=0, pts=7295502593, dts=7295502643, size=10655 [mpegts @ 0x4381020] Invalid timestamps stream=0, pts=7295502593, dts=7295502643, size=10567 [mpegts @ 0x4381020] Invalid timestamps stream=0, pts=7295560193, dts=7295560243, size=11363 [mpegts @ 0x4381020] Invalid timestamps stream=0, pts=7295560193, dts=7295560243, size=11847 frame= 44 fps=0.0 q=0.0 size= 0kB time=00:00:00.26 bitrate= 0.0kbits/s speed=0.518x [mpegts @ 0x4381020] Invalid timestamps stream=0, pts=7295588993, dts=7295589043, size=14275 frame= 52 fps= 38 q=0.0 size= 0kB time=00:00:00.42 bitrate= 0.0kbits/s speed=0.315x [mpegts @ 0x4381020] Invalid timestamps stream=0, pts=7295588993, dts=7295589043, size=13979 frame= 54 fps= 28 q=-0.0 size= 3kB time=00:00:00.48 bitrate= 45.9kbits/s speed=0.256x frame= 56 fps= 22 q=-0.0 size= 3kB time=00:00:00.64 bitrate= 34.6kbits/s speed=0.254x frame= 58 fps= 19 q=-0.0 size= 3kB time=00:00:00.64 bitrate= 34.6kbits/s speed=0.207x frame= 60 fps= 16 q=-0.0 size= 3kB time=00:00:00.64 bitrate= 34.6kbits/s speed=0.174x frame= 64 fps= 13 q=-0.0 size= 3kB time=00:00:00.74 bitrate= 29.9kbits/s speed=0.153x frame= 66 fps= 12 q=-0.0 size= 3kB time=00:00:00.80 bitrate= 27.7kbits/s speed=0.143x frame= 68 fps= 11 q=-0.0 size= 3kB time=00:00:00.80 bitrate= 27.7kbits/s speed=0.129x Thanks, Chris