February 2022 - ffmpeg-user - lists.ffmpeg.org

M1/Apple Silicon Max Res for -hwaccel videotoolbox?
by Steven Kan 18 Feb '22

18 Feb '22

I am assembling RTSP feeds from two cameras into one YouTube stream with ffmpeg on my M1 Mac Mini: https://www.youtube.com/channel/UCIVY11504PcY2sy2qpRhiMg/live If my cameras are set to output 1920x1080 each, then this works, with CPU utilization of about 25%: ./ffmpeg -thread_queue_size 2048 -hwaccel videotoolbox -i 'rtsp://anonymous:password1@192.168.1.13:554' -hwaccel videotoolbox -i 'rtsp://anonymous:password1@192.168.1.45:554' -vcodec h264_videotoolbox -b:v 5000k -acodec copy -t 02:00:00 -filter_complex "hstack=inputs=2,fps=20" -f flv "rtmp://a.rtmp.youtube.com/live2/<my-youtube-streaming-key>" I am simultaneously recording the original raw streams on a PC on my LAN via Blue Iris. With my current setup, my local copies of the raw video are only 1920 x 1080, and the cameras are capable of 2592x1944. YT accepts a maximum horizontal resolution of 3840, so I tried setting the cameras for 2592x1944 and scaling down via: ./ffmpeg -thread_queue_size 2048 -hwaccel videotoolbox -i 'rtsp://anonymous:password1@192.168.1.13:554' -hwaccel videotoolbox -i 'rtsp://anonymous:password1@192.168.1.45:554' -vcodec h264_videotoolbox -b:v 5000k -acodec copy -t 02:00:00 -filter_complex "[0:v]scale=1920:-1[left];[1:v]scale=1920:-1[right];[left][right]hstack" -f flv "rtmp://a.rtmp.youtube.com/live2/<my-youtube-streaming-key>” but that results in a stream of errors (full console dump at the bottom): [h264 @ 0x12100d200] hardware accelerator failed to decode picture [h264 @ 0x12100d800] hardware accelerator failed to decode picture [h264 @ 0x12100de00] hardware accelerator failed to decode picture [rtsp @ 0x12000ca00] max delay reached. need to consume packet [rtsp @ 0x12000ca00] RTP: missed 141 packets [rtsp @ 0x12000ca00] max delay reached. need to consume packet [rtsp @ 0x12000ca00] RTP: missed 19 packets [rtsp @ 0x12000ca00] max delay reached. need to consume packet [rtsp @ 0x12000ca00] RTP: missed 289 packets [rtsp @ 0x12000ca00] max delay reached. need to consume packet [rtsp @ 0x12000ca00] RTP: missed 531 packets [h264 @ 0x121026200] hardware accelerator failed to decode picture [h264 @ 0x121026800] hardware accelerator failed to decode picture [h264 @ 0x121026e00] hardware accelerator failed to decode picture and, of course, the YT stream doesn’t work. If I remove -hwaccel videotoolbox then it defaults to libx264, and it will stream, but CPU utilization on my Mac Mini goes from ~25% to 75%. What I don’t understand is that, if ffmpeg scales each 2592x1944 stream down to 1920x1440 before hstack, how is that different from combining two original 1920x1080 streams via hstack, other than the additional vertical pixels? Or does the scaling actually happen after hstack? Or is the limitation in the Y direction? Or am I doing this wrong? Or is this a question for Apple? Full dump: ./ffmpeg -thread_queue_size 2048 -hwaccel videotoolbox -i 'rtsp://anonymous:password1@192.168.1.13:554' -hwaccel videotoolbox -i 'rtsp://anonymous:password1@192.168.1.45:554' -vcodec h264_videotoolbox -b:v 5000k -acodec copy -t 02:00:00 -filter_complex "[0:v]scale=1920:-1[left];[1:v]scale=1920:-1[right];[left][right]hstack" -f flv "rtmp://a.rtmp.youtube.com/live2/<my-youtube-streaming-key>" ffmpeg version 4.4 Copyright (c) 2000-2021 the FFmpeg developers built with Apple clang version 12.0.0 (clang-1200.0.32.27) configuration: --prefix=/Volumes/tempdisk/sw --extra-cflags=-fno-stack-check --arch=arm64 --cc=/usr/bin/clang --enable-gpl --enable-videotoolbox --enable-libopenjpeg --enable-libopus --enable-libmp3lame --enable-libx264 --enable-libx265 --enable-libvpx --enable-libwebp --enable-libass --enable-libfreetype --enable-libtheora --enable-libvorbis --enable-libsnappy --enable-libaom --enable-libvidstab --enable-libzimg --enable-libsvtav1 --enable-version3 --pkg-config-flags=--static --disable-ffplay --enable-postproc --enable-nonfree --enable-neon --enable-runtime-cpudetect --disable-indev=qtkit --disable-indev=x11grab_xcb libavutil 56. 70.100 / 56. 70.100 libavcodec 58.134.100 / 58.134.100 libavformat 58. 76.100 / 58. 76.100 libavdevice 58. 13.100 / 58. 13.100 libavfilter 7.110.100 / 7.110.100 libswscale 5. 9.100 / 5. 9.100 libswresample 3. 9.100 / 3. 9.100 libpostproc 55. 9.100 / 55. 9.100 Input #0, rtsp, from 'rtsp://anonymous:password1@192.168.1.13:554': Metadata: title : Media Server Duration: N/A, start: 0.100000, bitrate: N/A Stream #0:0: Video: h264 (Main), yuv420p(progressive), 2592x1944, 20 fps, 20 tbr, 90k tbn, 180k tbc Input #1, rtsp, from 'rtsp://anonymous:password1@192.168.1.45:554': Metadata: title : Media Server Duration: N/A, start: 0.128000, bitrate: N/A Stream #1:0: Video: h264 (Main), yuv420p(progressive), 2592x1944, 20 fps, 20 tbr, 90k tbn, 180k tbc Stream #1:1: Audio: aac (LC), 8000 Hz, mono, fltp Stream mapping: Stream #0:0 (h264) -> scale Stream #1:0 (h264) -> scale hstack -> Stream #0:0 (h264_videotoolbox) Stream #1:1 -> #0:1 (copy) Press [q] to stop, [?] for help [h264 @ 0x12100d200] hardware accelerator failed to decode picture [h264 @ 0x12100d800] hardware accelerator failed to decode picture [h264 @ 0x12100de00] hardware accelerator failed to decode picture [rtsp @ 0x12000ca00] max delay reached. need to consume packet [rtsp @ 0x12000ca00] RTP: missed 141 packets [rtsp @ 0x12000ca00] max delay reached. need to consume packet [rtsp @ 0x12000ca00] RTP: missed 19 packets [rtsp @ 0x12000ca00] max delay reached. need to consume packet [rtsp @ 0x12000ca00] RTP: missed 289 packets [rtsp @ 0x12000ca00] max delay reached. need to consume packet [rtsp @ 0x12000ca00] RTP: missed 531 packets [h264 @ 0x121026200] hardware accelerator failed to decode picture [h264 @ 0x121026800] hardware accelerator failed to decode picture [h264 @ 0x121026e00] hardware accelerator failed to decode picture

1 0

Video Notation, A Video Lingua Franca
by Mark Filipak 18 Feb '22

18 Feb '22

I'm pleased to announce an update here: http://videonotation.spitzner.org/ I made the following corrections: 2022-02-17.1 Corrected: EncodingOfDVD&BlurayContent, ersatz-PAL 2022-02-17.1 Corrected: EncodingOfDVD&BlurayContent, ersatz-NTSC 2022-02-17.1 Corrected: Basic Primitives, decode 2022-02-17.1 Corrected: Basic Primitives, interlace Please comment on it if interested. Regards, Mark Filipak.

1 0

Compilation Video
by Fred Kemp 17 Feb '22

17 Feb '22

I am trying to automatically create a compilation video made up of security cam motion videos of relatively short duration (5 to 10 seconds) - kind of like a time-lapse only with videos instead of images. Each video snippet would append to the same compilation video file. The compilation video would be limited to X minutes long and newer videos would knock off the oldest videos from the compilation video once the X is reached. Can this be done using FFmpeg? Thank you in advance for your consideration.

1 0

HSV / RGB issue where picture is mostly Pink
by Jeffrey Carter 15 Feb '22

15 Feb '22

Hello, I am trying to use FFMPEG to send the output from a MS2109 HDMI to USB capture device to a RTSP server and then to VLC. I've previously used an EasyCap device (composite instead of HDMI) without issue. The problem is that after running the ffmpeg command and looking at the output in VLC the whites in the image appear pink and I believe it's the black that appear green. From my understanding this is a HSV vs RGB issue but I am unsure where the issue is originating from. Is there a way with FFMPEG to cast the image data so that it treats it as RGB/HSV without a conversion so I can get the color fixed? I can add more parameters to the command but this is the simplest command that reproduces the issue. "-input_format (rawvideo|mjpeg|yuyv422)" all cause the same issue as well. $ ffmpeg -i /dev/video0 -f rtsp rtsp://192.168.6.1:8554/test.stream ffmpeg version git-2022-02-05-bedb4ba Copyright (c) 2000-2022 the FFmpeg developers built with gcc 8 (Raspbian 8.3.0-6+rpi1) configuration: --arch=armel --target-os=linux --enable-gpl --enable-nonfree --enable-mmal --enable-omx --enable-omx-rpi --enable-libx264 --extra-ldflags=-latomic --enable-muxer=rtsp --enable-muxer=rtp --enable-protocol=tcp --enable-protocol=udp libavutil 57. 19.100 / 57. 19.100 libavcodec 59. 20.100 / 59. 20.100 libavformat 59. 17.101 / 59. 17.101 libavdevice 59. 5.100 / 59. 5.100 libavfilter 8. 26.101 / 8. 26.101 libswscale 6. 5.100 / 6. 5.100 libswresample 4. 4.100 / 4. 4.100 libpostproc 56. 4.100 / 56. 4.100 Input #0, video4linux2,v4l2, from '/dev/video0': Duration: N/A, start: 182238.016035, bitrate: 147456 kb/s Stream #0:0: Video: rawvideo (YUY2 / 0x32595559), yuyv422, 1280x720, 147456 kb/s, 10 fps, 10 tbr, 1000k tbn Stream mapping: Stream #0:0 -> #0:0 (rawvideo (native) -> mpeg4 (native)) Press [q] to stop, [?] for help [udp @ 0x35ac270] attempted to set receive buffer to size 393216 but it only ended up set as 360448 [udp @ 0x35abe10] attempted to set receive buffer to size 393216 but it only ended up set as 360448 [rtsp @ 0x347c6d0] method SETUP failed: 461 Unsupported Transport Output #0, rtsp, to 'rtsp://192.168.6.1:8554/test.stream': Metadata: encoder : Lavf59.17.101 Stream #0:0: Video: mpeg4, yuv420p(tv, progressive), 1280x720, q=2-31, 200 kb/s, 10 fps, 90k tbn Metadata: encoder : Lavc59.20.100 mpeg4 Side data: cpb: bitrate max/min/avg: 0/0/200000 buffer size: 0 vbv_delay: N/A frame= 87 fps= 10 q=31.0 Lsize=N/A time=00:00:08.60 bitrate=N/A speed=0.988x video:633kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown Exiting normally, received signal 2. I believe I should be able to use "-input_format=mjpeg" since it shows up as a format. $ ffmpeg -f v4l2 -list_formats all -i /dev/video0 ffmpeg version git-2022-02-05-bedb4ba Copyright (c) 2000-2022 the FFmpeg developers built with gcc 8 (Raspbian 8.3.0-6+rpi1) configuration: --arch=armel --target-os=linux --enable-gpl --enable-nonfree --enable-mmal --enable-omx --enable-omx-rpi --enable-libx264 --extra-ldflags=-latomic --enable-muxer=rtsp --enable-muxer=rtp --enable-protocol=tcp --enable-protocol=udp libavutil 57. 19.100 / 57. 19.100 libavcodec 59. 20.100 / 59. 20.100 libavformat 59. 17.101 / 59. 17.101 libavdevice 59. 5.100 / 59. 5.100 libavfilter 8. 26.101 / 8. 26.101 libswscale 6. 5.100 / 6. 5.100 libswresample 4. 4.100 / 4. 4.100 libpostproc 56. 4.100 / 56. 4.100 [video4linux2,v4l2 @ 0x1b22250] Compressed: mjpeg : Motion-JPEG : 1920x1080 1600x1200 1360x768 1280x1024 1280x960 1280x720 1024x768 800x600 720x576 720x480 640x480 [video4linux2,v4l2 @ 0x1b22250] Raw : yuyv422 : YUYV 4:2:2 : 1920x1080 1600x1200 1360x768 1280x1024 1280x960 1280x720 1024x768 800x600 720x576 720x480 640x480 Thanks, Jeff

3 3

color change when converting image to video
by Ronny Kurniawan 15 Feb '22

15 Feb '22

Hi everyone,I am a newbie to ffmpeg. I am currently trying to convert an image (which has a transparent background - alpha channel) to a 2 second video clip at 50fps. At the moment I did the following : ffmpeg -framerate 50 -loop 1 -i input_Image.png -t 2 -vcodec prores_ks -pix_fmt yuva444p10le -profile:v 4444 -alpha_bits 16 -an -y outputMovie.mov This works but the video output has a slight color change and has a higher exposure for some reason. I tried this ffmpeg -framerate 50 -loop 1 -i input_Image.png -t 2 -sws_flags spline+accurate_rnd+full_chroma_int -vf "colormatrix=bt470bg:bt709" -color_range 1 -colorspace 1 -color_primaries 1 -color_trc 1 -vcodec prores_ks -pix_fmt yuva444p10le -profile:v 4444 -an -y outputMovie.mov and it solved the color issue but then the alpha channel disappears. Would there be any suggestions on how I should resolve it. Many thank's guys for your help. Ronny

1 0

Custom data in AVPacket or AVFrame
by laddoe 15 Feb '22

15 Feb '22

Hi, I want to add a custom number to either an AVFame or an AVPacket before I encode it and I want to retrieve it back when I decode it. I have tried using the AVFrame/AVPacket metadata or side_data but I guess I don't understand how to get it to work. I have also looked into using AVDictionary/ AVDictionaryEntry but nothing so far. The data that I want to store per frame is only a uint32_t. The encoding/decoding of frames work correctly, I have been running it for weeks, here is my encoding piece that suppose to add the "custom number" in, but I'm stuck .... void MovieEncoder::writeFrame( AVFrame* frame, int frameNumber ) { int result; if ( s_frameCount >= streamNumberOfFrames) s_frameCount = streamNumberOfFrames; frame->pts = s_frameCount; if (m_formatCtx->oformat->flags & AVFMT_NOFILE ) { AVPacket pkt; av_init_packet(&pkt); pkt.flags |= AV_PKT_FLAG_KEY; pkt.stream_index = m_stream->index; pkt.data = frame->data[0]; pkt.size = sizeof(AVPicture); result = av_write_frame( m_formatCtx, &pkt ); } else { AVPacket pkt; av_init_packet(&pkt); AVFrameSideData* numberSideData = av_frame_new_side_data( frame, AV_FRAME_DATA_GOP_TIMECODE, sizeof( uint64_t )) // Here the magic should happen, I think if( !numberSideData) return; result = avcodec_send_frame(m_codecCtx, frame); checkError( result, "Error encoding video frame: "); while( result >= 0 ) { result = avcodec_receive_packet(m_codecCtx, &pkt); if (result == AVERROR(EAGAIN) /*|| ret == AVERROR_EOF*/) { Log::printLine("No more packet to write", Log::Debug ); return; } else if (result < 0) { Log::printLine("Codec context of the package is not correct", Log::Debug); return; } pkt.stream_index = m_stream->index; pkt.pts = av_rescale_q( pkt.pts, m_codecCtx->time_base, m_stream->time_base ); pkt.dts = av_rescale_q( pkt.dts, m_codecCtx->time_base, m_stream->time_base ); // AVDictionary* dictionary = nullptr; // av_dict_set( &dictionary, metaKey.c_str(),std::to_string( frameNumber ).c_str(), 0 ); // int dictionarySize = 0; // uint8_t* dictionaryData = av_packet_pack_dictionary( dictionary, &dictionarySize ); // av_dict_free( &dictionary ); // av_packet_add_side_data( &pkt, AV_PKT_DATA_STRINGS_METADATA, dictionaryData, dictionarySize ); pkt.duration = int64( 1 / streamFrameRate ); result = av_write_frame( m_formatCtx, &pkt ); s_frameCount++; } } // av_dict_free( &dictionary ); }

1 0

Video Notation, A Video Lingua Franca
by Mark Filipak 15 Feb '22

15 Feb '22

I'm pleased to announce an update here: http://videonotation.spitzner.org/ Please comment on it if interested. Regards, Mark Filipak.

1 0

API documentation for FFmpeg 5.0
by Andreas Unterweger 14 Feb '22

14 Feb '22

Hi, I am trying to find the API documentation for FFmpeg 5.0. On the FFmpeg Web site's documentation page [1], there exist links for trunk [2] and for some releases up to 4.1 [3]. I am looking for documentation on version 5.0 in particular. Is there a similar link for the API documentation of this version? Alternatively, if there is any easy way to build the documentation myself, where can I find information on how to do build the documentation for the whole API? As far as I have tried, calling the "documentation" and "install-html" targets of the Makefile only seems to build documentation for those components which I have enabled. However, I would like to have the API documentation of *all* components without installing every dependency of every component just to build the documentation. I would be grateful for any pointers to either a way to build the whole API documentation or to a link to the documentation of version 5.0. Thank you in advance. Best regards, Andreas [1] https://ffmpeg.org/documentation.html [2] https://ffmpeg.org/doxygen/trunk/index.html [3] https://ffmpeg.org/doxygen/4.1/index.html

1 0

Conversion from mjpeg to H.264 with 2 overlays failed, trace gives me no idea why ...
by Jens Berger 13 Feb '22

13 Feb '22

Hello, I'm new to the list. I'm a radiologist and I wrote a small shellscript years ago which can anonymize ultrasound DICOM data with burnt-in patients name by using one or multiple overlay(s) at least for the patients name for using this movies for educational presentations. So far, this script works very well for primary multiframe DICOM data. But from a good friend of mine, I have the request to anonymize old QT-files from an ancient machine with mjpeg codec. I tried this with two overlays. Unfortunately, ffmpeg gives me an error without further information about the reason. This line seems to be weird to me, but I cannot find more about this problem: sof0: picture: 258x28928 Please - can somebody have a look on this problem? Primary goal is uncompressed mjpeg/qt output, which I cannot figure out - but maybe this is another problem ... Many thanks in advance, Jens -------------------------------------------------------- At first, some information about the source file: MacBook-Jens:~ jb$ /opt/dcm2mov/bin/ffprobe -hide_banner -i test/test.mov [mov,mp4,m4a,3gp,3g2,mj2 @ 0x7fa558003000] multiple edit list entries, a/v desync might occur, patch welcome [mjpeg @ 0x7fa558017e00] Changing bps to 8 Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'test/test.mov': Metadata: major_brand : qt minor_version : 537199360 compatible_brands: qt creation_time : 2022-02-11 09:25:31 com.apple.quicktime.player.movie.visual.brightness: 0.000000 com.apple.quicktime.player.movie.visual.color: 1.000000 com.apple.quicktime.player.movie.visual.tint: 0.000000 com.apple.quicktime.player.movie.visual.contrast: 1.000000 com.apple.quicktime.player.version: 7.6.6 (7.6.6) com.apple.quicktime.version: 7.7.3 (3040) 0x7738000 (Mac OS X, 10.14.6, 18G9323) Duration: 00:01:00.84, start: 0.000000, bitrate: 3630 kb/s Stream #0:0(eng): Video: mjpeg (jpeg / 0x6765706A), yuvj422p(pc, bt470bg/unknown/unknown), 768x576, 3622 kb/s, 7.66 fps, 50 tbr, 600 tbn, 600 tbc (default) Metadata: creation_time : 2022-02-11 09:25:31 handler_name : Apple Alias-Datensteuerung encoder : Acuson JPEG -------------------------------------------------------- Here is the ffmpeg log report: ffmpeg started on 2022-02-11 at 15:27:47 Report written to "ffmpeg-20220211-152747.log" Command line: /opt/dcm2mov/bin/ffmpeg -y -xerror -thread_queue_size 1500 -hide_banner -loglevel trace -report -framerate 7.66 -f mjpeg -i /Users/jb/test/test.mov -i /Users/jb/test/768x576_0_mf.png -i /Users/jb/test/768x576_1_mf.png -filter_complex "[0:v]scale=trunc(iw/2)*2:trunc(ih/2)*2[bg];[1:v]setpts=PTS-STARTPTS[fg1];[2:v]setpts=PTS-STARTPTS[fg2];[bg][fg1]overlay=36:0[ol];[ol][fg2]overlay=4:557,format=yuvj420p[v]" -map "[v]" -map 0 -pix_fmt yuvj420p -framerate 7.66 -c libx264 -f mp4 -crf 0 /Users/jb/test/test.mp4 Splitting the commandline. Reading option '-y' ... matched as option 'y' (overwrite output files) with argument '1'. Reading option '-xerror' ... matched as option 'xerror' (exit on error) with argument '1'. Reading option '-thread_queue_size' ... matched as option 'thread_queue_size' (set the maximum number of queued packets from the demuxer) with argument '1500'. Reading option '-hide_banner' ... matched as option 'hide_banner' (do not show program banner) with argument '1'. Reading option '-loglevel' ... matched as option 'loglevel' (set logging level) with argument 'trace'. Reading option '-report' ... matched as option 'report' (generate a report) with argument '1'. Reading option '-framerate' ... matched as AVOption 'framerate' with argument '7.66'. Reading option '-f' ... matched as option 'f' (force format) with argument 'mjpeg'. Reading option '-i' ... matched as input file with argument '/Users/jb/test/test.mov'. Reading option '-i' ... matched as input file with argument '/Users/jb/test/768x576_0_mf.png'. Reading option '-i' ... matched as input file with argument '/Users/jb/test/768x576_1_mf.png'. Reading option '-filter_complex' ... matched as option 'filter_complex' (create a complex filtergraph) with argument '[0:v]scale=trunc(iw/2)*2:trunc(ih/2)*2[bg];[1:v]setpts=PTS-STARTPTS[fg1];[2:v]setpts=PTS-STARTPTS[fg2];[bg][fg1]overlay=36:0[ol];[ol][fg2]overlay=4:557,format=yuvj420p[v]'. Reading option '-map' ... matched as option 'map' (set input stream mapping) with argument '[v]'. Reading option '-map' ... matched as option 'map' (set input stream mapping) with argument '0'. Reading option '-pix_fmt' ... matched as option 'pix_fmt' (set pixel format) with argument 'yuvj420p'. Reading option '-framerate' ... matched as AVOption 'framerate' with argument '7.66'. Reading option '-c' ... matched as option 'c' (codec name) with argument 'libx264'. Reading option '-f' ... matched as option 'f' (force format) with argument 'mp4'. Reading option '-crf' ... matched as AVOption 'crf' with argument '0'. Reading option '/Users/jb/test/test.mp4' ... matched as output file. Finished splitting the commandline. Parsing a group of options: global . Applying option y (overwrite output files) with argument 1. Applying option xerror (exit on error) with argument 1. Applying option hide_banner (do not show program banner) with argument 1. Applying option loglevel (set logging level) with argument trace. Applying option report (generate a report) with argument 1. Applying option filter_complex (create a complex filtergraph) with argument [0:v]scale=trunc(iw/2)*2:trunc(ih/2)*2[bg];[1:v]setpts=PTS-STARTPTS[fg1];[2:v]setpts=PTS-STARTPTS[fg2];[bg][fg1]overlay=36:0[ol];[ol][fg2]overlay=4:557,format=yuvj420p[v]. Successfully parsed a group of options. Parsing a group of options: input file /Users/jb/test/test.mov. Applying option thread_queue_size (set the maximum number of queued packets from the demuxer) with argument 1500. Applying option f (force format) with argument mjpeg. Successfully parsed a group of options. Opening an input file: /Users/jb/test/test.mov. [file @ 0x7fd3fb5008e0] Setting default whitelist 'file,crypto' [mjpeg @ 0x7fd3fb800000] Before avformat_find_stream_info() pos: 0 bytes read:32768 seeks:0 [mjpeg @ 0x7fd3fd008600] marker=f7 avail_size_in_buf=116591 [mjpeg @ 0x7fd3fd008600] Changing bps to 1 [mjpeg @ 0x7fd3fd008600] sof0: picture: 258x28928 [mjpeg @ 0x7fd3fd008600] marker=d8 avail_size_in_buf=57418 [mjpeg @ 0x7fd3fd008600] marker parser used 0 bytes (0 bits) [mjpeg @ 0x7fd3fd008600] marker=db avail_size_in_buf=57416 [mjpeg @ 0x7fd3fd008600] marker parser used 0 bytes (0 bits) [mjpeg @ 0x7fd3fd008600] marker=c4 avail_size_in_buf=57282 [mjpeg @ 0x7fd3fd008600] marker parser used 0 bytes (0 bits) [mjpeg @ 0x7fd3fd008600] marker=c0 avail_size_in_buf=56862 [mjpeg @ 0x7fd3fd008600] Changing bps to 8 [mjpeg @ 0x7fd3fd008600] sof0: picture: 768x576 [mjpeg @ 0x7fd3fd008600] component 0 2:1 id: 0 quant:0 [mjpeg @ 0x7fd3fd008600] component 1 1:1 id: 1 quant:1 [mjpeg @ 0x7fd3fd008600] component 2 1:1 id: 2 quant:1 [mjpeg @ 0x7fd3fd008600] pix fmt id 21111100 [mjpeg @ 0x7fd3fd008600] marker parser used 17 bytes (136 bits) [mjpeg @ 0x7fd3fd008600] escaping removed 586 bytes [mjpeg @ 0x7fd3fd008600] marker=da avail_size_in_buf=56843 [mjpeg @ 0x7fd3fd008600] marker parser used 0 bytes (0 bits) [mjpeg @ 0x7fd3fd008600] marker=d9 avail_size_in_buf=0 [mjpeg @ 0x7fd3fd008600] decode frame unused 0 bytes [mjpeg @ 0x7fd3fb800000] All info found [mjpeg @ 0x7fd3fb800000] After avformat_find_stream_info() pos: 177152 bytes read:196608 seeks:0 frames:2 Input #0, mjpeg, from '/Users/jb/test/test.mov': Duration: N/A, bitrate: N/A Stream #0:0, 2, 1/1200000: Video: mjpeg, 1 reference frame, yuvj422p(pc, bt470bg/unknown/unknown, center), 768x576, 50/383, lossless, 7.66 tbr, 1200k tbn, 7.66 tbc Successfully opened the file. Parsing a group of options: input file /Users/jb/test/768x576_0_mf.png. Successfully parsed a group of options. Opening an input file: /Users/jb/test/768x576_0_mf.png. [file @ 0x7fd3fb407920] Setting default whitelist 'file,crypto' [png_pipe @ 0x7fd3fd009600] Format png_pipe probed with size=2048 and score=99 [png_pipe @ 0x7fd3fd009600] Before avformat_find_stream_info() pos: 0 bytes read:364 seeks:0 [png_pipe @ 0x7fd3fd009600] After avformat_find_stream_info() pos: 364 bytes read:364 seeks:0 frames:1 Input #1, png_pipe, from '/Users/jb/test/768x576_0_mf.png': Duration: N/A, bitrate: N/A Stream #1:0, 1, 1/25: Video: png, 1 reference frame, pal8(pc), 640x21 (0x0), 1/25, 25 tbr, 25 tbn, 25 tbc Successfully opened the file. Parsing a group of options: input file /Users/jb/test/768x576_1_mf.png. Successfully parsed a group of options. Opening an input file: /Users/jb/test/768x576_1_mf.png. [file @ 0x7fd3fb407d60] Setting default whitelist 'file,crypto' [png_pipe @ 0x7fd3fb820400] Format png_pipe probed with size=2048 and score=99 [png_pipe @ 0x7fd3fb820400] Before avformat_find_stream_info() pos: 0 bytes read:374 seeks:0 [png_pipe @ 0x7fd3fb820400] After avformat_find_stream_info() pos: 374 bytes read:374 seeks:0 frames:1 Input #2, png_pipe, from '/Users/jb/test/768x576_1_mf.png': Duration: N/A, bitrate: N/A Stream #2:0, 1, 1/25: Video: png, 1 reference frame, pal8(pc), 760x20 (0x0), 1/25, 25 tbr, 25 tbn, 25 tbc Successfully opened the file. detected 8 logical cores [Parsed_scale_0 @ 0x7fd3fb408380] Setting 'w' to value 'trunc(iw/2)*2' [Parsed_scale_0 @ 0x7fd3fb408380] Setting 'h' to value 'trunc(ih/2)*2' [Parsed_scale_0 @ 0x7fd3fb408380] w:trunc(iw/2)*2 h:trunc(ih/2)*2 flags:'bilinear' interl:0 [Parsed_setpts_1 @ 0x7fd3fb408900] Setting 'expr' to value 'PTS-STARTPTS' [Parsed_setpts_2 @ 0x7fd3fb408e40] Setting 'expr' to value 'PTS-STARTPTS' [Parsed_overlay_3 @ 0x7fd3fb4092a0] Setting 'x' to value '36' [Parsed_overlay_3 @ 0x7fd3fb4092a0] Setting 'y' to value '0' [Parsed_overlay_4 @ 0x7fd3fb408600] Setting 'x' to value '4' [Parsed_overlay_4 @ 0x7fd3fb408600] Setting 'y' to value '557' [Parsed_format_5 @ 0x7fd3fb409ce0] compat: called with args=[yuvj420p] [Parsed_format_5 @ 0x7fd3fb409ce0] Setting 'pix_fmts' to value 'yuvj420p' Parsing a group of options: output file /Users/jb/test/test.mp4. Applying option map (set input stream mapping) with argument [v]. Applying option map (set input stream mapping) with argument 0. Applying option pix_fmt (set pixel format) with argument yuvj420p. Applying option c (codec name) with argument libx264. Applying option f (force format) with argument mp4. Successfully parsed a group of options. Opening an output file: /Users/jb/test/test.mp4. [file @ 0x7fd3fb5025e0] Setting default whitelist 'file,crypto' Successfully opened the file. [Parsed_scale_0 @ 0x7fd3fb501b20] Setting 'w' to value 'trunc(iw/2)*2' [Parsed_scale_0 @ 0x7fd3fb501b20] Setting 'h' to value 'trunc(ih/2)*2' [Parsed_scale_0 @ 0x7fd3fb501b20] w:trunc(iw/2)*2 h:trunc(ih/2)*2 flags:'bilinear' interl:0 [Parsed_setpts_1 @ 0x7fd3fb501f60] Setting 'expr' to value 'PTS-STARTPTS' [Parsed_setpts_2 @ 0x7fd3fb502f80] Setting 'expr' to value 'PTS-STARTPTS' [Parsed_overlay_3 @ 0x7fd3fb5033e0] Setting 'x' to value '36' [Parsed_overlay_3 @ 0x7fd3fb5033e0] Setting 'y' to value '0' [Parsed_overlay_4 @ 0x7fd3fb502ee0] Setting 'x' to value '4' [Parsed_overlay_4 @ 0x7fd3fb502ee0] Setting 'y' to value '557' [Parsed_format_5 @ 0x7fd3fb503d80] compat: called with args=[yuvj420p] [Parsed_format_5 @ 0x7fd3fb503d80] Setting 'pix_fmts' to value 'yuvj420p' [graph 0 input from stream 0:0 @ 0x7fd3fb5040a0] Setting 'video_size' to value '768x576' [graph 0 input from stream 0:0 @ 0x7fd3fb5040a0] Setting 'pix_fmt' to value '13' [graph 0 input from stream 0:0 @ 0x7fd3fb5040a0] Setting 'time_base' to value '1/1200000' [graph 0 input from stream 0:0 @ 0x7fd3fb5040a0] Setting 'pixel_aspect' to value '0/1' [graph 0 input from stream 0:0 @ 0x7fd3fb5040a0] Setting 'sws_param' to value 'flags=2' [graph 0 input from stream 0:0 @ 0x7fd3fb5040a0] Setting 'frame_rate' to value '383/50' [graph 0 input from stream 0:0 @ 0x7fd3fb5040a0] w:768 h:576 pixfmt:yuvj422p tb:1/1200000 fr:383/50 sar:0/1 sws_param:flags=2 [graph 0 input from stream 1:0 @ 0x7fd3fb5043c0] Setting 'video_size' to value '640x21' [graph 0 input from stream 1:0 @ 0x7fd3fb5043c0] Setting 'pix_fmt' to value '11' [graph 0 input from stream 1:0 @ 0x7fd3fb5043c0] Setting 'time_base' to value '1/25' [graph 0 input from stream 1:0 @ 0x7fd3fb5043c0] Setting 'pixel_aspect' to value '0/1' [graph 0 input from stream 1:0 @ 0x7fd3fb5043c0] Setting 'sws_param' to value 'flags=2' [graph 0 input from stream 1:0 @ 0x7fd3fb5043c0] Setting 'frame_rate' to value '25/1' [graph 0 input from stream 1:0 @ 0x7fd3fb5043c0] w:640 h:21 pixfmt:pal8 tb:1/25 fr:25/1 sar:0/1 sws_param:flags=2 [graph 0 input from stream 2:0 @ 0x7fd3fb600500] Setting 'video_size' to value '760x20' [graph 0 input from stream 2:0 @ 0x7fd3fb600500] Setting 'pix_fmt' to value '11' [graph 0 input from stream 2:0 @ 0x7fd3fb600500] Setting 'time_base' to value '1/25' [graph 0 input from stream 2:0 @ 0x7fd3fb600500] Setting 'pixel_aspect' to value '0/1' [graph 0 input from stream 2:0 @ 0x7fd3fb600500] Setting 'sws_param' to value 'flags=2' [graph 0 input from stream 2:0 @ 0x7fd3fb600500] Setting 'frame_rate' to value '25/1' [graph 0 input from stream 2:0 @ 0x7fd3fb600500] w:760 h:20 pixfmt:pal8 tb:1/25 fr:25/1 sar:0/1 sws_param:flags=2 [format @ 0x7fd3fb408600] compat: called with args=[yuvj420p] [format @ 0x7fd3fb408600] Setting 'pix_fmts' to value 'yuvj420p' [auto-inserted scaler 0 @ 0x7fd3fb408e00] w:iw h:ih flags:'bilinear' interl:0 [Parsed_overlay_3 @ 0x7fd3fb5033e0] auto-inserting filter 'auto-inserted scaler 0' between the filter 'Parsed_setpts_1' and the filter 'Parsed_overlay_3' [auto-inserted scaler 1 @ 0x7fd3fb409c20] w:iw h:ih flags:'bilinear' interl:0 [Parsed_overlay_4 @ 0x7fd3fb502ee0] auto-inserting filter 'auto-inserted scaler 1' between the filter 'Parsed_setpts_2' and the filter 'Parsed_overlay_4' [auto-inserted scaler 2 @ 0x7fd3fb409ac0] w:iw h:ih flags:'bilinear' interl:0 [Parsed_format_5 @ 0x7fd3fb503d80] auto-inserting filter 'auto-inserted scaler 2' between the filter 'Parsed_overlay_4' and the filter 'Parsed_format_5' [AVFilterGraph @ 0x7fd3fb5027a0] query_formats: 11 queried, 7 merged, 3 already done, 0 delayed [swscaler @ 0x10b306000] deprecated pixel format used, make sure you did set range correctly [Parsed_scale_0 @ 0x7fd3fb501b20] w:768 h:576 fmt:yuvj422p sar:0/1 -> w:768 h:576 fmt:yuva420p sar:0/1 flags:0x2 [graph 0 input from stream 1:0 @ 0x7fd3fb5043c0] TB:0.040000 FRAME_RATE:25.000000 SAMPLE_RATE:nan [auto-inserted scaler 0 @ 0x7fd3fb408e00] w:640 h:21 fmt:pal8 sar:0/1 -> w:640 h:21 fmt:yuva420p sar:0/1 flags:0x2 [Parsed_overlay_3 @ 0x7fd3fb5033e0] main w:768 h:576 fmt:yuva420p overlay w:640 h:21 fmt:yuva420p eof_action:repeat [Parsed_overlay_3 @ 0x7fd3fb5033e0] [framesync @ 0x7fd3fb5034a8] Selected 1/1000000 time base [Parsed_overlay_3 @ 0x7fd3fb5033e0] [framesync @ 0x7fd3fb5034a8] Sync level 2 [graph 0 input from stream 2:0 @ 0x7fd3fb600500] TB:0.040000 FRAME_RATE:25.000000 SAMPLE_RATE:nan [auto-inserted scaler 1 @ 0x7fd3fb409c20] w:760 h:20 fmt:pal8 sar:0/1 -> w:760 h:20 fmt:yuva420p sar:0/1 flags:0x2 [Parsed_overlay_4 @ 0x7fd3fb502ee0] main w:768 h:576 fmt:yuva420p overlay w:760 h:20 fmt:yuva420p eof_action:repeat [Parsed_overlay_4 @ 0x7fd3fb502ee0] [framesync @ 0x7fd3fb503968] Selected 1/1000000 time base [Parsed_overlay_4 @ 0x7fd3fb502ee0] [framesync @ 0x7fd3fb503968] Sync level 2 [swscaler @ 0x10b32d000] deprecated pixel format used, make sure you did set range correctly [auto-inserted scaler 2 @ 0x7fd3fb409ac0] w:768 h:576 fmt:yuva420p sar:0/1 -> w:768 h:576 fmt:yuvj420p sar:0/1 flags:0x2 [graph 1 input from stream 0:0 @ 0x7fd3fb40d600] Setting 'video_size' to value '768x576' [graph 1 input from stream 0:0 @ 0x7fd3fb40d600] Setting 'pix_fmt' to value '13' [graph 1 input from stream 0:0 @ 0x7fd3fb40d600] Setting 'time_base' to value '1/1200000' [graph 1 input from stream 0:0 @ 0x7fd3fb40d600] Setting 'pixel_aspect' to value '0/1' [graph 1 input from stream 0:0 @ 0x7fd3fb40d600] Setting 'sws_param' to value 'flags=2' [graph 1 input from stream 0:0 @ 0x7fd3fb40d600] Setting 'frame_rate' to value '383/50' [graph 1 input from stream 0:0 @ 0x7fd3fb40d600] w:768 h:576 pixfmt:yuvj422p tb:1/1200000 fr:383/50 sar:0/1 sws_param:flags=2 [format @ 0x7fd3fb40da60] compat: called with args=[yuvj420p] [format @ 0x7fd3fb40da60] Setting 'pix_fmts' to value 'yuvj420p' [auto-inserted scaler 0 @ 0x7fd3fb40de40] Setting 'flags' to value 'bicubic' [auto-inserted scaler 0 @ 0x7fd3fb40de40] w:iw h:ih flags:'bicubic' interl:0 [format @ 0x7fd3fb40da60] auto-inserting filter 'auto-inserted scaler 0' between the filter 'Parsed_null_0' and the filter 'format' [AVFilterGraph @ 0x7fd3fb403080] query_formats: 4 queried, 2 merged, 1 already done, 0 delayed [swscaler @ 0x10b33a000] deprecated pixel format used, make sure you did set range correctly [auto-inserted scaler 0 @ 0x7fd3fb40de40] w:768 h:576 fmt:yuvj422p sar:0/1 -> w:768 h:576 fmt:yuvj420p sar:0/1 flags:0x4 [libx264 @ 0x7fd3fb815a00] using mv_range_thread = 24 [libx264 @ 0x7fd3fb815a00] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 AVX2 LZCNT BMI2 [libx264 @ 0x7fd3fb815a00] profile High 4:4:4 Predictive, level 3.1, 4:2:0 8-bit [libx264 @ 0x7fd3fb815a00] 64 - core 148 - H.264/MPEG-4 AVC codec - Copyleft 2003-2015 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x1:0x111 me=hex subme=7 psy=0 mixed_ref=1 me_range=16 chroma_me=1 trellis=0 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=0 chroma_qp_offset=0 threads=12 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=0 weightp=2 keyint=250 keyint_min=7 scenecut=40 intra_refresh=0 rc=cqp mbtree=0 qp=0 [libx264 @ 0x7fd3fd013400] using mv_range_thread = 24 [libx264 @ 0x7fd3fd013400] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 AVX2 LZCNT BMI2 [libx264 @ 0x7fd3fd013400] profile High 4:4:4 Predictive, level 3.1, 4:2:0 8-bit [libx264 @ 0x7fd3fd013400] 64 - core 148 - H.264/MPEG-4 AVC codec - Copyleft 2003-2015 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x1:0x111 me=hex subme=7 psy=0 mixed_ref=1 me_range=16 chroma_me=1 trellis=0 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=0 chroma_qp_offset=0 threads=12 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=0 weightp=2 keyint=250 keyint_min=7 scenecut=40 intra_refresh=0 rc=cqp mbtree=0 qp=0 Output #0, mp4, to '/Users/jb/test/test.mp4': Metadata: encoder : Lavf57.25.100 Stream #0:0, 0, 1/12256: Video: h264 (libx264), -1 reference frame ([33][0][0][0] / 0x0021), yuvj420p(pc), 768x576, 50/383, q=-1--1, 7.66 fps, 12256 tbn, 7.66 tbc Metadata: encoder : Lavc57.24.102 libx264 Side data: unknown side data type 10 (24 bytes) Stream #0:1, 0, 1/12256: Video: h264 (libx264), -1 reference frame ([33][0][0][0] / 0x0021), yuvj420p(pc, center), 768x576, 50/383, q=-1--1, 7.66 fps, 12256 tbn, 7.66 tbc Metadata: encoder : Lavc57.24.102 libx264 Side data: unknown side data type 10 (24 bytes) Stream mapping: Stream #0:0 (mjpeg) -> scale (graph 0) Stream #1:0 (png) -> setpts (graph 0) Stream #2:0 (png) -> setpts (graph 0) format (graph 0) -> Stream #0:0 (libx264) Stream #0:0 -> #0:1 (mjpeg (native) -> h264 (libx264)) Press [q] to stop, [?] for help cur_dts is invalid (this is harmless if it occurs once at the start per stream) cur_dts is invalid (this is harmless if it occurs once at the start per stream) [mjpeg @ 0x7fd3fb817800] marker=f7 avail_size_in_buf=116591 [mjpeg @ 0x7fd3fb817800] Changing bps to 1 [mjpeg @ 0x7fd3fb817800] sof0: picture: 258x28928 [AVIOContext @ 0x7fd3fb502660] Statistics: 0 seeks, 1 writeouts [AVIOContext @ 0x7fd3fb5009a0] Statistics: 589824 bytes read, 0 seeks [AVIOContext @ 0x7fd3fb407460] Statistics: 364 bytes read, 0 seeks [AVIOContext @ 0x7fd3fb4082a0] Statistics: 374 bytes read, 0 seeks Conversion failed!

3 5

Secure Video Streaming
by LianCheng 12 Feb '22

12 Feb '22

Hi, I would like to have my video streaming encrypted using SRTP. Looking at the ffmpeg documentation, seem like the encoding suites are limited as follows: ‘AES_CM_128_HMAC_SHA1_80’ ‘SRTP_AES128_CM_HMAC_SHA1_80’ ‘AES_CM_128_HMAC_SHA1_32’ ‘SRTP_AES128_CM_HMAC_SHA1_32’ How do I get AES-256 encryption?

1 0