September 2019 - ffmpeg-user - lists.ffmpeg.org

Unable to record VP8+Opus from RTP+SDP
by Juan Navarro 03 Sep '19

03 Sep '19

Hi, I'd like to record an RTP stream with one VP8 video and one OPUS audio; these are originated from Chrome and then distributed as plain RTP streams. I've written a basic SDP file to use as input for ffmpeg, but my results have been mixed: 1) Recording only the video works fine with a WEBM container (using "-vcodec copy -an -f webm"). ffmpeg is able to automatically find out properties of the video, such as the resolution, and it stores it fine. Other players (VLC tested) are able to open the file. 2) Recording only the audio is possible, again if using WEBM (with "-acodec copy -vn -f webm"), but seems that no Opus headers/metadata are stored. While ffplay is able to play the recorded file, other players complain about it. E.g. VLC says "opus error: cannot read Opus header", "opus error: initial Opus header is corrupted". There is, however, no error or warning message printed out from the debug FFmpeg output. Interestingly enough, using other container, e.g. OGG (with "-f opus" and a .ogg output file), then the recording won't start at all due to missing extradata: [opus @ 0x5e5d380] No extradata present Could not write header for output file #0 (incorrect codec parameters ?): Invalid data found when processing input 3) Recording of both audio and video in WEBM or Matroska doesn't work, ffmpeg complains about not being able to get the video resolution (but it was able to do so when recording only video): [sdp @ 0x6094a00] Could not find codec parameters for stream 1 (Video: vp8, 1 reference frame, yuv420p): unspecified size Consider increasing the value for the 'analyzeduration' and 'probesize' options [webm @ 0x6098640] dimensions not set Could not write header for output file #0 (incorrect codec parameters ?): Invalid argument Note that I've already tried setting analyzeduration and probesize to 10M, this takes a long time to start the ffmpeg command but in the end doesn't really change the outcome. This is the input SDP: v=0 o=- 0 0 IN IP4 127.0.0.1 s=- c=IN IP4 127.0.0.1 t=0 0 m=audio 5006 RTP/AVP 109 a=rtpmap:109 opus/48000/2 m=video 5004 RTP/AVP 120 a=rtpmap:120 VP8/90000 And these are the commands: # Audio recording ffmpeg -protocol_whitelist file,rtp,udp \ -fflags +genpts -i input.sdp \ -map 0:a:0 -acodec copy -vn \ -f webm -flags +global_header -y recording.webm # Video recording ffmpeg -protocol_whitelist file,rtp,udp \ -fflags +genpts -i input.sdp \ -map 0:v:0 -vcodec copy -an \ -f webm -flags +global_header -y recording.webm # Audio+Video recording, this is the final use case I'd like to end up solving, although being able to run the previous two commands will help me learn and understand more about how FFmpeg works: ffmpeg -protocol_whitelist file,rtp,udp -nostdin -loglevel debug \ -fflags +genpts -i input.sdp \ -map 0:a:0 -map 0:v:0 -acodec copy -vcodec copy \ -f webm -flags +global_header -y recording.webm Given how easy it is to break the recording of the audio (eg. when trying OGG format, instead of WEBM), I'm inclined to think that these problems are matter of finding the right options for some of the ffmpeg commands, and make the streams play well with the container. I want to avoid transcoding, so all codecs should be "copy". After all, the target here is to just store incoming media from Chrome, not to reencode it... Could anyone give me a hand here? PS. If anyone has a solution and wants the karma, I posted this question in SuperUser: https://superuser.com/questions/1468786/rtp-ffmpeg-dimensions-not-set-only-… ---- Full ffmpeg debug output: ffmpeg version 4.2-static https://johnvansickle.com/ffmpeg/ Copyright (c) 2000-2019 the FFmpeg developers built with gcc 6.3.0 (Debian 6.3.0-18+deb9u1) 20170516 configuration: --enable-gpl --enable-version3 --enable-static --disable-debug --disable-ffplay --disable-indev=sndio --disable-outdev=sndio --cc=gcc-6 --enable-fontconfig --enable-frei0r --enable-gnutls --enable-gmp --enable-libgme --enable-gray --enable-libaom --enable-libfribidi --enable-libass --enable-libvmaf --enable-libfreetype --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-librubberband --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libvorbis --enable-libopus --enable-libtheora --enable-libvidstab --enable-libvo-amrwbenc --enable-libvpx --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxml2 --enable-libdav1d --enable-libxvid --enable-libzvbi --enable-libzimg libavutil 56. 31.100 / 56. 31.100 libavcodec 58. 54.100 / 58. 54.100 libavformat 58. 29.100 / 58. 29.100 libavdevice 58. 8.100 / 58. 8.100 libavfilter 7. 57.100 / 7. 57.100 libswscale 5. 5.100 / 5. 5.100 libswresample 3. 5.100 / 3. 5.100 libpostproc 55. 5.100 / 55. 5.100 Splitting the commandline. Reading option '-protocol_whitelist' ... matched as AVOption 'protocol_whitelist' with argument 'file,rtp,udp'. Reading option '-nostdin' ... matched as option 'stdin' (enable or disable interaction on standard input) with argument 0. Reading option '-loglevel' ... matched as option 'loglevel' (set logging level) with argument 'debug'. Reading option '-fflags' ... matched as AVOption 'fflags' with argument '+genpts'. Reading option '-i' ... matched as input url with argument 'input.sdp'. Reading option '-map' ... matched as option 'map' (set input stream mapping) with argument '0:a:0'. Reading option '-map' ... matched as option 'map' (set input stream mapping) with argument '0:v:0'. Reading option '-acodec' ... matched as option 'acodec' (force audio codec ('copy' to copy stream)) with argument 'copy'. Reading option '-vcodec' ... matched as option 'vcodec' (force video codec ('copy' to copy stream)) with argument 'copy'. Reading option '-f' ... matched as option 'f' (force format) with argument 'webm'. Reading option '-flags' ... matched as AVOption 'flags' with argument '+global_header'. Reading option '-y' ... matched as option 'y' (overwrite output files) with argument '1'. Reading option 'recording.webm' ... matched as output url. Finished splitting the commandline. Parsing a group of options: global . Applying option nostdin (enable or disable interaction on standard input) with argument 0. Applying option loglevel (set logging level) with argument debug. Applying option y (overwrite output files) with argument 1. Successfully parsed a group of options. Parsing a group of options: input url input.sdp. Successfully parsed a group of options. Opening an input file: input.sdp. [NULL @ 0x6094a00] Opening 'input.sdp' for reading [sdp @ 0x6094a00] Format sdp probed with size=2048 and score=50 [sdp @ 0x6094a00] audio codec set to: opus [sdp @ 0x6094a00] audio samplerate set to: 48000 [sdp @ 0x6094a00] audio channels set to: 2 [sdp @ 0x6094a00] video codec set to: vp8 [udp @ 0x609d480] end receive buffer size reported is 131072 [udp @ 0x6096f80] end receive buffer size reported is 131072 [sdp @ 0x6094a00] setting jitter buffer size to 500 [udp @ 0x6097e80] end receive buffer size reported is 131072 [udp @ 0x6097600] end receive buffer size reported is 131072 [sdp @ 0x6094a00] setting jitter buffer size to 500 [sdp @ 0x6094a00] Before avformat_find_stream_info() pos: 157 bytes read:157 seeks:0 nb_streams:2 [sdp @ 0x6094a00] max_analyze_duration 5000000 reached at 5000000 microseconds st:0 [sdp @ 0x6094a00] Could not find codec parameters for stream 1 (Video: vp8, 1 reference frame, yuv420p): unspecified size Consider increasing the value for the 'analyzeduration' and 'probesize' options [sdp @ 0x6094a00] After avformat_find_stream_info() pos: 157 bytes read:157 seeks:0 frames:252 Input #0, sdp, from 'input.sdp': Metadata: title : - Duration: N/A, start: 0.000000, bitrate: N/A Stream #0:0, 252, 1/48000: Audio: opus, 48000 Hz, stereo, fltp Stream #0:1, 0, 1/90000: Video: vp8, 1 reference frame, yuv420p, 90k tbr, 90k tbn, 90k tbc Successfully opened the file. Parsing a group of options: output url recording.webm. Applying option map (set input stream mapping) with argument 0:a:0. Applying option map (set input stream mapping) with argument 0:v:0. Applying option acodec (force audio codec ('copy' to copy stream)) with argument copy. Applying option vcodec (force video codec ('copy' to copy stream)) with argument copy. Applying option f (force format) with argument webm. Successfully parsed a group of options. Opening an output file: recording.webm. [file @ 0x60e7000] Setting default whitelist 'file,crypto' Successfully opened the file. [webm @ 0x6098640] dimensions not set Could not write header for output file #0 (incorrect codec parameters ?): Invalid argument Stream mapping: Stream #0:0 -> #0:0 (copy) Stream #0:1 -> #0:1 (copy) Last message repeated 1 times [AVIOContext @ 0x6123800] Statistics: 0 seeks, 0 writeouts [AVIOContext @ 0x6095480] Statistics: 157 bytes read, 0 seeks

2 5

Extracting Frames from Video using FFMPEG in GPU and File Name with TimeStamp in Linux
by suraj kandukuri 03 Sep '19

03 Sep '19

Hi, I have Long video ~8hrs to be converted to individual frames to be saved in a folder with the filename in the format "InputVideoName_Frame_Number_TimeStampoftheframeinthevideo.jpg" for example: InputVideo2_234_130425 in a python code. My system has GPU to process the load. I was able to get to a part of it by running the below code in terminal but was not able to have the filename in the format i need and also was not able to run it in python code with absolute pathnames ffmpeg -i ActualPath/Video.mp4 -vf fps=1 Outputfolder/out%d.jpg *Thanks, Suraj *Phone:- 972-900-3677

2 2

608 to scc has truncated lines... maybe?
by a＠slo.me 03 Sep '19

03 Sep '19

I'm running the command ffmpeg -f lavfi -i movie="1.mp4[out+subcc]" \ -map 0:1 -c copy out1.scc \ -map 0:1 out1.vtt \ 2> con.txt The video file is here > https://slo.me/ffscc/1.mp4 con.txt, out1.scc, and out1.vtt are attached. ffmpeg version N-94431-g42a2edcc1d Copyright (c) 2000-2019 the FFmpeg developers built with OpenBSD clang version 7.0.1 (tags/RELEASE_701/final) (based on LLVM 7.0.1) configuration: --enable-libx264 --enable-libx265 --enable-libopus --enable-gpl --enable-version3 --enable-shared --enable-libfdk-aac --enable-gnutls --enable-nonfree --disable-debug libavutil 56. 32.100 / 56. 32.100 libavcodec 58. 55.100 / 58. 55.100 libavformat 58. 30.100 / 58. 30.100 libavdevice 58. 9.100 / 58. 9.100 libavfilter 7. 58.100 / 7. 58.100 libswscale 5. 6.100 / 5. 6.100 libswresample 3. 6.100 / 3. 6.100 libpostproc 55. 6.100 / 55. 6.100 Input #0, lavfi, from 'movie=1.mp4[out+subcc]': Duration: N/A, start: 0.033000, bitrate: N/A Stream #0:0: Video: rawvideo (I420 / 0x30323449), yuv420p, 400x224 [SAR 1:1 DAR 25:14], 29.97 tbr, 90k tbn, 90k tbc Stream #0:1: Subtitle: eia_608 Output #0, scc, to 'out1.scc': Metadata: encoder : Lavf58.30.100 Stream #0:0: Subtitle: eia_608 Output #1, webvtt, to 'out1.vtt': Metadata: encoder : Lavf58.30.100 Stream #1:0: Subtitle: webvtt Metadata: encoder : Lavc58.55.100 webvtt Stream mapping: Stream #0:1 -> #0:0 (copy) Stream #0:1 -> #1:0 (eia_608 (cc_dec) -> webvtt (native)) Press [q] to stop, [?] for help size= 5kB time=00:00:37.30 bitrate= 1.2kbits/s speed=74.6x ^Msize= 12kB time=00:01:14.90 bitrate= 1.3kbits/s speed=74.9x ^Msize= 17kB time=00:01:45.83 bitrate= 1.3kbits/s speed=70.5x ^Msize= 24kB time=00:02:23.00 bitrate= 1.4kbits/s speed=71.5x ^M[Parsed_movie_0 @ 0xe35d837ea00] EOF timestamp not reliable size= 27kB time=00:02:41.26 bitrate= 1.4kbits/s speed=70.2x video:0kB audio:0kB subtitle:286kB other streams:0kB global headers:0kB muxing overhead: unknown my scc file comes out like this Scenarist_SCC V1.0 00:00:00:03 9420 00:00:00:04 94f4 00:00:00:05 5b6d 00:00:00:06 7573 00:00:00:07 e9e3 00:00:00:08 2070 00:00:00:09 ec61 00:00:00:10 79e9 00:00:00:11 6e67 00:00:00:12 5d80 00:00:00:13 942c 00:00:00:16 942f 00:00:02:04 942c 00:00:04:13 9420 00:00:04:14 9452 however, my webvtt file comes out as expected WEBVTT 00:00.533 --> 00:02.135 [music playing] 00:05.538 --> 00:08.641 \h\h\h- In Egypt’s capital, Cairo, one environmentalist 00:08.742 --> 00:13.546 taps into the power of community to spread his green message. 00:13.646 --> 00:14.981 My name is Sharif Hosny. 00:15.081 --> 00:16.916 I’m the co-founder of Schaduf. 00:17.017 --> 00:21.187 - Schaduf is an Arabic word for an ancient irrigation tool that 00:21.287 --> 00:24.190 is still used by farmers today. 00:24.290 --> 00:28.228 It lifts water to irrigate \hcanals to harvest crops. I'm not sure of my mistake. Thank you for your time, Adrian

1 1

Read values from a text or CSV file?
by Michael Koch 02 Sep '19

02 Sep '19

Hello all, for a special effect I want to overlay a small video over the main video, where the position of the overlay is a function of time. It's a complicated function and can't be expressed by a simple formula. Segment-wise linear interpolation might work, but many segments are required and the command line may get too long: between(t,0,1) * lerp(x0,x1,t) + between(t,1,2) * lerp(x1,x2,t-1) + between(t,2,3) * lerp(x2,x1,t-2) + ... Is there any way to read the pre-calculated coordinates for the overlay filter from a text or CSV file? Or from a PGM file, as in the remap filter? Thanks, Michael

3 4

ffprobe aspect ration
by Jonathan Baecker 01 Sep '19

01 Sep '19

Hello, I figure out that ffprobe not always show the "display_aspect_ratio", but mediainfo does. Is there any technical reason for that? Or is there another way to get this info, instead of using "-show_streams". I could calculate the aspect from resolution but how could I be sure that the pixels are square? Here are a uncut output: ffprobe -i D:\char.mp4 -select_streams v:0 -show_streams ffprobe version N-94265-gecdb6fbe18 Copyright (c) 2007-2019 the FFmpeg developers built with gcc 9.1.0 (Rev3, Built by MSYS2 project) configuration: --enable-sdl2 --enable-gmp --enable-libmp3lame --enable-libvpx --enable-libx264 --enable-libx265 --enable-fontconfig --enable-libfreetype --enable-libmysofa --enable-libopenjpeg --enable-libsoxr --enable-libtwolame --enable-libwavpack --enable-libwebp --enable-libxml2 --enable-libzimg --enable-gpl --enable-avisynth --enable-chromaprint --enable-libfdk-aac --enable-libfribidi --enable-librubberband --enable-libzmq --enable-opengl --enable-libsrt --enable-libaom --enable-schannel --extra-cflags=-DLIBTWOLAME_STATIC --extra-cflags=-DCHROMAPRINT_NODLL --extra-libs=-lstdc++ --extra-cflags=-DZMQ_STATIC --extra-cflags=-DLIBXML_STATIC --enable-version3 --enable-nonfree --disable-stripping libavutil 56. 30.100 / 56. 30.100 libavcodec 58. 53.101 / 58. 53.101 libavformat 58. 28.101 / 58. 28.101 libavdevice 58. 7.100 / 58. 7.100 libavfilter 7. 56.101 / 7. 56.101 libswscale 5. 4.101 / 5. 4.101 libswresample 3. 4.100 / 3. 4.100 libpostproc 55. 4.100 / 55. 4.100 Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'D:\char.mp4': Metadata: major_brand : isom minor_version : 512 compatible_brands: isomiso2avc1mp41 encoder : Lavf58.28.101 Duration: 00:04:07.53, start: 0.000000, bitrate: 9085 kb/s Stream #0:0(und): Video: h264 (Constrained Baseline) (avc1 / 0x31637661), yuv420p, 1920x1080, 8953 kb/s, 25 fps, 25 tbr, 12800 tbn, 50 tbc (default) Metadata: handler_name : VideoHandler Stream #0:1(und): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 127 kb/s (default) Metadata: handler_name : SoundHandler [STREAM] index=0 codec_name=h264 codec_long_name=H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10 profile=Constrained Baseline codec_type=video codec_time_base=1/50 codec_tag_string=avc1 codec_tag=0x31637661 width=1920 height=1080 coded_width=1920 coded_height=1088 has_b_frames=0 sample_aspect_ratio=N/A display_aspect_ratio=N/A pix_fmt=yuv420p level=40 color_range=unknown color_space=unknown color_transfer=unknown color_primaries=unknown chroma_location=left field_order=unknown timecode=N/A refs=1 is_avc=true nal_length_size=4 id=N/A r_frame_rate=25/1 avg_frame_rate=25/1 time_base=1/12800 start_pts=0 start_time=0.000000 duration_ts=3168256 duration=247.520000 bit_rate=8953725 max_bit_rate=N/A bits_per_raw_sample=8 nb_frames=6188 nb_read_frames=N/A nb_read_packets=N/A DISPOSITION:default=1 DISPOSITION:dub=0 DISPOSITION:original=0 DISPOSITION:comment=0 DISPOSITION:lyrics=0 DISPOSITION:karaoke=0 DISPOSITION:forced=0 DISPOSITION:hearing_impaired=0 DISPOSITION:visual_impaired=0 DISPOSITION:clean_effects=0 DISPOSITION:attached_pic=0 DISPOSITION:timed_thumbnails=0 TAG:language=und TAG:handler_name=VideoHandler [/STREAM]

2 4

CUTTING A VIDEO WITHOUT RE-ENCODING GETS AUDIO OUT OF SYNC
by Alejandro Escudero 01 Sep '19

01 Sep '19

Hi! I am trying to cut a video file in to parts, without re-enconding the video, but i get a video file with non sync audio, how can I solve these with out re-encoding since I need a fast way to cut. I used this command: ffmpeg -i file.mp4 -ss 00:03:00 -t 00:05:00 -c copy part1.mp4 Thanks! Alejandro [https://ipmcdn.avast.com/images/icons/icon-envelope-tick-round-orange-anima…]<https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> Libre de virus. www.avast.com<https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…>

4 4