December 2023 - ffmpeg-user - lists.ffmpeg.org

Rgbashift T value
by emmanuel martin 22 Dec '23

22 Dec '23

Hello everyone, The rgbashift command is causing me some trouble when I refer to its documentation. Perhaps the issue stems from a misunderstanding. Here's the part that interests me: rgbashift AVOptions: rh <int> ..FV.....T. shift red horizontally (from -255 to 255) (default 0) rv <int> ..FV.....T. shift red vertically (from -255 to 255) (default 0) gh <int> ..FV.....T. shift green horizontally (from -255 to 255) (default 0) gv <int> ..FV.....T. shift green vertically (from -255 to 255) (default 0) bh <int> ..FV.....T. shift blue horizontally (from -255 to 255) (default 0) bv <int> ..FV.....T. shift blue vertically (from -255 to 255) (default 0) ah <int> ..FV.....T. shift alpha horizontally (from -255 to 255) (default 0) av <int> ..FV.....T. shift alpha vertically (from -255 to 255) (default 0) edge <int> ..FV.....T. set edge operation (from 0 to 1) (default smear) smear 0 ..FV.....T. wrap 1 ..FV.....T. If I understand correctly, 'T' indicates that the option can be set at the video filter level and over time, meaning the value can dynamically change based on the time in a video sequence. In other words, I can change the offset value of each color channel over time. The simple command below works perfectly: ffmpeg -i input.mp4 -vf "rgbashift=rh=20:bh=-20" -pix_fmt yuv420p output.mp4 However, as soon as I integrate the 'T' parameter into the offset value, I get error messages. For example: ffmpeg -i input.mp4 -vf "rgbashift=rh='t*2':bh='t*-2'" -pix_fmt yuv420p output.mp4 Error message: Undefined constant or missing '(' in 't*2' Unable to parse option value "t*2" Error applying option 'rh' to filter 'rgbashift': Invalid argument Do I have a misunderstanding of the documentation (ffmpeg -h filter=rgbashift) ? Or do I have a syntax problem somewhere? Thank you very much.

2 3

FFMPEG filter_complex overlays work well on windows but generates error on Linux and OSX
by Suraj Kadam 22 Dec '23

22 Dec '23

So, I am applying multiple overlays on a video using FFMPEG, on windows it always works fine for every size and number of overlays, but in case of MAC or Linux, it generates error for reinitializing filters. Let's say I have a video of 190MB, and about 182 overlay PNGs which will be overlayed using filter_complex. for (let i = 0; i < pngPaths.length; i++) { const start = Number(transcriptions[i].start).toFixed(2); const end = Number(transcriptions[i].end).toFixed(2); const overlayX = '0'; const overlayY = `0`; filterComplex += `[${ i + 1 }:v] overlay=${overlayX}:${overlayY}:enable='between(t,${start},${end})'`; if (i < pngPaths.length - 1) { filterComplex += '[vout];[vout]'; } } I am creating a filter_complex using above function. And then running FFMPEG command like this: const outputPath = path.join(__dirname, '..') + `/projects/${project.originalVideoFile}-output.mp4`; this.appGateway.sendProgress(JSON.stringify(userId), 'progress', 0); return new Promise((resolve, reject) => { const ffmpegCommand = ffmpeg(); // Add video input ffmpegCommand.input(videoPath); // Add PNG inputs for (const pngPath of pngPaths) { ffmpegCommand.input(pngPath); } if (project?.user?.subscription?.plan?.id === 1) { ffmpegCommand.input('watermark.png'); } ffmpegCommand .complexFilter(filterComplex) .outputOptions('-c:v', 'libx264') .output(outputPath) .on('progress', (progress) => { this.appGateway.sendProgress( JSON.stringify(userId), 'progress', Math.round(progress.percent), ); }) .on('end', async () => { "You can ignore the socket emmisions" This works will on windows. But when processing on OSX or Linux, it gives the following error: Stream #95:0 (png) -> overlay (graph 0) Stream #96:0 (png) -> overlay (graph 0) Stream #97:0 (png) -> overlay (graph 0) Stream #98:0 (png) -> overlay (graph 0) Stream #99:0 (png) -> overlay (graph 0) Stream #100:0 (png) -> overlay (graph 0) Stream #101:0 (png) -> overlay (graph 0) Stream #102:0 (png) -> overlay (graph 0) Stream #103:0 (png) -> overlay (graph 0) Stream #104:0 (png) -> overlay (graph 0) Stream #105:0 (png) -> overlay (graph 0) Stream #106:0 (png) -> overlay (graph 0) Stream #107:0 (png) -> overlay (graph 0) Stream #108:0 (png) -> overlay (graph 0) Stream #109:0 (png) -> overlay (graph 0) Stream #110:0 (png) -> overlay (graph 0) Stream #111:0 (png) -> overlay (graph 0) Stream #112:0 (png) -> overlay (graph 0) Stream #113:0 (png) -> overlay (graph 0) Stream #114:0 (png) -> overlay (graph 0) Stream #115:0 (png) -> overlay (graph 0) Stream #116:0 (png) -> overlay (graph 0) Stream #117:0 (png) -> overlay (graph 0) Stream #118:0 (png) -> overlay (graph 0) Stream #119:0 (png) -> overlay (graph 0) Stream #120:0 (png) -> overlay (graph 0) Stream #121:0 (png) -> overlay (graph 0) Stream #122:0 (png) -> overlay (graph 0) Stream #123:0 (png) -> overlay (graph 0) Stream #124:0 (png) -> overlay (graph 0) Stream #125:0 (png) -> overlay (graph 0) Stream #126:0 (png) -> overlay (graph 0) Stream #127:0 (png) -> overlay (graph 0) Stream #128:0 (png) -> overlay (graph 0) Stream #129:0 (png) -> overlay (graph 0) Stream #130:0 (png) -> overlay (graph 0) Stream #131:0 (png) -> overlay (graph 0) Stream #132:0 (png) -> overlay (graph 0) Stream #133:0 (png) -> overlay (graph 0) Stream #134:0 (png) -> overlay (graph 0) Stream #135:0 (png) -> overlay (graph 0) Stream #136:0 (png) -> overlay (graph 0) Stream #137:0 (png) -> overlay (graph 0) Stream #138:0 (png) -> overlay (graph 0) Stream #139:0 (png) -> overlay (graph 0) Stream #140:0 (png) -> overlay (graph 0) Stream #141:0 (png) -> overlay (graph 0) Stream #142:0 (png) -> overlay (graph 0) Stream #143:0 (png) -> overlay (graph 0) Stream #144:0 (png) -> overlay (graph 0) Stream #145:0 (png) -> overlay (graph 0) Stream #146:0 (png) -> overlay (graph 0) Stream #147:0 (png) -> overlay (graph 0) Stream #148:0 (png) -> overlay (graph 0) Stream #149:0 (png) -> overlay (graph 0) Stream #150:0 (png) -> overlay (graph 0) Stream #151:0 (png) -> overlay (graph 0) Stream #152:0 (png) -> overlay (graph 0) Stream #153:0 (png) -> overlay (graph 0) Stream #154:0 (png) -> overlay (graph 0) Stream #155:0 (png) -> overlay (graph 0) Stream #156:0 (png) -> overlay (graph 0) Stream #157:0 (png) -> overlay (graph 0) Stream #158:0 (png) -> overlay (graph 0) Stream #159:0 (png) -> overlay (graph 0) Stream #160:0 (png) -> overlay (graph 0) Stream #161:0 (png) -> overlay (graph 0) Stream #162:0 (png) -> overlay (graph 0) Stream #163:0 (png) -> overlay (graph 0) Stream #164:0 (png) -> overlay (graph 0) Stream #165:0 (png) -> overlay (graph 0) Stream #166:0 (png) -> overlay (graph 0) Stream #167:0 (png) -> overlay (graph 0) Stream #168:0 (png) -> overlay (graph 0) Stream #169:0 (png) -> overlay (graph 0) Stream #170:0 (png) -> overlay (graph 0) Stream #171:0 (png) -> overlay (graph 0) Stream #172:0 (png) -> overlay (graph 0) Stream #173:0 (png) -> overlay (graph 0) Stream #174:0 (png) -> overlay (graph 0) Stream #175:0 (png) -> overlay (graph 0) Stream #176:0 (png) -> overlay (graph 0) Stream #177:0 (png) -> overlay (graph 0) Stream #178:0 (png) -> overlay (graph 0) Stream #179:0 (png) -> overlay (graph 0) Stream #180:0 (png) -> overlay (graph 0) Stream #181:0 (png) -> overlay (graph 0) Stream #182:0 (png) -> overlay (graph 0) overlay:default (graph 0) -> Stream #0:0 (libx264) Stream #0:1 -> #0:1 (aac (native) -> aac (native)) Press [q] to stop, [?] for help [auto_scale_47 @ 0x60000182bbd0] Failed to configure output pad on auto_scale_47 Error reinitializing filters! Failed to inject frame into filter network: Resource temporarily unavailable Error while processing the decoded data for stream #182:0 [aac @ 0x13c063f40] Qavg: 325.486 [aac @ 0x13c063f40] 2 frames left in the queue on closing Conversion failed! /Users/surajkadam/Desktop/12/subtitleo-server/node_modules/fluent-ffmpeg/lib/processor.js:182 handleExit(new Error('ffmpeg exited with code ' + code)); ^ Error: ffmpeg exited with code 1: Conversion failed! at ChildProcess.<anonymous> (/Users/surajkadam/Desktop/12/subtitleo-server/node_modules/fluent-ffmpeg/lib/processor.js:182:22) at ChildProcess.emit (node:events:513:28) at Process.ChildProcess._handle.onexit (node:internal/child_process:291:12) I am generating inputs dynamically using node-canvas, those are typically same (i.e a PNG). This is how we are generating PNG from a canvas: const buffer = canvas.toBuffer('image/png'); , so as for other videos its parsing only foe heavy videos, like the one I am using, it's giving the error. It also says Failed to configure output pad on auto_scale_47 Error reinitializing filters! Failed to inject frame into filter network: Resource temporarily unavailable. It maybe a permission or limit issue? How can I allow FFMPEG to use all permissions? in MAC and Linux.

2 1

Loss of audio frames when adding watermark using ffmpeg
by Venkata Satya Vara Prasad Musunuru 22 Dec '23

22 Dec '23

Hi, Following is the sample watermark command D:/test/ffmpeg.exe -i D:/test/index-720p194.ts -i D:/test/watermark.png -filter_complex "[1][0]scale2ref=w='iw*40/100':h='ow/mdar'[wm][vid];[vid][wm]overlay=(main_w-overlay_w)/2:(main_h-overlay_h)/2" -preset fast -codec:v libx264 -c:a aac -s:v 1280x720 -b:v 1500k -maxrate:v 1500k -bufsize:v 750k -copyts -y D:/test/tmp-index-720p194.ts This command is working and I can see watermark overlayed. But this is causing loss of audio Can you suggest what arguments I need to pass so that I will not loose audio frames and regenerate correct timestamps When I run this fragment using hls.js I get following error Audio frame @ 582.005s overlaps nextAudioPts by -46 ms. Thanks Vara Prasad

1 0

Calculating VMAF of two mkv format videos.
by Aditya Dandavate 22 Dec '23

22 Dec '23

I was trying to calculate VMAF of two mkv videos. One is lossless and second is lossy. I tried to gave this command : ffmpeg -i outputvideo.mkv -i lossless.mkv -lavfi libvmaf=log_path=output.xml -f null - But it didn't work. So, how can I calculate the VMAF scores of two mkv videos ? Can anyone please help me with this ? Thank you. 🙏

4 8

Smooth animation with rgbashift
by emmanuel martin 21 Dec '23

21 Dec '23

I want to evolve the values of the rgbashift command over time with a sine wave. I started with the following code : ffmpeg -loop 1 -i picture.jpg -vf "rgbashift=rh=20*sin(PI*2*t/5):bh=-20*sin(PI*2*t/5)" -pix_fmt yuv420p -t 5 output.mp4 which returns an error. I checked the documentation using the command -h filter=rgbashift, and it seems that T is allowed as a value through the "enable" option. So, I modified the code: ffmpeg -loop 1 -i participant1.jpg -vf "rgbashift=rh='20*sin(PI*2*t/5)':bh='-20*sin(PI*2*t/5)',enable='between(t,0,5)'" -pix_fmt yuv420p -t 5 output.mp4 But I still encounter an error. Is it possible to have T in the rh and bh value parameters to smoothly animate the shift (from what I understand from the documentation, it seems possible)? Or is it just to make the effect appear at certain moments of the timeline like here: ffmpeg -loop 1 -i picture.jpg -vf "rgbashift=rh=20:bh=-20:enable='between(t,1,3)+between(t,4,4.5)+between(t,8,9)',random" -pix_fmt yuv420p -t 5 outputrgb.mp4

1 0

Connecting to NVR RTSP streams
by Mike 20 Dec '23

20 Dec '23

Folks, I have been playing around trying to find a better way to access a NVR which I own. The official method is a web page with some shonkly JAVAscript and a UX that was desigend by someone who, presumably, had a sideline in BDSM. The video is accessed over RTSP via a shonky client written in M$ Silverlight. I am attempting to write my own client to avoid having to keep an ancient version of Internet Exploder running and because I enjoy <s>pain</> a challenge. From what I can see, the video works over something that looks like but isn't entirely RTSP. Here's a packet trace: DESCRIBE rtsp://192.168.0.87/live.001 RTSP/1.0 CSeq: 1 Accept: application/sdp, application/rtsl Authorization: 0805459323-01-16 .RTSP/1.0 200 OK CSeq: 1 Date: 03/25/21 10:54:18 Content-Length: 88 Content-Type: text/parameters v=0 i=camera_name:CAM 01 i=ptz_protocol:NONE m=video 0 TCP RTP/AVP 95 H.264 704_480 .SETUP rtsp://192.168.0.87/live.001 RTSP/1.0 CSeq: 2 Transport: RTP/AVP/TCP;unicast Authorization: 0805459323-01-16 .RTSP/1.0 200 OK CSeq: 2 Date: 03/25/21 10:54:18 Session: 337 Transport: RTP/AVP/TCP;unicast;server_port=4522 .PLAY rtsp://192.168.0.87/live.001 RTSP/1.0 CSeq: 3 Session: 337 Range: clock=20210325T105405- Speed: +1.0 Bandwidth: 2048 Authorization: 0805459323-01-16 .RTSP/1.0 200 OK CSeq: 3 Date: 03/25/21 10:54:18 .TEARDOWN rtsp://192.168.0.87/live.001 RTSP/1.0 CSeq: 4 Session: 337 Authorization: 0805459323-01-16 .RTSP/1.0 200 OK CSeq: 4 Date: 03/25/21 10:54:25 The first issue appears to be dealing with the Authorization header. The "0805459323-01-16" auth string is something given to the broswer over a seperate command and control service. Giving rise to my first question: If I have the string, can I somehow configure FFMPEG to send the auth header? A google suggested that -header can be used but this did not work for me. Question two is similar: can one configurate FFMPEG to send the RANGE header? Google seems to suggest not but I thought I'd ask if anyone knew something Google didn't. Question three: If not, can one write my own RTSP client to handle the command and control and then point FFMPEG to the RTP port to handle playing the video? Question 4: If I sound completely nuts, is there a more sensible way to be going about this? Thanks in advance, Mike.

1 0

Calculating VMAF of single videos.
by Aditya Dandavate 20 Dec '23

20 Dec '23

I viddump videos with help of FFMPEG through `Video Capture Encoding Settings` of DSDA-Doom. A demo (also called LMP, from the lump file extension) is any recording of a game session that can be played back using the game engine. Internally, it is a sequence of tic commands, keeping track of just the input control states during each frame. Thus, a demo is much more compact than a video capture, or even than a recording of the states of all objects in the level. People record demos with help of DSDA-Doom source port. These demos are stored in .lmp file format. These can be converted to videos for doing normal things, like uploading to Youtube etc. When I give command : ffmpeg -timedemo nameofdemo -viddump video.mp4 It orders DSDA-Doom to playback the demos. The video and sound are encoded as the demo is played, so the process can be slow even on a fast computer. The problem is 'I don't have any source material, i.e rawvideo etc'. So, how to calculate VMAF of a single video ?

3 5

FFmpeg default processing(invisible processing)
by 大石脩斗 20 Dec '23

20 Dec '23

I'm trying to use ffmpeg to generate an MXF file that can be played on an XDCAM XDS-PD2000. Please tell me what default processing is performed in ffmpeg when no options are entered. [background] Sony's check tool outputs an error saying "MXF metadata contains non-standard values". The data output by the editing machine is OK with the check tool, The data generated with ffmpeg will be rejected by the check tool. The metadata looks the same for both. Please let me know if you are processing anything other than the meta information that is being output 【Data output by editing machine」 aftertext.txt 【Data output by ffmpeg】 testffmpeg.txt commondlie ffmpeg.exe -i input\base.MXF -c:v mpeg2video -r 29.97 -pix_fmt yuv422p -aspect 16:9 -flags +ildct+ilme -b:v 50000000 -minrate 50000000 -maxrate 50000000 -bufsize 17825792 -bf 2 -metadata creation_time=now -video_format component -g 15 -timecode 00:59:45:00 -ac 1 -map 0:0 -map 0:1 -map 0:1 -map 0:1 -map 0:1 -map 0:1 -map 0:1 -map 0:1 -map 0:1 -c:a pcm_s24le -ar 48000 -f mxf -y output/output_test.mxf Shuto

5 9

kmsgrab and audio problem
by KoreanFanOfficial 20 Dec '23

20 Dec '23

Cant record desktop video and audio with kmsgrab and pulseaudio/alsa on debian/arch system with xorg. I got video without audio or ffmpeg fail to record. If record only video with kmsgrab all works. How i can record video and audio with kmsgrab and alsa/pulseaudio?

5 9

Displacement map - glass effect
by emmanuel martin 19 Dec '23

19 Dec '23

Hello, Is there a way to do a displacement map in FFMPEG ? I would like to achieve this glass effect - See attached file. Thank you very much 🙏 Emmanuel

2 2