April 2025 - ffmpeg-user - lists.ffmpeg.org

Help regard ffmpeg xfade transitions
by Abdullah Qasim 05 Apr '25

05 Apr '25

I have around 10 pictures and 12 texts in a video that I want to create using ffmpeg in nodejs. I am testing the commands and get an issue. I want to animate them using xfade transitions means that text and shapes appear with some transitions. Those transitions must run at the same time. The issue I am facing is that they runs at different time, the first runs, then second and so on. Here is the command: ffmpeg -loop 1 -t 3 -i "bg shape.png" -loop 1 -t 2 -i "grey shape.png" -filter_complex "[0][1]overlay=0:680[ol];[0][ol]xfade=transition=dissolve:offset=1:duration=1[t3];[t3]drawtext=text='Hello':fontsize=100:x=100:y=100[tt];[t3][tt]xfade=transition=dissolve:offset=1:duration=1" -y output.mp4 Here is the video generated. https://media-hosting.imagekit.io/23ed6f2ef884474c/output.mp4?Expires=18384… I am expecting the transitions to run at the same time.

2 1

Subtitle Timing: Clock Timestamps vs. Frame Timestamps
by jeremie bergeron 04 Apr '25

04 Apr '25

Hi, This is not strictly an FFmpeg question but rather a general video processing question regarding when subtitles should be rendered. In this discussion, we are debating whether subtitles should be displayed based on *clock timestamps* or *frame timestamps (PTS)*. Let's say I have a video with those timestamps: - Frame 0: 0 ms - Frame 1: 42 ms - Frame 2: 83 ms - Frame 3: 125 ms - Frame 4: 167 ms - Frame 5: 209 ms - Frame 6: 250 ms - Frame 7: 292 ms - Frame 8: 334 ms - Frame 9: 375 ms - Frame 10: 417 ms - Frame 11: 459 ms - Frame 12: 500 ms - Frame 13: 542 ms - Frame 14: 584 ms - Frame 15: 626 ms - Frame 16: 667 ms - Frame 17: 709 ms - Frame 18: 751 ms - Frame 19: 792 ms - Frame 20: 834 ms - Frame 21: 876 ms Now, let's consider a subtitle that starts at *400 ms* and ends at *860 ms*. - Using frame timestamps (PTS): The subtitle would align with Frame 10 (417 ms) to Frame 20 (834 ms). - Using clock timestamps: The subtitle would attempt to display exactly at 400 ms. However, since Frame 9 covers the interval [375 ms, 417 ms[, the subtitle would effectively appear in the middle of Frame 9 rather than at the start of a frame. Given this discrepancy, which method should be used for accurate subtitle rendering? Should we prioritize aligning with frame timestamps (PTS), or should subtitles be placed at the exact clock timestamps, even if that means appearing mid-frame? Also, does it depend on the subtitle format? I need this information to try to convince the developer of Media3 in this issue <https://github.com/androidx/media/issues/2289>.

2 3

How can I burn-in the timestamp from AVCHD/MTS video?
by Jesse Gordon 04 Apr '25

04 Apr '25

Good Day, I got an older Sony handycam that makes 00000.MTS type files. It does record the date and time in them, which it can optionally display during playback. And ffplay also displays the correct date and time as a text overlay while vlc does not and youtube does not show the timestamp. I would like to simply burn in the timestamps to each frame so the date and time shows on youtube. I tried this: ffmpeg -i 00000.MTS -vf "drawtext=fontsize=60:fontcolor=black:text='%{pts\:gmtime}':x=(w-text_w):y=(h-text_h)" -acodec mp3 -y output.mp4 And that almost works, but it starts the date at "1970-01-01 00:00:00" and counts up. Below is a couple of frames from ffprobe -- the first 117 output lines from ffprobe -show_frames 00000.MTS I know ffmpeg can do this because ffplay displays it correctly. I just cannot for the life of me figure out how to make it burn it into the frame images! I notice that timecode is always 00:00:00:00 in the output of ffprobe: [TIMECODE] value=00:00:00:00 [/TIMECODE] And in: TAG:timecode=00:00:00:00 Those fields are always the same. Thank you very much for any ideas for me to try! ~Jesse [SUBTITLE] media_type=subtitle pts=1016689 pts_time=1.016689 format=0 start_display_time=0 end_display_time=4294967295 num_rects=1 [/SUBTITLE] [FRAME] media_type=audio stream_index=1 key_frame=1 pkt_pts=91502 pkt_pts_time=1.016689 pkt_dts=91502 pkt_dts_time=1.016689 best_effort_timestamp=91502 best_effort_timestamp_time=1.016689 pkt_duration=2880 pkt_duration_time=0.032000 pkt_pos=59520 pkt_size=1024 sample_fmt=fltp nb_samples=1536 channels=2 channel_layout=stereo [SIDE_DATA] side_data_type=AVMatrixEncoding [/SIDE_DATA] [SIDE_DATA] side_data_type=Metadata relevant to a downmix procedure [/SIDE_DATA] [/FRAME] [FRAME] media_type=video stream_index=0 key_frame=1 pkt_pts=91502 pkt_pts_time=1.016689 pkt_dts=91501 pkt_dts_time=1.016678 best_effort_timestamp=91502 best_effort_timestamp_time=1.016689 pkt_duration=1501 pkt_duration_time=0.016678 pkt_pos=768 pkt_size=214628 width=1920 height=1080 pix_fmt=yuv420p sample_aspect_ratio=1:1 pict_type=I coded_picture_number=0 display_picture_number=0 interlaced_frame=0 top_field_first=0 repeat_pict=0 color_range=unknown color_space=unknown color_primaries=unknown color_transfer=unknown chroma_location=left TAG:timecode=00:00:00:00 [SIDE_DATA] side_data_type=H.26[45] User Data Unregistered SEI message [/SIDE_DATA] [SIDE_DATA] side_data_type=H.26[45] User Data Unregistered SEI message [/SIDE_DATA] [SIDE_DATA] side_data_type=H.26[45] User Data Unregistered SEI message [/SIDE_DATA] [SIDE_DATA] side_data_type=SMPTE 12-1 timecode [TIMECODE] value=00:00:00:00 [/TIMECODE] [/SIDE_DATA] [/FRAME] [FRAME] media_type=video stream_index=0 key_frame=0 pkt_pts=93003 pkt_pts_time=1.033367 pkt_dts=93003 pkt_dts_time=1.033367 best_effort_timestamp=93003 best_effort_timestamp_time=1.033367 pkt_duration=1501 pkt_duration_time=0.016678 pkt_pos=232320 pkt_size=30575 width=1920 height=1080 pix_fmt=yuv420p sample_aspect_ratio=1:1 pict_type=P coded_picture_number=1 display_picture_number=0 interlaced_frame=0 top_field_first=0 repeat_pict=0 color_range=unknown color_space=unknown color_primaries=unknown color_transfer=unknown chroma_location=left TAG:timecode=00:00:00:00 [SIDE_DATA] side_data_type=SMPTE 12-1 timecode [TIMECODE] value=00:00:00:00 [/TIMECODE] [/SIDE_DATA] [/FRAME]

3 5

Re: [FFmpeg-user] [Cin] "Competitors" or do we want to stay alive?
by Andrew Randrianasulu 04 Apr '25

04 Apr '25

пт, 4 апр. 2025 г., 18:32 Phyllis Smith <phylsmith2017(a)gmail.com>: > Yes, thanks for a good summary. I think Cinelerra has its place and still > serves as a learning tool also.. > If the Olive NLE Matt had corroborated with CinGG, he would have been > welcome and could have made major changes to update it instead of trying to > write from scratch. > https://github.com/olive-editor/olive/issues/2383 lets see ...... > > On Fri, Apr 4, 2025 at 4:06 AM Andrew Randrianasulu via Cin < > cin(a)lists.cinelerra-gg.org> wrote: > >> Sorry for being frustrated lately. >> >> Realities of all this "modern development" vs me tend to be not in favor >> of our project. >> >> I looked up two "other" projects in video editing. >> >> MLT is well-known and going on for nearly two decades. >> >> In this year release notes we see: >> >> https://github.com/mltframework/mlt/releases >> >> >> ===== >> >> https://github.com/mltframework/mlt/releases/tag/v7.30.0 >> >> >> Added support for mlt_image_yuv420p10, mlt_image_yuv444p10, and >> mlt_image_yuv422p16 in avfilter, swscale, and rescale filters. >> This facilitates using these pixel formats end-to-end when using only >> FFmpeg producers, certain avfilters, and avformat consumer. This means >> it is possible to do 10-bit end-to-end on the CPU when being careful to >> select compatible components and options to avoid conversions. One can >> pass-through HDR; however, you must set the color_trc and pix_fmt >> properties on the avformat consumer (see ffmpeg -h full for these >> values). The avformat consumer automatically converts MLT colorspace >> (integer value) to FFmpeg's colorspace and color_primaries (unless >> explicit) options. >> >> ==== >> >> I take this as "floating point pipeline still not here". >> >> Olive branch is even more depressing: >> >> https://github.com/olive-editor/olive/issues >> >> Last non-CI commit was in ... september 2023? >> >> May be developing moved somewhere, but this mean all exiting new bugs and >> state of being incomplete for few more years, given that even with most of >> hard work done by OpenGL, OCIO, ffmpeg etc remaining NLE core is not that >> simple, as it turned out to be. >> >> Natron does not do audio, as far as I know, and also hanging on a thread >> (single developer). >> >> Blender is a Big Shot now, with predictably big requirements both in >> software (try to build it on Slackware) and in hardware. Driven by higher >> end! >> >> And whole "Oh lol X is deprecated, everyone rewrite themselves to >> Wayland" push. I bet there might be way to resistance say Intel's or >> Nvidia "HDR on X" proposals in Xwayland but who will do all this work for >> single application? It took Valve's money effectively to get anything at >> all done in this area. >> >> https://www.phoronix.com/news/X11-DeepColor-Visual-RFC >> >> from 2017 .... >> >> >> https://lists.freedesktop.org/archives/wayland-devel/2017-December/036403.h… >> >> It took whole 8 years to get into "usable in mpv" state, and producing >> video usually have higher demands than playing back. >> >> I am fairly sure someone will write something in Rust (so it will break >> in 6 months time because Rust is for Big D Developers who have no problems >> with such churn) or c++ 25 because c+11 is too archaic and all new courses >> are about $latest (double meaning of $ here). >> >> Again, I do not think this is only individual developers fault, just more >> complex issue with constant stream of *new* hardware we supposed to fix in >> field by writing software, somehow (HDR displays are all or nothing, so >> HD(R), SD and GUI all must be mixed on host side). And general "culture" of >> individualism (because Silicon Valley, bebe!) and effectively social >> darwinism (where are XDTV and libquicktime? killed by constant API churn >> ....). >> >> I see no escape from this, at larger scale. And this makes me even more >> frustrated. >> >> cc ffmpeg-user/libav user because otherwise no one from "outside" will >> ever read this. >> -- >> Cin mailing list >> Cin(a)lists.cinelerra-gg.org >> https://lists.cinelerra-gg.org/mailman/listinfo/cin >> >

1 0

"Competitors" or do we want to stay alive?
by Andrew Randrianasulu 04 Apr '25

04 Apr '25

Sorry for being frustrated lately. Realities of all this "modern development" vs me tend to be not in favor of our project. I looked up two "other" projects in video editing. MLT is well-known and going on for nearly two decades. In this year release notes we see: https://github.com/mltframework/mlt/releases ===== https://github.com/mltframework/mlt/releases/tag/v7.30.0 Added support for mlt_image_yuv420p10, mlt_image_yuv444p10, and mlt_image_yuv422p16 in avfilter, swscale, and rescale filters. This facilitates using these pixel formats end-to-end when using only FFmpeg producers, certain avfilters, and avformat consumer. This means it is possible to do 10-bit end-to-end on the CPU when being careful to select compatible components and options to avoid conversions. One can pass-through HDR; however, you must set the color_trc and pix_fmt properties on the avformat consumer (see ffmpeg -h full for these values). The avformat consumer automatically converts MLT colorspace (integer value) to FFmpeg's colorspace and color_primaries (unless explicit) options. ==== I take this as "floating point pipeline still not here". Olive branch is even more depressing: https://github.com/olive-editor/olive/issues Last non-CI commit was in ... september 2023? May be developing moved somewhere, but this mean all exiting new bugs and state of being incomplete for few more years, given that even with most of hard work done by OpenGL, OCIO, ffmpeg etc remaining NLE core is not that simple, as it turned out to be. Natron does not do audio, as far as I know, and also hanging on a thread (single developer). Blender is a Big Shot now, with predictably big requirements both in software (try to build it on Slackware) and in hardware. Driven by higher end! And whole "Oh lol X is deprecated, everyone rewrite themselves to Wayland" push. I bet there might be way to resistance say Intel's or Nvidia "HDR on X" proposals in Xwayland but who will do all this work for single application? It took Valve's money effectively to get anything at all done in this area. https://www.phoronix.com/news/X11-DeepColor-Visual-RFC from 2017 .... https://lists.freedesktop.org/archives/wayland-devel/2017-December/036403.h… It took whole 8 years to get into "usable in mpv" state, and producing video usually have higher demands than playing back. I am fairly sure someone will write something in Rust (so it will break in 6 months time because Rust is for Big D Developers who have no problems with such churn) or c++ 25 because c+11 is too archaic and all new courses are about $latest (double meaning of $ here). Again, I do not think this is only individual developers fault, just more complex issue with constant stream of *new* hardware we supposed to fix in field by writing software, somehow (HDR displays are all or nothing, so HD(R), SD and GUI all must be mixed on host side). And general "culture" of individualism (because Silicon Valley, bebe!) and effectively social darwinism (where are XDTV and libquicktime? killed by constant API churn ....). I see no escape from this, at larger scale. And this makes me even more frustrated. cc ffmpeg-user/libav user because otherwise no one from "outside" will ever read this.

2 1

Lossless JPEG encoding
by Gianluca Cannata 03 Apr '25

03 Apr '25

What is the right command to produce a Lossless JPEG file ? magick wizard: ppm:- | ffmpeg -v trace -i - -map 0:v -c:v ljpeg -b:v 1M -pred median -f mjpeg -y wizard.jpg ffmpeg version N-119135-g1722f08acf Copyright (c) 2000-2025 the FFmpeg developers built with gcc 11 (Ubuntu 11.4.0-1ubuntu1~22.04) configuration: --prefix=/usr --disable-static --enable-shared --enable-gpl --enable-version3 --disable-doc --disable-avdevice --enable-swresample --disable-swscale --disable-postproc --disable-network --disable-everything --enable-protocol='fd, file, subfile, pipe' --enable-demuxer='image_jpeg_pipe, mjpeg, mpjpeg, smjpeg, image_ppm_pipe' --enable-muxer='mjpeg, mpjpeg, smjpeg' --enable-decoder='mjpeg, ppm' --enable-encoder='ljpeg, mjpeg, ppm' --disable-ffplay libavutil 60. 0.100 / 60. 0.100 libavcodec 62. 0.101 / 62. 0.101 libavformat 62. 0.100 / 62. 0.100 libavfilter 11. 0.100 / 11. 0.100 libswresample 6. 0.100 / 6. 0.100 Splitting the commandline. Reading option '-v' ... matched as option 'v' (set logging level) with argument 'trace'. Reading option '-i' ... matched as input url with argument '-'. Reading option '-map' ... matched as option 'map' (set input stream mapping) with argument '0:v'. Reading option '-c:v' ... matched as option 'c' (select encoder/decoder ('copy' to copy stream without reencoding)) with argument 'ljpeg'. Reading option '-b:v' ... matched as option 'b' (video bitrate (please use -b:v)) with argument '1M'. Reading option '-pred' ... matched as AVOption 'pred' with argument 'median'. Reading option '-f' ... matched as option 'f' (force container format (auto-detected otherwise)) with argument 'mjpeg'. Reading option '-y' ... matched as option 'y' (overwrite output files) with argument '1'. Reading option 'wizard.jpg' ... matched as output url. Finished splitting the commandline. Parsing a group of options: global . Applying option v (set logging level) with argument trace. Applying option y (overwrite output files) with argument 1. Successfully parsed a group of options. Parsing a group of options: input url -. Successfully parsed a group of options. Opening an input file: -. [AVFormatContext @ 0x5ea397c38a40] Opening 'fd:' for reading [fd @ 0x5ea397c39200] Setting default whitelist 'crypto,data' Probing ppm_pipe score:52 size:2048 [ppm_pipe @ 0x5ea397c38a40] Format ppm_pipe probed with size=2048 and score=52 [ppm_pipe @ 0x5ea397c38a40] Before avformat_find_stream_info() pos: 0 bytes read:16384 seeks:0 nb_streams:1 [ppm_pipe @ 0x5ea397c38a40] parser not found for codec ppm, packets or times may be invalid. [ppm_pipe @ 0x5ea397c38a40] stream 0: start_time: NOPTS duration: NOPTS [ppm_pipe @ 0x5ea397c38a40] format: start_time: NOPTS duration: NOPTS (estimate from bit rate) bitrate=0 kb/s [ppm_pipe @ 0x5ea397c38a40] Could not find codec parameters for stream 0 (Video: ppm, 1 reference frame, none): unspecified size Consider increasing the value for the 'analyzeduration' (0) and 'probesize' (5000000) options [ppm_pipe @ 0x5ea397c38a40] After avformat_find_stream_info() pos: 0 bytes read:16384 seeks:0 frames:0 Input #0, ppm_pipe, from 'fd:': Duration: N/A, bitrate: N/A Stream #0:0, 0, 1/25: Video: ppm, 1 reference frame, none, 25 fps, 25 tbr, 25 tbn Successfully opened the file. Parsing a group of options: output url wizard.jpg. Applying option map (set input stream mapping) with argument 0:v. Parsing stream specifier: v Parsed media type: video; remainder: Applying option c:v (select encoder/decoder ('copy' to copy stream without reencoding)) with argument ljpeg. Parsing stream specifier: v Parsed media type: video; remainder: Applying option b:v (video bitrate (please use -b:v)) with argument 1M. Applying option f (force container format (auto-detected otherwise)) with argument mjpeg. Successfully parsed a group of options. Opening an output file: wizard.jpg. [out#0/mjpeg @ 0x5ea397c3b5c0] Adding streams from explicit maps... [vost#0:0/ljpeg @ 0x5ea397c3c0c0] Created video stream from input stream 0:0 Parsing stream specifier: v Parsed media type: video; remainder: [file @ 0x5ea397c48040] Setting default whitelist 'file,crypto,data' Successfully opened the file. Stream mapping: Stream #0:0 -> #0:0 (ppm (native) -> ljpeg (native)) [vost#0:0/ljpeg @ 0x5ea397c3c0c0] Starting thread... [vf#0:0 @ 0x5ea397c3d680] Starting thread... [vist#0:0/ppm @ 0x5ea397c3ae40] [dec:ppm @ 0x5ea397c43880] Starting thread... [in#0/ppm_pipe @ 0x5ea397c386c0] Starting thread... [in#0/ppm_pipe @ 0x5ea397c386c0] EOF while reading input [in#0/ppm_pipe @ 0x5ea397c386c0] Terminating thread with return code 0 (success) [vist#0:0/ppm @ 0x5ea397c3ae40] [dec:ppm @ 0x5ea397c43880] Decoder thread received EOF packet [vist#0:0/ppm @ 0x5ea397c3ae40] [dec:ppm @ 0x5ea397c43880] Decoder returned EOF, finishing [vist#0:0/ppm @ 0x5ea397c3ae40] [dec:ppm @ 0x5ea397c43880] Terminating thread with return code 0 (success) [vf#0:0 @ 0x5ea397c3d680] Cannot determine format of input 0:0 after EOF [vf#0:0 @ 0x5ea397c3d680] Task finished with error code: -1094995529 (Invalid data found when processing input) [vf#0:0 @ 0x5ea397c3d680] Terminating thread with return code -1094995529 (Invalid data found when processing input) [vost#0:0/ljpeg @ 0x5ea397c3c0c0] [enc:ljpeg @ 0x5ea397c3cb00] Encoder thread received EOF [vost#0:0/ljpeg @ 0x5ea397c3c0c0] [enc:ljpeg @ 0x5ea397c3cb00] Could not open encoder before EOF [vost#0:0/ljpeg @ 0x5ea397c3c0c0] Task finished with error code: -22 (Invalid argument) [vost#0:0/ljpeg @ 0x5ea397c3c0c0] Terminating thread with return code -22 (Invalid argument) [out#0/mjpeg @ 0x5ea397c3b5c0] Nothing was written into output file, because at least one of its streams received no packets. frame= 0 fps=0.0 q=0.0 Lsize= 0KiB time=N/A bitrate=N/A speed=N/A [AVIOContext @ 0x5ea397c47f00] Statistics: 0 bytes written, 0 seeks, 0 writeouts [in#0/ppm_pipe @ 0x5ea397c386c0] Input file #0 (fd:): [in#0/ppm_pipe @ 0x5ea397c386c0] Input stream #0:0 (video): 0 packets read (0 bytes); 0 frames decoded; 0 decode errors; [in#0/ppm_pipe @ 0x5ea397c386c0] Total: 0 packets (0 bytes) demuxed [AVIOContext @ 0x5ea397c495c0] Statistics: 16384 bytes read, 0 seeks Conversion failed! Gianluca

2 1