[FFmpeg-user] Bad performance when using h264_vaapi to encode stream from camera.
Xiang, Haihao
haihao.xiang at intel.com
Wed May 24 02:15:53 EEST 2023
You may run `ffmpeg -filters` to get the supported filter list,
e.g.
$ ffmpeg -filters | grep vaapi
then run `ffmpeg -h filter=xxx` to get the supported options for the given
filter xxx.
e.g.
$ ffmpeg -h filter=scale_vaapi
BRs
Haihao
> Hi,
>
> It helped, thank you very much! I couldn't find much info about additional
> options that can be passed via -f. Do you have any reference for that?
>
> Once again, thank you.
>
> Cheers.
>
> -----Original Message-----
> From: ffmpeg-user <ffmpeg-user-bounces at ffmpeg.org> On Behalf Of Xiang, Haihao
> Sent: Friday, May 19, 2023 6:31 AM
> To: ffmpeg-user at ffmpeg.org
> Subject: Re: [FFmpeg-user] Bad performance when using h264_vaapi to encode
> stream from camera.
>
>
> You may use vaapi to convert yuyv422 to nv12, try -f
> 'hwupload,scale_vaapi=format=nv12' instead of -f 'format=nv12,hwupload'.
>
> BRs
> Haihao
>
> > Hi,
> >
> > Thank you for your answer. Yes it does support 1920x1080 at 30fps. So I
> > guess nothing can be done to speed it up? Assuming 1920x1080 at 30fps stays.
> >
> > Best regards.
> >
> >
> >
> > -----Original Message-----
> > From: ffmpeg-user <ffmpeg-user-bounces at ffmpeg.org> On Behalf Of Xiang,
> > Haihao
> > Sent: Thursday, May 18, 2023 8:16 AM
> > To: ffmpeg-user at ffmpeg.org
> > Subject: Re: [FFmpeg-user] Bad performance when using h264_vaapi to
> > encode stream from camera.
> >
> >
> > Hi,
> >
> > Does your camera support 1920x1080 at 30fps ? Moreover, the output format
> > from your camera is yuyv422, converting yuyv422 to nv12 impacts the
> > performance too.
> >
> > Thanks
> > Haihao
> >
> >
> > > Hello guys,
> > >
> > >
> > >
> > > I am using quite old Intel e3845 processor to do hardware
> > > encoding/decoding via vaapi. It works very well when I test it on
> > > transcoding a h264 1920x1080
> > > 30 fps file:
> > >
> > >
> > >
> > > ffmpeg -vaapi_device /dev/dri/renderD128 -i test_02.mp4 -vf
> > > 'format=nv12,hwupload' -c:v h264_vaapi -profile: high -qp: 42
> > > test_02_01_h264_vaapi.mp4
> > >
> > >
> > >
> > > [out#0/mp4 @ 0x55c058071e40] video:3194kB audio:0kB subtitle:0kB
> > > other streams:0kB global headers:0kB muxing overhead: 0.287536%
> > >
> > > frame= 901 fps= 42 q=-0.0 Lsize= 3203kB time=00:00:29.96
> > > bitrate= 875.5kbits/s speed=1.41x
> > >
> > >
> > >
> > > I would think that it will work as good when encoding camera stream
> > > (or even better because there is no decoding involved). To my
> > > surprise, performance is lousy, it is a fraction of speed in
> > > comparison to transcoding from a
> > > file:
> > >
> > >
> > >
> > > ffmpeg -loglevel debug -vaapi_device /dev/dri/renderD128 -f v4l2
> > > -framerate
> > > 30 -video_size 1920x1080 -i /dev/video2 -vf 'format=nv12,hwupload'
> > > -c:v h264_vaapi -profile: high -qp: 42 output_2_vaapi.mp4
> > >
> > > ffmpeg version N-110363-g2aad9765ef Copyright (c) 2000-2023 the
> > > FFmpeg developers
> > >
> > > built with gcc 12 (Ubuntu 12.2.0-3ubuntu1)
> > >
> > > configuration: --pkg-config-flags=--static --enable-static
> > > --disable-shared --prefix=/home/sicore/ffmpeg_build
> > > --bindir=/home/test/bin --extra-cflags=-I/home/test/bin/include
> > > --extra-ldflags=-L/home/sicore/bin/lib
> > > --extra-cflags=-I/usr/local/include
> > > --extra-ldflags=-L/usr/local/lib --enable-vaapi --disable-debug
> > > --enable-libdrm --enable-gpl --enable-runtime-cpudetect
> > > --enable-libx264 --enable-openssl --enable-pic
> > > --extra-libs='-lpthread -lm - lz -ldl'
> > > --enable-nonfree
> > >
> > > libavutil 58. 6.100 / 58. 6.100
> > >
> > > libavcodec 60. 10.100 / 60. 10.100
> > >
> > > libavformat 60. 5.100 / 60. 5.100
> > >
> > > libavdevice 60. 2.100 / 60. 2.100
> > >
> > > libavfilter 9. 5.100 / 9. 5.100
> > >
> > > libswscale 7. 2.100 / 7. 2.100
> > >
> > > libswresample 4. 11.100 / 4. 11.100
> > >
> > > libpostproc 57. 2.100 / 57. 2.100
> > >
> > > Splitting the commandline.
> > >
> > > Reading option '-loglevel' ... matched as option 'loglevel' (set
> > > logging
> > > level) with argument 'debug'.
> > >
> > > Reading option '-vaapi_device' ... matched as option 'vaapi_device'
> > > (set VAAPI hardware device (DirectX adapter index, DRM path or X11
> > > display name)) with argument '/dev/dri/renderD128'.
> > >
> > > Reading option '-f' ... matched as option 'f' (force format) with
> > > argument 'v4l2'.
> > >
> > > Reading option '-framerate' ... matched as AVOption 'framerate' with
> > > argument '30'.
> > >
> > > Reading option '-video_size' ... matched as AVOption 'video_size'
> > > with argument '1920x1080'.
> > >
> > > Reading option '-i' ... matched as input url with argument '/dev/video2'.
> > >
> > > Reading option '-vf' ... matched as option 'vf' (set video filters)
> > > with argument 'format=nv12,hwupload'.
> > >
> > > Reading option '-c:v' ... matched as option 'c' (codec name) with
> > > argument 'h264_vaapi'.
> > >
> > > Reading option '-profile:' ... matched as option 'profile' (set
> > > profile) with argument 'high'.
> > >
> > > Reading option '-qp:' ... matched as AVOption 'qp:' with argument '42'.
> > >
> > > Reading option 'output_2_vaapi.mp4' ... matched as output url.
> > >
> > > Finished splitting the commandline.
> > >
> > > Parsing a group of options: global .
> > >
> > > Applying option loglevel (set logging level) with argument debug.
> > >
> > > Applying option vaapi_device (set VAAPI hardware device (DirectX
> > > adapter index, DRM path or X11 display name)) with argument
> > > /dev/dri/renderD128.
> > >
> > > [AVHWDeviceContext @ 0x55c91096d7c0] libva: VA-API version 1.16.0
> > >
> > > [AVHWDeviceContext @ 0x55c91096d7c0] libva: User environment
> > > variable requested driver 'i965'
> > >
> > > [AVHWDeviceContext @ 0x55c91096d7c0] libva: Trying to open
> > > /usr/lib/x86_64-linux-gnu/dri/i965_drv_video.so
> > >
> > > [AVHWDeviceContext @ 0x55c91096d7c0] libva: Found init function
> > > __vaDriverInit_1_16
> > >
> > > [AVHWDeviceContext @ 0x55c91096d7c0] libva: va_openDriver() returns
> > > 0
> > >
> > > [AVHWDeviceContext @ 0x55c91096d7c0] Initialised VAAPI connection:
> > > version
> > > 1.16
> > >
> > > [AVHWDeviceContext @ 0x55c91096d7c0] Format 0x32315659 -> yuv420p.
> > >
> > > [AVHWDeviceContext @ 0x55c91096d7c0] Format 0x30323449 -> yuv420p.
> > >
> > > [AVHWDeviceContext @ 0x55c91096d7c0] Format 0x3231564e -> nv12.
> > >
> > > [AVHWDeviceContext @ 0x55c91096d7c0] Format 0x32595559 -> yuyv422.
> > >
> > > [AVHWDeviceContext @ 0x55c91096d7c0] Format 0x59565955 -> uyvy422.
> > >
> > > [AVHWDeviceContext @ 0x55c91096d7c0] Format 0x48323234 -> yuv422p.
> > >
> > > [AVHWDeviceContext @ 0x55c91096d7c0] Format 0x58424752 -> rgb0.
> > >
> > > [AVHWDeviceContext @ 0x55c91096d7c0] Format 0x58524742 -> bgr0.
> > >
> > > [AVHWDeviceContext @ 0x55c91096d7c0] Format 0x30313050 -> p010le.
> > >
> > > [AVHWDeviceContext @ 0x55c91096d7c0] VAAPI driver: Intel i965 driver
> > > for
> > > Intel(R) Bay Trail - 2.4.0.pre1 (2.3.0-35-gab755cb).
> > >
> > > [AVHWDeviceContext @ 0x55c91096d7c0] Driver not found in known
> > > nonstandard list, using standard behaviour.
> > >
> > > Successfully parsed a group of options.
> > >
> > > Parsing a group of options: input url /dev/video2.
> > >
> > > Applying option f (force format) with argument v4l2.
> > >
> > > Successfully parsed a group of options.
> > >
> > > Opening an input file: /dev/video2.
> > >
> > > [video4linux2,v4l2 @ 0x55c91097f300] fd:4 capabilities:84a00001
> > >
> > > [video4linux2,v4l2 @ 0x55c91097f300] Current input_channel: 0, input_name:
> > > Camera, input_std: 0
> > >
> > > [video4linux2,v4l2 @ 0x55c91097f300] The V4L2 driver changed the
> > > pixel format from 0x32315559 to 0x56595559
> > >
> > > [video4linux2,v4l2 @ 0x55c91097f300] Trying to set codec:rawvideo
> > > pix_fmt:yuv420p
> > >
> > > [video4linux2,v4l2 @ 0x55c91097f300] The V4L2 driver changed the
> > > pixel format from 0x32315559 to 0x56595559
> > >
> > > [video4linux2,v4l2 @ 0x55c91097f300] Trying to set codec:rawvideo
> > > pix_fmt:yuv420p
> > >
> > > [video4linux2,v4l2 @ 0x55c91097f300] The V4L2 driver changed the
> > > pixel format from 0x32315659 to 0x56595559
> > >
> > > [video4linux2,v4l2 @ 0x55c91097f300] Trying to set codec:rawvideo
> > > pix_fmt:yuv422p
> > >
> > > [video4linux2,v4l2 @ 0x55c91097f300] The V4L2 driver changed the
> > > pixel format from 0x50323234 to 0x56595559
> > >
> > > [video4linux2,v4l2 @ 0x55c91097f300] Trying to set codec:rawvideo
> > > pix_fmt:yuyv422
> > >
> > > [video4linux2,v4l2 @ 0x55c91097f300] Setting time per frame to 1/30
> > >
> > > [video4linux2,v4l2 @ 0x55c91097f300] All info found
> > >
> > > Input #0, video4linux2,v4l2, from '/dev/video2':
> > >
> > > Duration: N/A, start: 172336.109110, bitrate: 995328 kb/s
> > >
> > > Stream #0:0, 1, 1/1000000: Video: rawvideo, 1 reference frame
> > > (YUY2 / 0x32595559), yuyv422, 1920x1080, 0/1, 995328 kb/s, 30 fps,
> > > 30 tbr, 1000k tbn
> > >
> > > Successfully opened the file.
> > >
> > > Parsing a group of options: output url output_2_vaapi.mp4.
> > >
> > > Applying option vf (set video filters) with argument format=nv12,hwupload.
> > >
> > > Applying option c:v (codec name) with argument h264_vaapi.
> > >
> > > Applying option profile: (set profile) with argument high.
> > >
> > > Successfully parsed a group of options.
> > >
> > > Opening an output file: output_2_vaapi.mp4.
> > >
> > > [file @ 0x55c9109890c0] Setting default whitelist 'file,crypto,data'
> > >
> > > Successfully opened the file.
> > >
> > > Stream mapping:
> > >
> > > Stream #0:0 -> #0:0 (rawvideo (native) -> h264 (h264_vaapi))
> > >
> > > Press [q] to stop, [?] for help
> > >
> > > [vost#0:0/h264_vaapi @ 0x55c910983900] cur_dts is invalid [init:0
> > > i_done:0 finish:0] (this is harmless if it occurs once at the start
> > > per stream)
> > >
> > > [rawvideo @ 0x55c910982240] PACKET SIZE: 4147200, STRIDE: 3840
> > >
> > > [AVFilterGraph @ 0x55c910988340] Setting 'pix_fmts' to value 'nv12'
> > >
> > > detected 4 logical cores
> > >
> > > [graph 0 input from stream 0:0 @ 0x55c91098a480] Setting 'video_size'
> > > to value '1920x1080'
> > >
> > > [graph 0 input from stream 0:0 @ 0x55c91098a480] Setting 'pix_fmt'
> > > to value '1'
> > >
> > > [graph 0 input from stream 0:0 @ 0x55c91098a480] Setting 'time_base'
> > > to value '1/1000000'
> > >
> > > [graph 0 input from stream 0:0 @ 0x55c91098a480] Setting
> > > 'pixel_aspect' to value '0/1'
> > >
> > > [graph 0 input from stream 0:0 @ 0x55c91098a480] Setting 'frame_rate'
> > > to value '30/1'
> > >
> > > [graph 0 input from stream 0:0 @ 0x55c91098a480] w:1920 h:1080
> > > pixfmt:yuyv422 tb:1/1000000 fr:30/1 sar:0/1
> > >
> > > [format @ 0x55c91098b500] Setting 'pix_fmts' to value 'vaapi'
> > >
> > > [auto_scale_0 @ 0x55c91098c980] w:iw h:ih flags:'' interl:0
> > >
> > > [Parsed_format_0 @ 0x55c910989680] auto-inserting filter 'auto_scale_0'
> > > between the filter 'graph 0 input from stream 0:0' and the filter
> > > 'Parsed_format_0'
> > >
> > > [AVFilterGraph @ 0x55c910988340] query_formats: 5 queried, 4 merged,
> > > 1 already done, 0 delayed
> > >
> > > [auto_scale_0 @ 0x55c91098c980] w:1920 h:1080 fmt:yuyv422 sar:0/1 ->
> > > w:1920
> > > h:1080 fmt:nv12 sar:0/1 flags:0x00000004
> > >
> > > [hwupload @ 0x55c910989c00] Surface format is nv12.
> > >
> > > [AVHWFramesContext @ 0x55c910bc3a00] Created surface 0x4000000.
> > >
> > > [AVHWFramesContext @ 0x55c910bc3a00] Direct mapping possible.
> > >
> > > [AVHWFramesContext @ 0x55c910bc3a00] Map surface 0x4000000.
> > >
> > > [AVHWFramesContext @ 0x55c910bc3a00] Unmap surface 0x4000000.
> > >
> > > [h264_vaapi @ 0x55c910983d00] Using input frames context (format
> > > vaapi) with h264_vaapi encoder.
> > >
> > > [h264_vaapi @ 0x55c910983d00] Input surface format is nv12.
> > >
> > > [h264_vaapi @ 0x55c910983d00] Using VAAPI profile VAProfileH264High (7).
> > >
> > > [h264_vaapi @ 0x55c910983d00] Using VAAPI entrypoint
> > > VAEntrypointEncSlice (6).
> > >
> > > [h264_vaapi @ 0x55c910983d00] Using VAAPI render target format YUV420
> > > (0x1).
> > >
> > > [h264_vaapi @ 0x55c910983d00] Driver supports RC modes CQP, CBR, VBR.
> > >
> > > [h264_vaapi @ 0x55c910983d00] RC mode: CQP.
> > >
> > > [h264_vaapi @ 0x55c910983d00] RC quality: 42.
> > >
> > > [h264_vaapi @ 0x55c910983d00] RC framerate: 30/1 (30.00 fps).
> > >
> > > [h264_vaapi @ 0x55c910983d00] Driver does not report any additional
> > > prediction constraints.
> > >
> > > [h264_vaapi @ 0x55c910983d00] Using intra, P- and B-frames
> > > (supported
> > > references: 1 / 1).
> > >
> > > [h264_vaapi @ 0x55c910983d00] All wanted packed headers available
> > > (wanted 0xd, found 0x1f).
> > >
> > > [h264_vaapi @ 0x55c910983d00] Using nv12 as format of reconstructed
> > > frames.
> > >
> > > [AVHWFramesContext @ 0x55c910c1b380] Created surface 0x4000001.
> > >
> > > [AVHWFramesContext @ 0x55c910c1b380] Direct mapping possible.
> > >
> > > [h264_vaapi @ 0x55c910983d00] Using fixed QP = 42 / 42 / 50 for IDR-
> > > /
> > > P- / B-frames.
> > >
> > > [h264_vaapi @ 0x55c910983d00] Using level 4.
> > >
> > > Output #0, mp4, to 'output_2_vaapi.mp4':
> > >
> > > Metadata:
> > >
> > > encoder : Lavf60.5.100
> > >
> > > Stream #0:0, 0, 1/15360: Video: h264 (High), 1 reference frame
> > > (avc1 / 0x31637661), vaapi(tv, progressive), 1920x1080 (0x0), 0/1,
> > > q=2-31,
> > > 30 fps,
> > > 15360 tbn
> > >
> > > Metadata:
> > >
> > > encoder : Lavc60.10.100 h264_vaapi
> > >
> > >
> > >
> > > <some time later>
> > >
> > >
> > >
> > > [out#0/mp4 @ 0x55c91097f800] video:74kB audio:0kB subtitle:0kB other
> > > streams:0kB global headers:0kB muxing overhead: 1.961509%
> > >
> > > frame= 67 fps= 13 q=-0.0 Lsize= 75kB time=00:00:02.16
> > > bitrate= 285.4kbits/s dup=7 drop=0 speed=0.413x
> > >
> > > 60 frames successfully decoded, 0 decoding errors
> > >
> > > [h264_vaapi @ 0x55c910983d00] Freed output buffer 0x8000000
> > >
> > > [in#0/video4linux2,v4l2 @ 0x55c91097f180] Terminating demuxer thread
> > >
> > > [in#0/video4linux2,v4l2 @ 0x55c91097f180] Input file #0 (/dev/video2):
> > >
> > > [in#0/video4linux2,v4l2 @ 0x55c91097f180] Input stream #0:0 (video):
> > > 60 packets read (248832000 bytes); 60 frames decoded;
> > >
> > > [in#0/video4linux2,v4l2 @ 0x55c91097f180] Total: 60 packets
> > > (248832000
> > > bytes) demuxed
> > >
> > >
> > >
> > > As you can see, speed is 0.413, it is almost 4 times slower when
> > > transcoding. Is there something I am doing wrong?
> > >
> > >
> > >
> > > Thanks for any help.
> > >
> > > _______________________________________________
> > > ffmpeg-user mailing list
> > > ffmpeg-user at ffmpeg.org
> > > https://ffmpeg.org/mailman/listinfo/ffmpeg-user
> > >
> > > To unsubscribe, visit link above, or email
> > > ffmpeg-user-request at ffmpeg.org with subject "unsubscribe".
> >
> > _______________________________________________
> > ffmpeg-user mailing list
> > ffmpeg-user at ffmpeg.org
> > https://ffmpeg.org/mailman/listinfo/ffmpeg-user
> >
> > To unsubscribe, visit link above, or email
> > ffmpeg-user-request at ffmpeg.org with subject "unsubscribe".
> >
> > _______________________________________________
> > ffmpeg-user mailing list
> > ffmpeg-user at ffmpeg.org
> > https://ffmpeg.org/mailman/listinfo/ffmpeg-user
> >
> > To unsubscribe, visit link above, or email
> > ffmpeg-user-request at ffmpeg.org with subject "unsubscribe".
>
> _______________________________________________
> ffmpeg-user mailing list
> ffmpeg-user at ffmpeg.org
> https://ffmpeg.org/mailman/listinfo/ffmpeg-user
>
> To unsubscribe, visit link above, or email ffmpeg-user-request at ffmpeg.org with
> subject "unsubscribe".
>
> _______________________________________________
> ffmpeg-user mailing list
> ffmpeg-user at ffmpeg.org
> https://ffmpeg.org/mailman/listinfo/ffmpeg-user
>
> To unsubscribe, visit link above, or email
> ffmpeg-user-request at ffmpeg.org with subject "unsubscribe".
More information about the ffmpeg-user
mailing list