[FFmpeg-trac] #10046(avfilter:new): Vulkan filters failing with "There are no supported modifiers for the given sw_format" message
FFmpeg
trac at avcodec.org
Fri Dec 30 11:26:38 EET 2022
#10046: Vulkan filters failing with "There are no supported modifiers for the given
sw_format" message
-------------------------------------+-------------------------------------
Reporter: Dennis E. | Owner: (none)
Mungai |
Type: defect | Status: new
Priority: normal | Component: avfilter
Version: git-master | Resolution:
Keywords: vulkan | Blocked By:
Blocking: | Reproduced by developer: 0
Analyzed by developer: 0 |
-------------------------------------+-------------------------------------
Comment (by hronek):
Same for me. I cannot make libplacebo work.
command:
{{{
ffmpeg -v verbose -init_hw_device vulkan=vul -i ~/video-test/vertical-
test.mp4 -vf
"hwupload,libplacebo=w=1920:h=1080:format=yuv420p,hwdownload,format=yuv420p"
"/tmp/output.mkv" -y -loglevel debug
}}}
output:
{{{
ffmpeg version 5.1.2 Copyright (c) 2000-2022 the FFmpeg developers
built with gcc 11 (Ubuntu 11.3.0-1ubuntu1~22.04)
configuration: --enable-nonfree --enable-gpl --enable-openssl --enable-
libdav1d --enable-libsvtav1 --enable-libx264 --enable-libx265 --enable-
libvpx --enable-libxvid --enable-libvidstab --enable-libaom --enable-
libzimg --enable-lv2 --enable-libopencore_amrnb --enable-libopencore_amrwb
--enable-libmp3lame --enable-libopus --enable-libvorbis --enable-libtheora
--enable-libfdk-aac --enable-libwebp --enable-libsrt --enable-cuda-nvcc
--enable-cuvid --enable-nvenc --enable-cuda-llvm --enable-libnpp
--nvccflags='-gencode arch=compute_52,code=sm_52' --enable-amf --enable-
opencl --enable-vulkan --enable-libplacebo --disable-debug --disable-doc
--disable-shared --enable-pthreads --enable-static --enable-small
--enable-version3 --extra-cflags='-I/app/workspace/include
-I/app/workspace/include/lilv-0 -I/usr/local/cuda/include' --extra-
ldexeflags= --extra-ldflags='-L/app/workspace/lib -L/usr/local/cuda/lib64'
--extra-libs='-ldl -lpthread -lm -lz'
--pkgconfigdir=/app/workspace/lib/pkgconfig --pkg-config-flags=--static
--prefix=/app/workspace --extra-version=
libavutil 57. 28.100 / 57. 28.100
libavcodec 59. 37.100 / 59. 37.100
libavformat 59. 27.100 / 59. 27.100
libavdevice 59. 7.100 / 59. 7.100
libavfilter 8. 44.100 / 8. 44.100
libswscale 6. 7.100 / 6. 7.100
libswresample 4. 7.100 / 4. 7.100
libpostproc 56. 6.100 / 56. 6.100
Splitting the commandline.
Reading option '-v' ... matched as option 'v' (set logging level) with
argument 'verbose'.
Reading option '-init_hw_device' ... matched as option 'init_hw_device'
(initialise hardware device) with argument 'vulkan=vul'.
Reading option '-i' ... matched as input url with argument '/home/main
/video-test/vertical-test.mp4'.
Reading option '-vf' ... matched as option 'vf' (set video filters) with
argument
'hwupload,libplacebo=w=1920:h=1080:format=yuv420p,hwdownload,format=yuv420p'.
Reading option '/tmp/output.mkv' ... matched as output url.
Reading option '-y' ... matched as option 'y' (overwrite output files)
with argument '1'.
Reading option '-loglevel' ... matched as option 'loglevel' (set logging
level) with argument 'debug'.
Finished splitting the commandline.
Parsing a group of options: global .
Applying option v (set logging level) with argument verbose.
[AVHWDeviceContext @ 0x5627f6c99900] Supported validation layers:
[AVHWDeviceContext @ 0x5627f6c99900] VK_LAYER_MESA_device_select
[AVHWDeviceContext @ 0x5627f6c99900] VK_LAYER_MESA_overlay
[AVHWDeviceContext @ 0x5627f6c99900] VK_LAYER_LUNARG_monitor
[AVHWDeviceContext @ 0x5627f6c99900] VK_LAYER_KHRONOS_validation
[AVHWDeviceContext @ 0x5627f6c99900] VK_LAYER_LUNARG_gfxreconstruct
[AVHWDeviceContext @ 0x5627f6c99900] VK_LAYER_LUNARG_screenshot
[AVHWDeviceContext @ 0x5627f6c99900] VK_LAYER_KHRONOS_profiles
[AVHWDeviceContext @ 0x5627f6c99900] VK_LAYER_LUNARG_api_dump
[AVHWDeviceContext @ 0x5627f6c99900] VK_LAYER_KHRONOS_synchronization2
MESA-INTEL: warning: Haswell Vulkan support is incomplete
[AVHWDeviceContext @ 0x5627f6c99900] GPU listing:
[AVHWDeviceContext @ 0x5627f6c99900] 0: NVIDIA GeForce GTX 1060 6GB
(discrete) (0x1c03)
[AVHWDeviceContext @ 0x5627f6c99900] 1: Intel(R) HD Graphics 4600 (HSW
GT2) (integrated) (0x412)
[AVHWDeviceContext @ 0x5627f6c99900] 2: llvmpipe (LLVM 13.0.1, 256
bits) (software) (0x0)
[AVHWDeviceContext @ 0x5627f6c99900] Device 0 selected: NVIDIA GeForce GTX
1060 6GB (discrete) (0x1c03)
[AVHWDeviceContext @ 0x5627f6c99900] Queue families:
[AVHWDeviceContext @ 0x5627f6c99900] 0: graphics compute transfer
sparse (queues: 16)
[AVHWDeviceContext @ 0x5627f6c99900] 1: transfer sparse (queues: 2)
[AVHWDeviceContext @ 0x5627f6c99900] 2: compute transfer sparse
(queues: 8)
[AVHWDeviceContext @ 0x5627f6c99900] Using device extension
VK_KHR_push_descriptor
[AVHWDeviceContext @ 0x5627f6c99900] Using device extension
VK_KHR_sampler_ycbcr_conversion
[AVHWDeviceContext @ 0x5627f6c99900] Using device extension
VK_KHR_synchronization2
[AVHWDeviceContext @ 0x5627f6c99900] Using device extension
VK_KHR_external_memory_fd
[AVHWDeviceContext @ 0x5627f6c99900] Using device extension
VK_EXT_external_memory_dma_buf
[AVHWDeviceContext @ 0x5627f6c99900] Using device extension
VK_EXT_image_drm_format_modifier
[AVHWDeviceContext @ 0x5627f6c99900] Using device extension
VK_KHR_external_semaphore_fd
[AVHWDeviceContext @ 0x5627f6c99900] Using device extension
VK_EXT_external_memory_host
[AVHWDeviceContext @ 0x5627f6c99900] Using device: NVIDIA GeForce GTX 1060
6GB
[AVHWDeviceContext @ 0x5627f6c99900] Alignments:
[AVHWDeviceContext @ 0x5627f6c99900]
optimalBufferCopyRowPitchAlignment: 1
[AVHWDeviceContext @ 0x5627f6c99900] minMemoryMapAlignment:
64
[AVHWDeviceContext @ 0x5627f6c99900] minImportedHostPointerAlignment:
4096
[AVHWDeviceContext @ 0x5627f6c99900] Using queue family 0 (queues: 16) for
graphics
[AVHWDeviceContext @ 0x5627f6c99900] Using queue family 1 (queues: 2) for
transfers
[AVHWDeviceContext @ 0x5627f6c99900] Using queue family 2 (queues: 8) for
compute
Successfully parsed a group of options.
Parsing a group of options: input url /home/main/video-test/vertical-
test.mp4.
Successfully parsed a group of options.
Opening an input file: /home/main/video-test/vertical-test.mp4.
[NULL @ 0x5627f7045a00] Opening '/home/main/video-test/vertical-test.mp4'
for reading
[file @ 0x5627f70462c0] Setting default whitelist 'file,crypto,data'
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x5627f7045a00] Format mov,mp4,m4a,3gp,3g2,mj2
probed with size=2048 and score=100
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x5627f7045a00] ISO: File Type Major Brand:
isom
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x5627f7045a00] Unknown dref type 0x206c7275
size 12
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x5627f7045a00] Processing st: 0, edit list 0 -
media time: 1024, duration: 6450693
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x5627f7045a00] Offset DTS by 1024 to make
first pts zero.
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x5627f7045a00] Setting codecpar->delay to 2
for stream st: 0
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x5627f7045a00] Unknown dref type 0x206c7275
size 12
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x5627f7045a00] Processing st: 1, edit list 0 -
media time: 0, duration: 20160048
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x5627f7045a00] Before
avformat_find_stream_info() pos: 48198918 bytes read:316317 seeks:1
nb_streams:2
[h264 @ 0x5627f704f200] nal_unit_type: 7(SPS), nal_ref_idc: 3
[h264 @ 0x5627f704f200] nal_unit_type: 8(PPS), nal_ref_idc: 3
[h264 @ 0x5627f704f200] nal_unit_type: 7(SPS), nal_ref_idc: 3
[h264 @ 0x5627f704f200] nal_unit_type: 8(PPS), nal_ref_idc: 3
[h264 @ 0x5627f704f200] nal_unit_type: 6(SEI), nal_ref_idc: 0
[h264 @ 0x5627f704f200] nal_unit_type: 5(IDR), nal_ref_idc: 3
[h264 @ 0x5627f704f200] Format yuv420p chosen by get_format().
[h264 @ 0x5627f704f200] Reinit context to 1088x1920, pix_fmt: yuv420p
[h264 @ 0x5627f704f200] no picture
[opus @ 0x5627f7054240] skip 312/960 samples
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x5627f7045a00] All info found
[mov,mp4,m4a,3gp,3g2,mj2 @ 0x5627f7045a00] After
avformat_find_stream_info() pos: 50271 bytes read:387199 seeks:2 frames:4
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '/home/main/video-test/vertical-
test.mp4':
Metadata:
major_brand : isom
minor_version : 512
compatible_brands: isomiso2avc1mp41
encoder : Lavf58.76.100
Duration: 00:07:00.00, start: 0.000000, bitrate: 918 kb/s
Stream #0:0[0x1](eng), 3, 1/15360: Video: h264, 1 reference frame (avc1
/ 0x31637661), yuv420p(tv, gbr/reserved/reserved, progressive, left),
1080x1920 (1088x1920) [SAR 1:1 DAR 9:16], 0/1, 911 kb/s, 30 fps, 30 tbr,
15360 tbn (default)
Metadata:
handler_name : VideoHandler
vendor_id : [0][0][0][0]
Stream #0:1[0x2](eng), 1, 1/48000: Audio: opus (Opus / 0x7375704F),
48000 Hz, stereo, fltp, delay 312, 1 kb/s (default)
Metadata:
handler_name : SoundHandler
vendor_id : [0][0][0][0]
Successfully opened the file.
Parsing a group of options: output url /tmp/output.mkv.
Applying option vf (set video filters) with argument
hwupload,libplacebo=w=1920:h=1080:format=yuv420p,hwdownload,format=yuv420p.
Successfully parsed a group of options.
Opening an output file: /tmp/output.mkv.
[file @ 0x5627f7052cc0] Setting default whitelist 'file,crypto,data'
Successfully opened the file.
detected 4 logical cores
[h264 @ 0x5627f704db40] nal_unit_type: 7(SPS), nal_ref_idc: 3
[h264 @ 0x5627f704db40] nal_unit_type: 8(PPS), nal_ref_idc: 3
Stream mapping:
Stream #0:0 -> #0:0 (h264 (native) -> h264 (libx264))
Stream #0:1 -> #0:1 (opus (native) -> vorbis (libvorbis))
Press [q] to stop, [?] for help
cur_dts is invalid st:0 (0) [init:0 i_done:0 finish:0] (this is harmless
if it occurs once at the start per stream)
Last message repeated 1 times
[h264 @ 0x5627f704db40] nal_unit_type: 6(SEI), nal_ref_idc: 0
[h264 @ 0x5627f704db40] nal_unit_type: 5(IDR), nal_ref_idc: 3
[h264 @ 0x5627f704db40] Format yuv420p chosen by get_format().
[h264 @ 0x5627f704db40] Reinit context to 1088x1920, pix_fmt: yuv420p
[h264 @ 0x5627f704db40] no picture
cur_dts is invalid st:0 (0) [init:0 i_done:0 finish:0] (this is harmless
if it occurs once at the start per stream)
[h264 @ 0x5627f8bcffc0] nal_unit_type: 1(Coded slice of a non-IDR
picture), nal_ref_idc: 2
[h264 @ 0x5627f8bcffc0] no picture
cur_dts is invalid st:0 (0) [init:0 i_done:0 finish:0] (this is harmless
if it occurs once at the start per stream)
[opus @ 0x5627f712a880] skip 312/960 samples
[h264 @ 0x5627f8bf3200] nal_unit_type: 1(Coded slice of a non-IDR
picture), nal_ref_idc: 2
[graph_1_in_0_1 @ 0x5627f93c6d40] Setting 'time_base' to value '1/48000'
[graph_1_in_0_1 @ 0x5627f93c6d40] Setting 'sample_rate' to value '48000'
[graph_1_in_0_1 @ 0x5627f93c6d40] Setting 'sample_fmt' to value 'fltp'
[graph_1_in_0_1 @ 0x5627f93c6d40] Setting 'channel_layout' to value
'stereo'
[graph_1_in_0_1 @ 0x5627f93c6d40] tb:1/48000 samplefmt:fltp
samplerate:48000 chlayout:stereo
[format_out_0_1 @ 0x5627f93c7780] Setting 'sample_fmts' to value 'fltp'
[AVFilterGraph @ 0x5627f9224100] query_formats: 4 queried, 9 merged, 0
already done, 0 delayed
cur_dts is invalid st:0 (0) [init:0 i_done:0 finish:0] (this is harmless
if it occurs once at the start per stream)
Last message repeated 2 times
[h264 @ 0x5627f8b90540] nal_unit_type: 1(Coded slice of a non-IDR
picture), nal_ref_idc: 2
cur_dts is invalid st:0 (0) [init:0 i_done:0 finish:0] (this is harmless
if it occurs once at the start per stream)
Last message repeated 2 times
[h264 @ 0x5627f8ba4980] nal_unit_type: 1(Coded slice of a non-IDR
picture), nal_ref_idc: 2
cur_dts is invalid st:0 (0) [init:0 i_done:0 finish:0] (this is harmless
if it occurs once at the start per stream)
Last message repeated 3 times
[h264 @ 0x5627f704db40] nal_unit_type: 1(Coded slice of a non-IDR
picture), nal_ref_idc: 2
[h264 @ 0x5627f8bcffc0] nal_unit_type: 1(Coded slice of a non-IDR
picture), nal_ref_idc: 2
[Parsed_libplacebo_1 @ 0x5627f9433080] Setting 'w' to value '1920'
[Parsed_libplacebo_1 @ 0x5627f9433080] Setting 'h' to value '1080'
[Parsed_libplacebo_1 @ 0x5627f9433080] Setting 'format' to value 'yuv420p'
[libplacebo @ 0x5627f9433180] Initialized libplacebo v5.229.1-49-g22ce304
(API v233)
[Parsed_format_3 @ 0x5627f7132400] Setting 'pix_fmts' to value 'yuv420p'
[graph 0 input from stream 0:0 @ 0x5627f95119c0] Setting 'video_size' to
value '1080x1920'
[graph 0 input from stream 0:0 @ 0x5627f95119c0] Setting 'pix_fmt' to
value '0'
[graph 0 input from stream 0:0 @ 0x5627f95119c0] Setting 'time_base' to
value '1/15360'
[graph 0 input from stream 0:0 @ 0x5627f95119c0] Setting 'pixel_aspect' to
value '1/1'
[graph 0 input from stream 0:0 @ 0x5627f95119c0] Setting 'frame_rate' to
value '30/1'
[graph 0 input from stream 0:0 @ 0x5627f95119c0] w:1080 h:1920
pixfmt:yuv420p tb:1/15360 fr:30/1 sar:1/1
[format @ 0x5627f9375480] Setting 'pix_fmts' to value
'yuv420p|yuvj420p|yuv422p|yuvj422p|yuv444p|yuvj444p|nv12|nv16|nv21|yuv420p10le|yuv422p10le|yuv444p10le|nv20le|gray|gray10le'
[AVFilterGraph @ 0x5627f950ff80] query_formats: 7 queried, 6 merged, 0
already done, 0 delayed
[hwupload @ 0x5627f9510340] Surface format is yuv420p.
[AVHWFramesContext @ 0x5627f9506740] There are no supported modifiers for
the given sw_format
[Parsed_hwupload_0 @ 0x5627f950f800] Failed to configure output pad on
Parsed_hwupload_0
Error reinitializing filters!
Failed to inject frame into filter network: Invalid argument
Error while processing the decoded data for stream #0:0
[AVIOContext @ 0x5627f8bd0e40] Statistics: 0 bytes written, 0 seeks, 0
writeouts
[libvorbis @ 0x5627f7051d00] 43 frames left in the queue on closing
[AVIOContext @ 0x5627f704e6c0] Statistics: 419967 bytes read, 2 seeks
Conversion failed!
}}}
--
Ticket URL: <https://trac.ffmpeg.org/ticket/10046#comment:1>
FFmpeg <https://ffmpeg.org>
FFmpeg issue tracker
More information about the FFmpeg-trac
mailing list