[FFmpeg-devel] [PATCH] lavc/imgconvert: fix check on av_image_check_size() return code in avpicture_get_size()
Stefano Sabatini
stefasab at gmail.com
Sun Jun 17 12:22:24 CEST 2012
The documentation states that av_image_check_size() will return a
negative value in case of error, while the check is done on ret != 0.
Also return a proper error code rather than -1 in case the check fails.
---
libavcodec/imgconvert.c | 4 ++--
1 files changed, 2 insertions(+), 2 deletions(-)
diff --git a/libavcodec/imgconvert.c b/libavcodec/imgconvert.c
index 495a1d0..e517812 100644
--- a/libavcodec/imgconvert.c
+++ b/libavcodec/imgconvert.c
@@ -346,8 +346,8 @@ int avpicture_layout(const AVPicture* src, enum PixelFormat pix_fmt, int width,
int avpicture_get_size(enum PixelFormat pix_fmt, int width, int height)
{
AVPicture dummy_pict;
- if(av_image_check_size(width, height, 0, NULL))
- return -1;
+ if (av_image_check_size(width, height, 0, NULL) < 0)
+ return AVERROR(EINVAL);
if (av_pix_fmt_descriptors[pix_fmt].flags & PIX_FMT_PSEUDOPAL)
// do not include palette for these pseudo-paletted formats
return width * height;
--
1.7.5.4
More information about the ffmpeg-devel
mailing list