[FFmpeg-trac] #7983(avcodec:open): undefined-behavior at libavcodec/j2kenc.c:524:31

[FFmpeg]

#7983: undefined-behavior at libavcodec/j2kenc.c:524:31
------------------------------------+-----------------------------------
             Reporter:  Suhwan      |                    Owner:
                 Type:  defect      |                   Status:  open
             Priority:  important   |                Component:  avcodec
              Version:  git-master  |               Resolution:
             Keywords:  j2k ubsan   |               Blocked By:
             Blocking:              |  Reproduced by developer:  1
Analyzed by developer:  0           |
------------------------------------+-----------------------------------
Changes (by cehoyos):

 * keywords:  j2kenc => j2k ubsan
 * status:  new => open
 * component:  undetermined => avcodec
 * reproduced:  0 => 1


Comment:

 {{{
 $ ffmpeg -i tmp.avi -vcodec jpeg2000 -f null -
 ffmpeg version N-94148-g4877b5869e Copyright (c) 2000-2019 the FFmpeg
 developers
   built with gcc 9 (SUSE Linux)
   configuration: --enable-gpl --toolchain=gcc-usan
   libavutil      56. 30.100 / 56. 30.100
   libavcodec     58. 53.101 / 58. 53.101
   libavformat    58. 28.101 / 58. 28.101
   libavdevice    58.  7.100 / 58.  7.100
   libavfilter     7. 55.100 /  7. 55.100
   libswscale      5.  4.101 /  5.  4.101
   libswresample   3.  4.100 /  3.  4.100
   libpostproc    55.  4.100 / 55.  4.100
 Input #0, avi, from 'tmp.avi':
   Duration: 00:00:03.14, start: 0.000000, bitrate: 736 kb/s
     Stream #0:0: Video: indeo4 (IV41 / 0x31345649), yuv410p, 256x240, 731
 kb/s, 35 fps, 35 tbr, 35 tbn, 35 tbc
 Stream mapping:
   Stream #0:0 -> #0:0 (indeo4 (native) -> jpeg2000 (native))
 Press [q] to stop, [?] for help
 src/libavcodec/j2kenc.c:524:31: runtime error: left shift of negative
 value -288
 src/libavcodec/j2kenc.c:530:31: runtime error: left shift of negative
 value -3
 src/libavcodec/j2kenc.c:530:31: runtime error: left shift of negative
 value -3
 src/libavcodec/j2kenc.c:528:31: runtime error: left shift of negative
 value -1
 Output #0, null, to 'pipe:':
   Metadata:
     encoder         : Lavf58.28.101
     Stream #0:0: Video: jpeg2000, yuv410p, 256x240, q=2-31, 200 kb/s, 35
 fps, 35 tbn, 35 tbc
     Metadata:
       encoder         : Lavc58.53.101 jpeg2000
 src/libavcodec/jpeg2000dwt.c:258:14: runtime error: left shift of negative
 value -82
 frame=  110 fps= 68 q=-0.0 Lsize=N/A time=00:00:03.14 bitrate=N/A
 speed=1.94x
 video:1462kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB
 muxing overhead: unknown
 }}}

--
Ticket URL: <https://trac.ffmpeg.org/ticket/7983#comment:1>
FFmpeg <https://ffmpeg.org>
FFmpeg issue tracker