[FFmpeg-trac] #7802(avcodec:new): libvpx-vp9 encode causes segmentation fault

[FFmpeg]

#7802: libvpx-vp9 encode causes segmentation fault
--------------------------------------+-----------------------------------
             Reporter:  j_karthic     |                    Owner:
                 Type:  defect        |                   Status:  new
             Priority:  normal        |                Component:  avcodec
              Version:  git-master    |               Resolution:
             Keywords:  libvpx crash  |               Blocked By:
             Blocking:                |  Reproduced by developer:  0
Analyzed by developer:  0             |
--------------------------------------+-----------------------------------

Comment (by j_karthic):

 {{{
 blr-mp4tf:ffmpeg kjeyapal$ lldb ./ffmpeg
 (lldb) target create "./ffmpeg"
 Current executable set to './ffmpeg' (x86_64).
 (lldb) r -i ~/Downloads/big_buck_bunny_1080p_stereo.avi -c:v libvpx-vp9
 -pix_fmt yuv420p -cpu-used 3 -tile-columns 3 -frame-parallel 1 -deadline
 realtime -threads 4  -lag-in-frames 0  -b:v 1000k -an out.mp4
 Process 44440 launched: './ffmpeg' (x86_64)
 ffmpeg version N-93431-g6dc1da416e Copyright (c) 2000-2019 the FFmpeg
 developers
   built with Apple LLVM version 10.0.0 (clang-1000.11.45.5)
   configuration: --enable-libx264 --enable-libvpx --enable-gpl
   libavutil      56. 26.100 / 56. 26.100
   libavcodec     58. 47.105 / 58. 47.105
   libavformat    58. 26.101 / 58. 26.101
   libavdevice    58.  7.100 / 58.  7.100
   libavfilter     7. 48.100 /  7. 48.100
   libswscale      5.  4.100 /  5.  4.100
   libswresample   3.  4.100 /  3.  4.100
   libpostproc    55.  4.100 / 55.  4.100
 Input #0, avi, from
 '/Users/kjeyapal/Downloads/big_buck_bunny_1080p_stereo.avi':
   Metadata:
     encoder         : MEncoder 2:1.0~rc2-0ubuntu13
   Duration: 00:09:56.46, start: 0.000000, bitrate: 9586 kb/s
     Stream #0:0: Video: msmpeg4v2 (MP42 / 0x3234504D), yuv420p, 1920x1080,
 9328 kb/s, 24 fps, 24 tbr, 24 tbn, 24 tbc
     Stream #0:1: Audio: mp3 (U[0][0][0] / 0x0055), 48000 Hz, stereo, fltp,
 245 kb/s
 File 'out.mp4' already exists. Overwrite ? [y/N] y
 Stream mapping:
   Stream #0:0 -> #0:0 (msmpeg4v2 (native) -> vp9 (libvpx-vp9))
 Press [q] to stop, [?] for help
 [libvpx-vp9 @ 0x10286b000] v1.8.0-289-g5cde05fda
 Process 44440 stopped
 * thread #1, queue = 'com.apple.main-thread', stop reason = EXC_BAD_ACCESS
 (code=1, address=0x1efd5c8)
     frame #0: 0x00007fff6808ece8
 libsystem_pthread.dylib`__pthread_once_handler + 70
 libsystem_pthread.dylib`__pthread_once_handler:
 ->  0x7fff6808ece8 <+70>: movq   %rax, 0x8(%rbx)
     0x7fff6808ecec <+74>: movq   (%r14), %rax
     0x7fff6808ecef <+77>: movq   $0x4f4e4345, (%rax)       ; imm =
 0x4F4E4345
     0x7fff6808ecf6 <+84>: addq   $0x18, %rsp
 Target 0: (ffmpeg) stopped.
 (lldb) bt
 * thread #1, queue = 'com.apple.main-thread', stop reason = EXC_BAD_ACCESS
 (code=1, address=0x1efd5c8)
   * frame #0: 0x00007fff6808ece8
 libsystem_pthread.dylib`__pthread_once_handler + 70
     frame #1: 0x00007fff68084acb libsystem_platform.dylib`_os_once_callout
 + 18
     frame #2: 0x00007fff6808ec7f libsystem_pthread.dylib`pthread_once + 56
     frame #3: 0x00000001010eab7d ffmpeg`vp9_initialize_enc + 29
     frame #4: 0x00007fff6808ece4
 libsystem_pthread.dylib`__pthread_once_handler + 66
     frame #5: 0x00007fff68084acb libsystem_platform.dylib`_os_once_callout
 + 18
     frame #6: 0x00007fff6808ec7f libsystem_pthread.dylib`pthread_once + 56
     frame #7: 0x0000000101097f81
 ffmpeg`___lldb_unnamed_symbol17840$$ffmpeg + 193
     frame #8: 0x0000000101001df1 ffmpeg`vpx_codec_enc_init_ver + 161
     frame #9: 0x000000010087f0b4 ffmpeg`___lldb_unnamed_symbol8583$$ffmpeg
 + 2511
     frame #10: 0x0000000100b77cac ffmpeg`avcodec_open2 + 3932
     frame #11: 0x000000010001fefb ffmpeg`___lldb_unnamed_symbol78$$ffmpeg
 + 4795
     frame #12: 0x00000001000215bc ffmpeg`___lldb_unnamed_symbol87$$ffmpeg
 + 172
     frame #13: 0x000000010001ab77 ffmpeg`___lldb_unnamed_symbol73$$ffmpeg
 + 15527
     frame #14: 0x00000001000165e9 ffmpeg`main + 361
     frame #15: 0x00007fff67e9ced9 libdyld.dylib`start + 1
     frame #16: 0x00007fff67e9ced9 libdyld.dylib`start + 1
 (lldb) register read
 General Purpose Registers:
        rax = 0x00007ffeefbfd410
        rbx = 0x0000000001efd5c0
        rcx = 0x0000000000000000
        rdx = 0x000000009c000000
        rdi = 0x00000000000027ab
        rsi = 0x000000000000000d
        rbp = 0x00007ffeefbfd390
        rsp = 0x00007ffeefbfd360
         r8 = 0x0000000000000012
         r9 = 0x00000000ffffffee
        r10 = 0x00007ffeefbff9f0
        r11 = 0xffff800212c7c14f
        r12 = 0x00007fff6808eca2
 libsystem_pthread.dylib`__pthread_once_handler
        r13 = 0x000000010286b000
        r14 = 0x00007ffeefbfd3c0
        r15 = 0x00007ffeefbfd360
        rip = 0x00007fff6808ece8
 libsystem_pthread.dylib`__pthread_once_handler + 70
     rflags = 0x0000000000010246
         cs = 0x000000000000002b
         fs = 0x0000000000000000
         gs = 0x0000000000000000
 (lldb) disassemble --pc
 libsystem_pthread.dylib`__pthread_once_handler:
 ->  0x7fff6808ece8 <+70>: movq   %rax, 0x8(%rbx)
     0x7fff6808ecec <+74>: movq   (%r14), %rax
     0x7fff6808ecef <+77>: movq   $0x4f4e4345, (%rax)       ; imm =
 0x4F4E4345
     0x7fff6808ecf6 <+84>: addq   $0x18, %rsp

 }}}

 Please find backtrace, disassembly and register dump above. Please let me
 know if anything else is required.

--
Ticket URL: <https://trac.ffmpeg.org/ticket/7802#comment:2>
FFmpeg <https://ffmpeg.org>
FFmpeg issue tracker