[FFmpeg-trac] #10268(avcodec:new): When nvenc fails with "out of memory" the program crashes instead of returning that error

FFmpeg trac at avcodec.org
Fri Mar 17 20:47:46 EET 2023


#10268: When nvenc fails with "out of memory" the program crashes instead of
returning that error
---------------------------------+--------------------------------------
             Reporter:  Adrian   |                     Type:  defect
               Status:  new      |                 Priority:  normal
            Component:  avcodec  |                  Version:  git-master
             Keywords:  NVENC    |               Blocked By:
             Blocking:           |  Reproduced by developer:  0
Analyzed by developer:  0        |
---------------------------------+--------------------------------------
 Using latest master, when the NVENC encoder fails "OpenEncodeSessionEx
 failed: out of memory", the program crashes in avcodec_open2, instead of
 returning the error.

 It's easy to reproduce by starting multiple concurrent encoding sessions
 (4 was enough for me with RTX 3080 Ti)

 The error is printed to the log, and then it crashes.
-- 
Ticket URL: <https://trac.ffmpeg.org/ticket/10268>
FFmpeg <https://ffmpeg.org>
FFmpeg issue tracker


More information about the FFmpeg-trac mailing list