[FFmpeg-devel] How to support audio data placed within video data

[Manuel Lauss]

Hello,

I'd like to add some audio support for the old libavformat/smush
formats (mainly the "ANIM" variants; the "SANM" variant already has
audio decoding support).

The audio data (16bit stereo PCM) however is placed at (more or less)
random places within all the video data, also with no relation to the
actual video frame it is embedded into (i.e. most files place a few
hundred ms of audio in the first video frame, while the rest are
roughly the length of a video frame).

What is the best way to support this scenario?

Thanks!
     Manuel