[FFmpeg-devel] [PATCH] checkasm/af_afir: relax the max allowed absolute difference
Derek Buitenhuis
derek.buitenhuis at gmail.com
Sun Jan 13 16:32:38 EET 2019
On 13/01/2019 02:44, James Almer wrote:
> Michael suggested 1000*FLT_EPSILON but IMO that's too big and may hide
> errors in future implementations.
> The value i used is the smallest value i found that didn't fail after
> several runs. 6.1e-05 for example fails.
I figured that's how it was chosen (though not documented). I thought there
be a way to calculate it properly instead of empirically.
- Derek
More information about the ffmpeg-devel
mailing list