We introduce data structures and algorithms to count numerical inaccuracies arising from usage of floating numbers described in IEEE 754. Here we describe how to estimate precision for some collection of functions most commonly used for array manipulations and training of neural networks. For highly optimized functions like matrix multiplication, we provide a fast estimation of precision and some hint how the estimation can be strengthened.
翻译:我们提出了一套数据结构和算法,用于统计IEEE 754标准浮点数使用中产生的数值不精确性。本文描述了如何估算数组操作及神经网络训练中最常用函数集合的精度。针对矩阵乘法等高优化函数,我们提供了快速的精度估计方法,并给出了如何增强该估计的提示。