Neural network representations of simple models, such as linear regression, are being studied increasingly to better understand the underlying principles of deep learning algorithms. However, neural representations of distributional regression models, such as the Cox model, have received little attention so far. We close this gap by proposing a framework for distributional regression using inverse flow transformations (DRIFT), which includes neural representations of the aforementioned models. We empirically demonstrate that the neural representations of models in DRIFT can serve as a substitute for their classical statistical counterparts in several applications involving continuous, ordered, time-series, and survival outcomes. We confirm that models in DRIFT empirically match the performance of several statistical methods in terms of estimation of partial effects, prediction, and aleatoric uncertainty quantification. DRIFT covers both interpretable statistical models and flexible neural networks opening up new avenues in both statistical modeling and deep learning.
翻译:简单模型(如线性回归)的神经网络表示正被越来越多地研究,以深入理解深度学习算法的基本原理。然而,分布回归模型(如Cox模型)的神经表示迄今鲜受关注。我们通过提出基于逆流变换的分布回归框架(DRIFT)填补了这一空白,该框架包含上述模型的神经表示。我们通过实验证明,在涉及连续、有序、时间序列和生存结果的多种应用中,DRIFT框架中模型的神经表示可作为其经典统计对应物的有效替代。我们证实,DRIFT中的模型在部分效应估计、预测和偶然不确定性量化方面,在经验上与多种统计方法的性能相匹配。DRIFT兼具可解释统计模型与灵活神经网络的双重特性,为统计建模与深度学习开辟了全新途径。