This paper introduces the `Jacobi prior,' an alternative Bayesian method, that aims to address the computational challenges inherent in traditional techniques. It demonstrates that the Jacobi prior performs better than well-known methods like Lasso, Ridge, Elastic Net, and MCMC-based Horse-Shoe Prior, especially in predicting accurately. Additionally, We also show that the Jacobi prior is more than a hundred times faster than these methods while maintaining similar predictive accuracy. The method is implemented for Generalised Linear Models, Gaussian process regression, and classification, making it suitable for longitudinal/panel data analysis. The Jacobi prior shows it can handle partitioned data across servers worldwide, making it useful for distributed computing environments. As the method runs faster while still predicting accurately, it's good for organizations wanting to reduce their environmental impact and meet ESG standards. To show how well the Jacobi prior works, we did a detailed simulation study with four experiments, looking at statistical consistency, accuracy, and speed. Additionally, we present two empirical studies. First, we thoroughly evaluate Credit Risk by studying default probability using data from the U.S. Small Business Administration (SBA). Also, we use the Jacobi prior to classifying stars, quasars, and galaxies in a 3-class problem using multinational logit regression on Sloan Digital Sky Survey data. We use different filters as features. All codes and datasets for this paper are available in the following GitHub repository: https://github.com/sourish-cmi/Jacobi-Prior/
翻译:本文提出了一种名为“雅可比先验”的替代贝叶斯方法,旨在解决传统技术中固有的计算挑战。研究表明,雅可比先验在预测精度上优于Lasso、Ridge、Elastic Net以及基于MCMC的Horse-Shoe先验等知名方法。此外,我们还证明,雅可比先验在保持相似预测精度的同时,其运行速度比这些方法快百倍以上。该方法适用于广义线性模型、高斯过程回归及分类任务,因此适合纵向/面板数据分析。雅可比先验能够处理分布在全球服务器上的分区数据,从而在分布式计算环境中具有实用性。由于该方法在快速运行的同时仍能保持高精度预测,因此适用于希望降低环境影响并满足ESG标准的组织。为展示雅可比先验的性能,我们通过四个实验进行了详细的模拟研究,探讨了统计一致性、精度和速度。此外,我们还给出了两项实证研究。首先,我们利用美国小企业管理局(SBA)的数据,通过研究违约概率对信用风险进行了全面评估。其次,我们使用多项逻辑回归对斯隆数字巡天数据进行三星分类(恒星、类星体和星系),并采用不同滤波器作为特征。本文的所有代码和数据集均可在以下GitHub仓库中获取:https://github.com/sourish-cmi/Jacobi-Prior/