Low-rank multivariate regression (LRMR) is an important statistical learning model that combines highly correlated tasks as a multiresponse regression problem with low-rank priori on the coefficient matrix. In this paper, we study quantized LRMR, a practical setting where the responses and/or the covariates are discretized to finite precision. We focus on the estimation of the underlying coefficient matrix. To make consistent estimator that could achieve arbitrarily small error possible, we employ uniform quantization with random dithering, i.e., we add appropriate random noise to the data before quantization. Specifically, uniform dither and triangular dither are used for responses and covariates, respectively. Based on the quantized data, we propose the constrained Lasso and regularized Lasso estimators, and derive the non-asymptotic error bounds. With the aid of dithering, the estimators achieve minimax optimal rate, while quantization only slightly worsens the multiplicative factor in the error rate. Moreover, we extend our results to a low-rank regression model with matrix responses. We corroborate and demonstrate our theoretical results via simulations on synthetic data or image restoration.
翻译:低秩多元回归(LRMR)是一种重要的统计学习模型,它将高度相关的任务组合为多响应回归问题,并对系数矩阵施加低秩先验。本文研究量化LRMR这一实际场景,其中响应变量和/或协变量被离散化为有限精度。我们聚焦于潜在系数矩阵的估计。为使一致估计量能够实现任意小的误差,我们采用带随机抖动的均匀量化,即在量化前向数据中添加适当的随机噪声。具体而言,对响应变量使用均匀抖动,对协变量使用三角抖动。基于量化数据,我们提出了约束Lasso和正则化Lasso估计量,并推导了非渐近误差界限。借助抖动技术,估计量达到了极小极大最优速率,而量化仅略微增大了误差速率中的乘法因子。此外,我们将结果推广至具有矩阵响应的低秩回归模型。通过合成数据或图像恢复的模拟实验,我们验证并展示了理论结果。