LT (Luby transform) codes are a celebrated family of rateless erasure codes (RECs). Most of existing LT codes were designed for applications in which a centralized encoder possesses all message blocks and is solely responsible for encoding them into codewords. Distributed LT codes, in which message blocks are physically scattered across multiple different locations (encoders) that need to collaboratively perform the encoding, has never been systemically studied before despite its growing importance in applications. In this work, we present the first systemic study of LT codes in the distributed setting, and make the following three major contributions. First, we show that only a proper subset of LT codes are feasible in the distributed setting, and give the sufficient and necessary condition for such feasibility. Second, we propose a distributed encoding protocol that can efficiently implement any feasible code. The protocol is parameterized by a so-called action probability array (APA) that is only a few KBs in size, and any feasible code corresponds to a valid APA setting and vice versa. Third, we propose two heuristic search algorithms that have led to the discovery of feasible codes that are much more efficient than the state of the art.
翻译:摘要:LT(Luby变换)码是一类著名的无速率纠删码(REC)。现有LT码大多针对集中式编码器持有所有消息块并独立完成编码的应用场景设计。尽管分布式LT码在应用中日益重要,但消息块分散存储于多个不同位置(编码器)且需协作编码的分布式场景至今未得到系统性研究。本文首次系统研究了分布式环境下的LT码,并作出以下三大贡献:第一,证明仅有部分LT码适用于分布式场景,并给出其充分必要条件;第二,提出可高效实现任意可行码的分布式编码协议,该协议由仅数KB大小的所谓动作概率数组(APA)参数化,且可行码与有效APA配置一一对应;第三,提出两种启发式搜索算法,发现比现有技术更高效的可行码。