Efficient compression of correlated data is essential to minimize communication overload in multi-sensor networks. In such networks, each sensor independently compresses the data and transmits them to a central node due to limited communication bandwidth. A decoder at the central node decompresses and passes the data to a pre-trained machine learning-based task to generate the final output. Thus, it is important to compress the features that are relevant to the task. Additionally, the final performance depends heavily on the total available bandwidth. In practice, it is common to encounter varying availability in bandwidth, and higher bandwidth results in better performance of the task. We design a novel distributed compression framework composed of independent encoders and a joint decoder, which we call neural distributed principal component analysis (NDPCA). NDPCA flexibly compresses data from multiple sources to any available bandwidth with a single model, reducing computing and storage overhead. NDPCA achieves this by learning low-rank task representations and efficiently distributing bandwidth among sensors, thus providing a graceful trade-off between performance and bandwidth. Experiments show that NDPCA improves the success rate of multi-view robotic arm manipulation by 9% and the accuracy of object detection tasks on satellite imagery by 14% compared to an autoencoder with uniform bandwidth allocation.
翻译:有效压缩相关数据对于减少多传感器网络中的通信负载至关重要。在此类网络中,由于通信带宽有限,每个传感器独立压缩数据并将其传输至中心节点。中心节点的解码器解压数据后,将其传递给基于预训练机器学习模型的任务以生成最终输出。因此,压缩与任务相关的特征非常重要。此外,最终性能在很大程度上依赖于总可用带宽。实践中,带宽的可用性常出现动态变化,更高的带宽通常带来更好的任务性能。我们设计了一种由独立编码器和联合解码器组成的新型分布式压缩框架,称为神经分布式主成分分析(NDPCA)。NDPCA能够通过单一模型灵活地将多源数据压缩至任意可用带宽,从而降低计算和存储开销。该框架通过学习低秩任务表示并高效分配各传感器的带宽,实现了性能与带宽之间的优雅平衡。实验表明,与采用均匀带宽分配的自动编码器相比,NDPCA在多视角机械臂操作任务中的成功率提升了9%,在卫星图像目标检测任务中的准确率提升了14%。