Developing robust sparse models fit for safety-critical and resource-constrained systems such as drones, autonomous robots, etc., has been an issue of longstanding interest. The inability of adversarial training mechanisms to provide a formal robustness guarantee kindles the requirement for verified local robustness mechanisms. This work aims to compute sparse verified locally robust networks which exhibit (benign) accuracy and verified local robustness comparable to their dense counterparts. Towards this objective, we examine several model sparsification approaches and present `SparseVLR'-- a framework to search verified locally robust sparse networks. We empirically investigated SparseVLR's efficacy and generalizability by evaluating various benchmark and application-specific datasets across several models. Above all, we provide an in-depth study and reasoning to unveil the causes for the ascendancy of SparseVLR.
翻译:开发适用于无人机、自主机器人等安全关键且资源受限系统的鲁棒稀疏模型一直是长期关注的问题。对抗训练机制无法提供形式化鲁棒性保证,这激发了对验证性局部鲁棒机制的需求。本研究旨在计算稀疏验证性局部鲁棒网络,使其在(良性)准确率和验证性局部鲁棒性方面与稠密网络相当。为实现这一目标,我们考察了多种模型稀疏化方法,并提出“SparseVLR”——一种搜索验证性局部鲁棒稀疏网络的框架。我们通过跨多个模型评估各类基准及应用特定数据集,实证研究了SparseVLR的有效性与泛化能力。最重要的是,我们提供了深入的研究与推理,以揭示SparseVLR优势背后的成因。