Fault-tolerant deep learning accelerator is the basis for highly reliable deep learning processing and critical to deploy deep learning in safety-critical applications such as avionics and robotics. Since deep learning is known to be computing- and memory-intensive, traditional fault-tolerant approaches based on redundant computing will incur substantial overhead including power consumption and chip area. To this end, we propose to characterize deep learning vulnerability difference across both neurons and bits of each neuron, and leverage the vulnerability difference to enable selective protection of the deep learning processing components from the perspective of architecture layer and circuit layer respectively. At the same time, we observe the correlation between model quantization and bit protection overhead of the underlying processing elements of deep learning accelerators, and propose to reduce the bit protection overhead by adding additional quantization constrain without compromising the model accuracy. Finally, we employ Bayesian optimization strategy to co-optimize the correlated cross-layer design parameters at algorithm layer, architecture layer, and circuit layer to minimize the hardware resource consumption while fulfilling multiple user constraints including reliability, accuracy, and performance of the deep learning processing at the same time.
翻译:容错深度学习加速器是实现高可靠深度学习处理的基础,对于在航空电子、机器人等安全关键型应用中部署深度学习至关重要。由于深度学习以计算密集型和内存密集型著称,基于冗余计算的传统容错方法会带来大量额外的功耗和芯片面积开销。为此,本文提出通过刻画深度学习在神经元层面及每个神经元位级上的脆弱性差异,利用这种脆弱性差异分别从架构层和电路层视角对深度学习处理组件进行选择性保护。同时,我们观察到模型量化与深度学习加速器底层处理单元位保护开销之间的关联性,提出在不影响模型精度的前提下,通过增加额外量化约束来降低位保护开销。最后,采用贝叶斯优化策略,协同优化算法层、架构层和电路层中相互关联的跨层设计参数,在满足可靠性、精度及性能等多重用户约束的前提下,最小化硬件资源消耗。