Deep learning-based machine listening is broadening the scope of industrial acoustic analysis, yet its widespread implementation on live shop floors is hindered by the reliance on large, task-specific annotated datasets for every new task. While emerging general-purpose sound foundation models aim to alleviate data dependency, they reveal critical dilemmas in practice. General-purpose sound foundation models are computationally expensive and fail in industrial scenarios characterized by tonal harmonics, broadband noise, and transient fault events, making instant, on-site deployment impractical. These challenges combined mean that a practical, end-to-end system for deploying a sound foundation model on a live shop floor has remained elusive. To address this challenge, this study introduces LISTEN (Lightweight Industrial Sound-representable Transformer for Edge Notification), the first lightweight foundation model specialized for industrial sound. Through Knowledge Distillation (KD) from the large-scale teacher model IMPACT (Industrial Machine Perception via Acoustic Cognitive Transformer), we construct LISTEN optimized for resource-constrained edge environments. By freezing the backbone and training only a shallow head on minimal target-process data, rather than performing full fine-tuning or retraining, LISTEN achieves nearly identical performance to IMPACT across diverse manufacturing processes. This study further demonstrates a complete system for real-time machine monitoring, encompassing data acquisition with Industrial Internet of Things (IIoT) devices, rapid model adaptation using minimal annotated data, and real-time monitoring on a low-cost edge device. By validating the entire system on a live CNC machine, this work establishes the first feasible end-to-end system for deploying a lightweight industrial sound foundation model in an active industrial environment.
翻译:摘要:基于深度学习的机器听觉技术正在拓展工业声学分析的应用范围,但其在实时车间环境中的广泛部署仍受限于每项新任务均需依赖大规模、任务特定的标注数据集。尽管新兴的通用声音基础模型旨在缓解数据依赖性问题,但在实践中暴露出关键困境:通用声音基础模型计算开销高昂,且在具有谐波特性、宽带噪声及瞬态故障事件的工业场景中表现失效,因此无法实现即时现场部署。这些挑战共同导致在真实车间环境中部署端到端声音基础模型的实用系统仍遥不可及。针对该难题,本研究提出LISTEN(面向边缘通知的轻量级工业声音可表征Transformer)——首个专为工业声音优化的轻量级基础模型。通过从大规模教师模型IMPACT(基于声学认知Transformer的工业机器感知)进行知识蒸馏,我们构建了针对资源受限边缘环境优化的LISTEN模型。通过冻结骨干网络并仅利用极小目标过程数据训练浅层预测头(而非执行全模型微调或重训练),LISTEN在多种制造工艺场景中实现了与IMPACT近乎一致的性能表现。本研究进一步展示了完整的实时机器监控系统,涵盖工业物联网设备数据采集、基于极小标注数据的快速模型自适应,以及在低成本边缘设备上的实时监控。通过在真实CNC机床上验证整套系统,本研究首次建立了在活跃工业环境中部署轻量级工业声音基础模型的可行端到端系统。