The drum kit, which has only been around for around 100 years, is a popular instrument in many music genres such as pop, rock, and jazz. However, the road to owning a kit is expensive, both financially and space-wise. Also, drums are more difficult to move around compared to other instruments, as they do not fit into a single bag. We propose a no-drums approach that uses only two sticks and a smartphone or a webcam to provide an air-drumming experience. The detection algorithm combines deep learning tools with tracking methods for an enhanced user experience. Based on both quantitative and qualitative testing with humans-in-the-loop, we show that our system has zero misses for beginner level play and negligible misses for advanced level play. Additionally, our limited human trials suggest potential directions for future research.
翻译:架子鼓虽然只出现了大约100年,却已成为流行、摇滚和爵士等多种音乐流派中常用的乐器。然而,拥有一套架子鼓无论在经济上还是空间上成本都相当高昂。此外,与其他乐器不同,架子鼓无法收纳在一个包中,携带十分不便。我们提出一种无需鼓具的方法,仅使用两根鼓棒和一部智能手机或网络摄像头,即可实现空气打鼓体验。该检测算法融合了深度学习工具与跟踪方法,以提升用户体验。基于包含人工参与的定量与定性测试表明,我们的系统在初级水平演奏中无漏击,在高级水平演奏中漏击次数极少。此外,有限的人体试验为未来研究指出了潜在方向。