Birth asphyxia is a major newborn mortality problem in low-resource countries. International guideline provides treatment recommendations; however, the importance and effect of the different treatments are not fully explored. The available data is collected in Tanzania, during newborn resuscitation, for analysis of the resuscitation activities and the response of the newborn. An important step in the analysis is to create activity timelines of the episodes, where activities include ventilation, suction, stimulation etc. Methods: The available recordings are noisy real-world videos with large variations. We propose a two-step process in order to detect activities possibly overlapping in time. The first step is to detect and track the relevant objects, like bag-mask resuscitator, heart rate sensors etc., and the second step is to use this information to recognize the resuscitation activities. The topic of this paper is the first step, and the object detection and tracking are based on convolutional neural networks followed by post processing. Results: The performance of the object detection during activities were 96.97 % (ventilations), 100 % (attaching/removing heart rate sensor) and 75 % (suction) on a test set of 20 videos. The system also estimate the number of health care providers present with a performance of 71.16 %. Conclusion: The proposed object detection and tracking system provides promising results in noisy newborn resuscitation videos. Significance: This is the first step in a thorough analysis of newborn resuscitation episodes, which could provide important insight about the importance and effect of different newborn resuscitation activities
翻译:出生窒息是低资源国家新生儿死亡的主要问题。国际指南提供了治疗建议,但不同治疗方法的重要性和效果尚未完全明确。现有数据采集自坦桑尼亚的新生儿复苏过程,用于分析复苏活动及新生儿的反应。分析的关键步骤是创建事件的活动时间线,其中活动包括通气、吸引、刺激等。方法:可用记录是存在较大变化的真实世界噪声视频。我们提出一个两步流程来检测可能重叠的活动。第一步是检测和跟踪相关物体,如球囊面罩复苏器、心率传感器等;第二步是利用这些信息识别复苏活动。本文关注第一步,目标检测与跟踪基于卷积神经网络及后续处理。结果:在20个视频的测试集中,活动期间的目标检测性能分别为96.97%(通气)、100%(安装/移除心率传感器)和75%(吸引)。系统对现场医护人员数量的估计性能为71.16%。结论:所提出的目标检测与跟踪系统在噪声较大的新生儿复苏视频中取得了令人鼓舞的结果。意义:这是对新生儿复苏事件进行深入分析的第一步,可为不同复苏活动的重要性和效果提供重要见解。