The BioNLP Workshop 2023 initiated the launch of a shared task on Problem List Summarization (ProbSum) in January 2023. The aim of this shared task is to attract future research efforts in building NLP models for real-world diagnostic decision support applications, where a system generating relevant and accurate diagnoses will augment the healthcare providers decision-making process and improve the quality of care for patients. The goal for participants is to develop models that generated a list of diagnoses and problems using input from the daily care notes collected from the hospitalization of critically ill patients. Eight teams submitted their final systems to the shared task leaderboard. In this paper, we describe the tasks, datasets, evaluation metrics, and baseline systems. Additionally, the techniques and results of the evaluation of the different approaches tried by the participating teams are summarized.
翻译:BioNLP研讨会2023于2023年1月发起了一项关于问题列表摘要(ProbSum)的共享任务。该共享任务旨在吸引未来在构建用于真实世界诊断决策支持应用的NLP模型方面的研究投入,其中能够生成相关且准确诊断的系统将增强医疗保健提供者的决策过程,并改善患者的护理质量。参与者的目标是利用从危重症患者住院期间每日护理记录中获取的输入,开发能够生成诊断与问题列表的模型。八个团队向共享任务排行榜提交了最终系统。本文描述了任务、数据集、评估指标及基线系统。此外,还总结了参与团队尝试的不同方法的技术特点及评估结果。