Automated machine learning (AutoML) frameworks can lower technical barriers for predictive and prognostic model development in radiomics by enabling researchers without programming expertise to build models. However, their effectiveness in addressing radiomics-specific challenges remains unclear. This study evaluates the performance, efficiency, and accessibility of general-purpose and radiomics-specific AutoML frameworks on diverse radiomics classification tasks, thereby highlighting development needs for radiomics. Ten public/private radiomics datasets with varied imaging modalities (CT/MRI), sizes, anatomies and endpoints were used. Six general-purpose and five radiomics-specific frameworks were tested with predefined parameters using standardized cross-validation. Evaluation metrics included AUC, runtime, together with qualitative aspects related to software status, accessibility, and interpretability. Simplatab, a radiomics-specific tool with a no-code interface, achieved the highest average test AUC (81.81%) with a moderate runtime (~1 hour). LightAutoML, a general-purpose framework, showed the fastest execution with competitive performance (78.74% mean AUC in six minutes). Most radiomics-specific frameworks were excluded from the performance analysis due to obsolescence, extensive programming requirements, or computational inefficiency. Conversely, general-purpose frameworks demonstrated higher accessibility and ease of implementation. Simplatab provides an effective balance of performance, efficiency, and accessibility for radiomics classification problems. However, significant gaps remain, including the lack of accessible survival analysis support and the limited integration of feature reproducibility and harmonization within current AutoML frameworks. Future research should focus on adapting AutoML solutions to better address these radiomics-specific challenges.
翻译:自动化机器学习(AutoML)框架能够降低影像组学中预测和预后模型开发的技术门槛,使不具备编程专业知识的研究者也能构建模型。然而,这些框架在应对影像组学特有挑战方面的有效性仍不明确。本研究评估了通用型与影像组学专用AutoML框架在多种影像组学分类任务上的性能、效率和可访问性,从而揭示了影像组学领域的发展需求。研究使用了十个公开/私有的影像组学数据集,涵盖不同成像模态(CT/MRI)、数据规模、解剖部位和临床终点。在标准化交叉验证设置下,以预设参数测试了六个通用框架和五个影像组学专用框架。评估指标包括AUC、运行时间,以及与软件状态、可访问性和可解释性相关的定性方面。Simplatab——一款具备无代码界面的影像组学专用工具——取得了最高的平均测试AUC(81.81%),同时运行时间适中(约1小时)。通用框架LightAutoML则表现出最快的执行速度,且性能具有竞争力(平均AUC为78.74%,耗时六分钟)。大多数影像组学专用框架因过时、需要大量编程或计算效率低下而被排除在性能分析之外。相反,通用框架展现出更高的可访问性和更易实施的特点。对于影像组学分类问题,Simplatab在性能、效率和可访问性之间提供了有效的平衡。然而,显著差距依然存在,包括缺乏可访问的生存分析支持,以及当前AutoML框架中对特征可重复性与协调性的整合有限。未来的研究应着重于调整AutoML解决方案,以更好地应对这些影像组学特有的挑战。