The use of synthetic data is recognized as a crucial step in the development of neural network-based Artificial Intelligence (AI) systems. While the methods for generating synthetic data for AI applications in other domains have a role in certain biomedical AI systems, primarily related to image processing, there is a critical gap in the generation of time series data for AI tasks where it is necessary to know how the system works. This is most pronounced in the ability to generate synthetic multi-dimensional molecular time series data (SMMTSD); this is the type of data that underpins research into biomarkers and mediator signatures for forecasting various diseases and is an essential component of the drug development pipeline. We argue the insufficiency of statistical and data-centric machine learning (ML) means of generating this type of synthetic data is due to a combination of factors: perpetual data sparsity due to the Curse of Dimensionality, the inapplicability of the Central Limit Theorem, and the limits imposed by the Causal Hierarchy Theorem. Alternatively, we present a rationale for using complex multi-scale mechanism-based simulation models, constructed and operated on to account for epistemic incompleteness and the need to provide maximal expansiveness in concordance with the Principle of Maximal Entropy. These procedures provide for the generation of SMMTD that minimizes the known shortcomings associated with neural network AI systems, namely overfitting and lack of generalizability. The generation of synthetic data that accounts for the identified factors of multi-dimensional time series data is an essential capability for the development of mediator-biomarker based AI forecasting systems, and therapeutic control development and optimization through systems like Drug Development Digital Twins.
翻译:合成数据的应用被认为是开发基于神经网络的人工智能(AI)系统的关键环节。尽管其他领域用于AI应用的合成数据生成方法在部分生物医学AI系统(主要涉及图像处理)中具有一定作用,但在需要理解系统运行机制的AI任务中,时间序列数据的生成仍存在关键空白。这一空白在生成合成多维分子时间序列数据(SMMTSD)方面尤为突出——此类数据是支撑疾病预测生物标志物与中介因子特征研究的基石,也是药物开发管线的重要组成部分。我们认为,统计方法和以数据为中心的机器学习(ML)手段无法充分生成此类合成数据,其原因可归结为多重因素:维度灾难导致的持续性数据稀疏性、中心极限定理的不适用性,以及因果层次定理所施加的限制。为此,我们提出一种替代方案的理论依据:采用基于复杂多尺度机制的仿真模型,在构建与运行中充分考虑认知不完备性,并依据最大熵原理追求最大扩展性。这些流程生成的SMMTD可最大限度减少神经网络AI系统的已知缺陷,即过拟合与泛化能力不足。针对多维时间序列数据的上述关键因素生成合成数据,是开发基于中介因子-生物标志物的AI预测系统,以及通过药物开发数字孪生等系统实现治疗控制开发与优化的核心能力。