Designing high-performance neural networks for new tasks requires balancing optimization quality with search efficiency. Current methods fail to achieve this balance: neural architectural search is computationally expensive, while model retrieval often yields suboptimal static checkpoints. To resolve this dilemma, we model the performance gains induced by fine-grained architectural modifications as edit-effect evidence and build evidence graphs from prior tasks. By constructing a retrieval-augmented model refinement framework, our proposed M-DESIGN dynamically weaves historical evidence to discover near-optimal modification paths. M-DESIGN features an adaptive retrieval mechanism that quickly calibrates the evolving transferability of edit-effect evidence from different sources. To handle out-of-distribution shifts, we introduce predictive task planners that extrapolate gains from multi-hop evidence, thereby reducing reliance on an exhaustive repository. Based on our model knowledge base of 67,760 graph neural networks across 22 datasets, extensive experiments demonstrate that M-DESIGN consistently outperforms baselines, achieving the search-space best performance in 26 out of 33 cases under a strict budget.

翻译：针对新任务设计高性能神经网络需要在优化质量与搜索效率之间取得平衡。现有方法未能实现这一平衡：神经架构搜索计算成本高昂，而模型检索往往产生次优的静态检查点。为解决这一困境，我们将细粒度架构修改带来的性能增益建模为编辑效应证据，并从先验任务中构建证据图。通过构建检索增强的模型精炼框架，本文提出的M-DESIGN方法动态编织历史证据以发现接近最优的修改路径。M-DESIGN具备自适应检索机制，可快速校准来自不同来源的编辑效应证据的演进可迁移性。为应对分布外偏移，我们引入预测性任务规划器，通过多跳证据外推性能增益，从而降低对完备知识库的依赖。基于涵盖22个数据集中67,760个图神经网络的模型知识库，大量实验证明M-DESIGN持续超越基线方法，在严格预算约束下于33个案例中取得26个搜索空间最优性能。