Deep generative models can help with data scarcity and privacy by producing synthetic training data, but they struggle in low-data, imbalanced tabular settings to fully learn the complex data distribution. We argue that striving for the full joint distribution could be overkill; for greater data efficiency, models should prioritize learning the conditional distribution $P(y\mid \bm{X})$, as suggested by recent theoretical analysis. Therefore, we overcome this limitation with \textbf{ReTabSyn}, a \textbf{Re}inforced \textbf{Tab}ular \textbf{Syn}thesis pipeline that provides direct feedback on feature correlation preservation during synthesizer training. This objective encourages the generator to prioritize the most useful predictive signals when training data is limited, thereby strengthening downstream model utility. We empirically fine-tune a language model-based generator using this approach, and across benchmarks with small sample sizes, class imbalance, and distribution shift, ReTabSyn consistently outperforms state-of-the-art baselines. Moreover, our approach can be readily extended to control various aspects of synthetic tabular data, such as applying expert-specified constraints on generated observations.
翻译:深度生成模型可通过生成合成训练数据缓解数据稀缺与隐私问题,但在低数据量、类别不平衡的表格场景中难以充分学习复杂数据分布。我们认为追求完整联合分布可能适得其反;为提高数据效率,模型应优先学习条件分布 $P(y\mid \bm{X})$,正如近期理论分析所示。为此,我们提出\textbf{ReTabSyn}——一种\textbf{强}化学习的\textbf{表}格数据\textbf{合}成流程,该流程在生成器训练过程中提供关于特征相关性保持的直接反馈。此目标激励生成器在训练数据有限时优先捕捉最具预测价值的信号,从而增强下游模型的实用性。我们基于该方法对语言模型生成器进行经验性微调,在样本量小、类别不平衡及分布偏移的基准测试中,ReTabSyn持续优于最新基线模型。此外,该方法可便捷扩展以控制合成表格数据的多方面属性,例如对生成观测值施加专家指定的约束。