Recent language models have made tremendous progress in the structured data to text generation task. However, these models still give sub-optimal performance where logical inference is required to generate the descriptions. In this work, we specifically focus on analytical text generation from structured data such as tables. Building on the taxonomy proposed in (Gupta et al., 2020) we focus on controllable table to text generation for the following reasoning categories: numerical reasoning, commonsense reasoning, temporal reasoning, table knowledge, and entity knowledge. We propose STOAT model, which is table and reasoning aware, with vector-quantization to infuse the given reasoning categories in the output. We observe that our model provides 10.19%, 1.13% improvement on the PARENT metric in iToTTo and Infotabs for the analytical sentence task. We also found that our model generates 15.3% more faithful and analytical descriptions as compared to the baseline models in human evaluation. We curate and release two reasoning category annotated table-to-interesting text generation datasets based on the ToTTo (Parikh et al., 2020) and InfoTabs datasets (Gupta et al.,2020).
翻译:近期语言模型在结构化数据到文本生成任务上取得了显著进展,但在需要逻辑推理生成描述的场景中仍表现欠佳。本研究聚焦于从表格等结构化数据生成分析文本。基于Gupta等人(2020)提出的分类体系,我们针对以下推理类别展开可控表格到文本生成研究:数值推理、常识推理、时态推理、表格知识及实体知识。我们提出STOAT模型,该模型具备表格感知与推理感知能力,并通过向量量化技术将指定推理类别融入输出结果。实验表明,在iToTTo和InfoTabs数据集的分析语句任务中,我们的模型在PARENT指标上分别获得10.19%和1.13%的提升。人工评估显示,相较基线模型,我们的模型生成的描述在忠实度和分析性上提升15.3%。我们基于ToTTo(Parikh等人,2020)和InfoTabs(Gupta等人,2020)数据集整理并发布了两个带推理类别标注的表格到趣味文本生成数据集。