The fundamental problem in toxicity detection task lies in the fact that the toxicity is ill-defined. Jigsaw, a unit within Google and one of the leaders in the field, uses a definition of toxicity given by Dixon et al. - 'rude, disrespectful, or unreasonable language that is likely to make someone leave a discussion'. One can instantly see the issue with this definition, as it gives no quantitative measure of the toxicity and operates with highly subjective cultural terms. Despite all vagueness and flaws, this definition is de-facto widely used by many researchers. In this work we suggest quantative stress-based defenition for the toxicity that overcomes existing shortcomings.
翻译:毒性检测任务的根本问题在于毒性的定义不明确。Jigsaw是谷歌旗下在该领域的领先团队之一,其采用的毒性定义由Dixon等人提出,即“可能使某人退出讨论的粗鲁、无礼或不合理的语言”。人们可以立即发现这一定义的问题,因为它没有提供毒性的量化指标,并且依赖于高度主观的文化术语。尽管存在模糊性和缺陷,这一定义实际上被许多研究者广泛使用。在本研究中,我们提出了一种基于压力的量化毒性定义,以克服现有缺陷。