We present a simple cross-lingual plagiarism detection method applicable to a large number of languages. The presented approach leverages open multilingual thesauri for candidate retrieval task and pre-trained multilingual BERT-based language models for detailed analysis. The method does not rely on machine translation and word sense disambiguation when in use, and therefore is suitable for a large number of languages, including under-resourced languages. The effectiveness of the proposed approach is demonstrated for several existing and new benchmarks, achieving state-of-the-art results for French, Russian, and Armenian languages.
翻译:我们提出了一种适用于多种语言的简单跨语言剽窃检测方法。该方法利用开放的多语种词库进行候选检索,并采用基于预训练多语言BERT的语言模型进行详细分析。该方法在使用时无需依赖机器翻译和词义消歧,因此适用于包括资源匮乏语言在内的多种语言。通过在多个现有及新建基准测试上的实验验证,该方法在法语、俄语和亚美尼亚语上达到了最先进的效果。