We present an extended Greek Dialectal Dataset (GRDD+) 1that complements the existing GRDD dataset with more data from Cretan, Cypriot, Pontic and Northern Greek, while we add six new varieties: Greco-Corsican, Griko (Southern Italian Greek), Maniot, Heptanesian, Tsakonian, and Katharevusa Greek. The result is a dataset with total size 6,374,939 words and 10 varieties. This is the first dataset with such variation and size to date. We conduct a number of fine-tuning experiments to see the effect of good quality dialectal data on a number of LLMs. We fine-tune three model architectures (Llama-3-8B, Llama-3.1-8B, Krikri-8B) and compare the results to frontier models (Claude-3.7-Sonnet, Gemini-2.5, ChatGPT-5).
翻译:我们提出了一个扩展的希腊方言数据集(GRDD+),该数据集在现有GRDD的基础上,补充了更多来自克里特、塞浦路斯、庞蒂克和北希腊的方言数据,同时新增了六种新的变体:希腊-科西嘉语、格里科语(南意大利希腊语)、马尼奥特语、赫普塔尼西亚语、察科尼亚语以及卡萨雷乌萨希腊语。最终构建的数据集总规模达6,374,939词,涵盖10种方言变体。这是迄今为止首个具有如此多样性和规模的数据集。我们进行了一系列微调实验,以探究高质量方言数据对多种大语言模型的影响。我们微调了三种模型架构(Llama-3-8B、Llama-3.1-8B、Krikri-8B),并将结果与前沿模型(Claude-3.7-Sonnet、Gemini-2.5、ChatGPT-5)进行了对比。