In this paper, we present Jellyfish, an open-source LLM as a universal task solver for DP. Built on the Llama 2 13B model, Jellyfish is instruction-tuned with the datasets of several typical DP tasks including error detection, data imputation, schema matching, and entity matching, and delivers generalizability to other tasks. Remarkably, Jellyfish can operate on a local, single, and low-priced GPU with its 13 billion parameters, ensuring data security and enabling further tuning. Its proficiency in understanding natural language allows users to manually craft instructions for DP tasks. Unlike many existing methods that heavily rely on prior knowledge, Jellyfish acquires domain knowledge during its tuning process and integrates optional knowledge injection during inference. A distinctive feature of Jellyfish is its interpreter, which elucidates its output decisions. To construct Jellyfish, we develop a series of pre-tuning and DP-tuning techniques. Jellyfish is equipped with an instance serializer, which automatically translates raw data into model prompts, and a knowledge injector, which optionally introduces task- and dataset-specific knowledge to enhance DP performance. Our evaluation of Jellyfish, using a range of real datasets, shows its competitiveness compared to state-of-the-art methods and its strong generalizability to unseen tasks. Jellyfish's performance rivals that of GPT series models, and its interpreter offers enhanced reasoning capabilities compared to GPT-3.5. Furthermore, our evaluation highlights the effectiveness of the techniques employed in constructing Jellyfish. Our model is available at Hugging Face: https://huggingface.co/NECOUDBFM/Jellyfish .

翻译：本文提出Jellyfish，一种面向数据预处理任务的开源通用大语言模型。该模型基于Llama 2 13B构建，通过误差检测、数据插补、模式匹配与实体匹配等典型数据预处理任务的数据集进行指令微调，并具备对其他任务的泛化能力。值得关注的是，Jellyfish凭借其130亿参数可在本地单块低价格GPU上运行，既保障数据安全又支持后续微调。其自然语言理解能力允许用户为数据预处理任务手动编写指令。与许多依赖先验知识的方法不同，Jellyfish在微调过程中获取领域知识，并在推理阶段集成可选择性知识注入。该模型的显著特色在于其内置解释器，可阐明输出决策机制。为构建Jellyfish，我们开发了一系列预微调与数据预处理微调技术。该模型配备实例序列化器（自动将原始数据转换为模型提示）与知识注入器（可选择性引入任务及数据集特定知识以增强数据预处理性能）。通过多组真实数据集的评估表明，Jellyfish在与最先进方法的竞争中展现出显著优势，同时对未见任务具有强泛化能力。其性能可与GPT系列模型相媲美，且解释器相较GPT-3.5具备更强的推理能力。此外，评估结果验证了构建Jellyfish所用技术的有效性。模型已发布于Hugging Face平台：https://huggingface.co/NECOUDBFM/Jellyfish。