What factors contribute to the relative success and corresponding difficulties of in-context learning for Large Language Models (LLMs)? Drawing on insights from the literature on human concept learning, we test LLMs on carefully designed concept learning tasks, and show that task performance highly correlates with the Boolean complexity of the concept. This suggests that in-context learning exhibits a learning bias for simplicity in a way similar to humans.

翻译：什么因素促成了大型语言模型（LLM）在上下文学习中相对的成功及相应的困难？借鉴人类概念学习文献中的见解，我们在精心设计的LLM概念学习任务上进行了测试，结果表明任务表现与概念的布尔复杂性高度相关。这表明上下文学习表现出类似于人类的简单性学习偏好。