Large Language Models (LLMs) went from non-existent to ubiquitous in the machine learning discourse within a few years. Due to the fast pace of the field, it is difficult to identify the remaining challenges and already fruitful application areas. In this paper, we aim to establish a systematic set of open problems and application successes so that ML researchers can comprehend the field's current state more quickly and become productive.

翻译：大语言模型（LLMs）在短短几年内从无到有，迅速成为机器学习领域讨论中无处不在的话题。由于该领域发展迅速，难以明确识别尚存的挑战与已产生丰硕成果的应用领域。本文旨在系统性地梳理一组未解决的问题与应用成功案例，以便机器学习研究人员能够更快速地把握该领域的现状，并高效开展研究工作。