Since DARPA Grand Challenges (rural) in 2004/05 and Urban Challenges in 2007, autonomous driving has been the most active field of AI applications. Recently powered by large language models (LLMs), chat systems, such as chatGPT and PaLM, emerge and rapidly become a promising direction to achieve artificial general intelligence (AGI) in natural language processing (NLP). There comes a natural thinking that we could employ these abilities to reformulate autonomous driving. By combining LLM with foundation models, it is possible to utilize the human knowledge, commonsense and reasoning to rebuild autonomous driving systems from the current long-tailed AI dilemma. In this paper, we investigate the techniques of foundation models and LLMs applied for autonomous driving, categorized as simulation, world model, data annotation and planning or E2E solutions etc.

翻译：自2004/2005年DARPA大挑战赛（乡村道路）和2007年城市挑战赛以来，自动驾驶一直是人工智能应用最活跃的领域。近期，由大型语言模型（LLM）驱动的对话系统（如chatGPT和PaLM）相继涌现，并迅速成为自然语言处理（NLP）领域实现通用人工智能（AGI）的重要方向。这自然引发了一个思考：能否利用这些能力重构自动驾驶？通过将LLM与基础模型相结合，有望利用人类知识、常识和推理能力，将自动驾驶系统从当前长尾人工智能困境中重建。本文研究了应用于自动驾驶的基础模型和LLM技术，涵盖仿真、世界模型、数据标注与规划或端到端解决方案等类别。