Under the lens of Marr's levels of analysis, we critique and extend two claims about language models (LMs) and language processing: first, that predicting upcoming linguistic information based on context is central to language processing, and second, that many advances in psycholinguistics would be impossible without large language models (LLMs). We further outline future directions that combine the strengths of LLMs with psycholinguistic models.
翻译:基于Marr的分析层级视角,我们评述并延伸了关于语言模型(LMs)与语言加工的两项主张:其一,基于语境预测即将出现的语言信息是语言加工的核心;其二,若无大语言模型(LLMs),心理语言学的许多进展将无法实现。我们进一步勾勒了未来研究方向,即结合LLMs与心理语言学模型的优势。