To evaluate how developers perform differently in solving programming tasks, i.e., which actions and behaviours are more beneficial to them than others and if there are any specific strategies and behaviours that may indicate good versus poor understanding of the task and program given to them, we used the MIMESIS plug-in to record developers' interactions with the IDE. In a series of three studies we investigated the specific behaviour of developers solving a specific programming task. We focused on which source code files they visited, how they related pieces of code and knowledge to others and when and how successful they performed code edits. To cope with the variety of behaviours due to interpersonal differences such as different level of knowledge, development style or problem solving stratiegies, we used an abstraction of the observed behaviour, which enables for a better comparison between different individual attributes such as skill, speed and used stratiegies and also facilitates later automatic evaluation of behaviours, i.e. by using a software to react to.
翻译:为了评估开发者在解决编程任务时的表现差异,即哪些行为和策略对他们更有益,以及是否存在特定策略与行为可表明他们对任务和给定程序的理解程度优劣,我们使用MIMESIS插件记录了开发者与集成开发环境(IDE)的交互。通过三项系列研究,我们调查了开发者在解决特定编程任务时的具体行为,重点关注他们访问了哪些源代码文件、如何将代码片段与知识相互关联,以及何时以及如何成功完成代码编辑。为应对因个体差异(如知识水平、开发风格或问题解决策略不同)导致的行为多样性,我们对观察到的行为进行了抽象化处理,这不仅能更好地比较技能、速度和所用策略等个体属性,也便于后续通过软件等方式实现行为的自动化评估。