Background: Various factors determine analyst effectiveness during elicitation. While the literature suggests that elicitation technique and time are influential factors, other attributes could also play a role. Aim: Determine aspects that may have an influence on analysts' ability to identify certain elements of the problem domain. Methodology: We conducted 14 quasi-experiments, inquiring 134 subjects about two problem domains. For each problem domain, we calculated whether the experimental subjects identified the problem domain elements (concepts, processes, and requirements), i.e., the degree to which these domain elements were visible. Results: Domain element visibility does not appear to be related to either analyst experience or analyst-client interaction. Domain element visibility depends on how analysts provide the elicited information: when asked about the knowledge acquired during elicitation, domain element visibility dramatically increases compared to the information they provide using a written report. Conclusions: Further research is required to replicate our results. However, the finding that analysts have difficulty reporting the information they have acquired is useful for identifying alternatives for improving the documentation of elicitation results. We found evidence that other issues, like domain complexity, the relative importance of different elements within the domain, and the interview script, also seem influential.
翻译:背景:多种因素决定了分析师在需求获取过程中的有效性。尽管文献表明获取技术和时间是影响因素,但其他属性也可能发挥作用。目的:确定可能影响分析师识别问题领域特定要素能力的方面。方法:我们开展了14项准实验,针对两个问题领域询问了134名被试。针对每个问题领域,我们计算了实验被试是否识别出问题领域要素(概念、过程和需求),即这些领域要素的可见程度。结果:领域要素可见性似乎与分析师经验或分析师-客户互动无关。领域要素可见性取决于分析师如何提供所获取的信息:当被问及在需求获取过程中获得的知识时,与使用书面报告提供的信息相比,领域要素可见性显著提高。结论:需要进一步研究来复现我们的结果。然而,分析师难以报告其所获信息的这一发现,对于改进需求获取结果文档化的替代方案识别具有参考价值。我们发现证据表明其他因素,如领域复杂性、领域内不同要素的相对重要性以及访谈脚本,似乎也具有影响力。