Data entry forms use completeness requirements to specify the fields that are required or optional to fill for collecting necessary information from different types of users. However, some required fields may not be applicable for certain types of users anymore. Nevertheless, they may still be incorrectly marked as required in the form; we call such fields obsolete required fields. Since obsolete required fields usually have not-null validation checks before submitting the form, users have to enter meaningless values in such fields in order to complete the form submission. These meaningless values threaten the quality of the filled data. To avoid users filling meaningless values, existing techniques usually rely on manually written rules to identify the obsolete required fields and relax their completeness requirements. However, these techniques are ineffective and costly. In this paper, we propose LACQUER, a learning-based automated approach for relaxing the completeness requirements of data entry forms. LACQUER builds Bayesian Network models to automatically learn conditions under which users had to fill meaningless values. To improve its learning ability, LACQUER identifies the cases where a required field is only applicable for a small group of users, and uses SMOTE, an oversampling technique, to generate more instances on such fields for effectively mining dependencies on them. Our experimental results show that LACQUER can accurately relax the completeness requirements of required fields in data entry forms with precision values ranging between 0.76 and 0.90 on different datasets. LACQUER can prevent users from filling 20% to 64% of meaningless values, with negative predictive values between 0.72 and 0.91. Furthermore, LACQUER is efficient; it takes at most 839 ms to predict the completeness requirement of an instance.
翻译:数据录入表单通过完整性要求来规定不同用户类型需填写的必填或可选字段,以收集必要信息。然而,某些必填字段可能不再适用于特定用户群体,仍被错误标记为必填项——我们将此类字段称为“过时必填字段”。由于过时必填字段在提交表单前通常设有非空验证检查,用户必须输入无意义的值才能完成提交,此类无意义数据会威胁填写质量。现有技术通常依赖人工编写规则识别过时必填字段并松弛其完整性要求,但存在效率低下且成本高昂的问题。本文提出LACQUER——一种基于学习的自动化方法,用于松弛数据录入表单的完整性要求。LACQUER通过构建贝叶斯网络模型,自动学习用户被迫填写无意义值的条件。为提升学习能力,LACQUER识别仅适用于小规模用户群体的必填字段案例,并采用过采样技术SMOTE生成该类字段的更多实例,从而有效挖掘字段间的依赖关系。实验结果表明:在不同数据集上,LACQUER能够以0.76至0.90的精确度精准松弛数据录入表单中必填字段的完整性要求;可阻止20%至64%的无意义值填写,阴性预测值介于0.72至0.91之间;且算法高效,预测单个实例的完整性要求耗时最多仅需839毫秒。