Online scams often unfold gradually through interaction, yet existing detection systems predominantly rely on snapshot-based signals and interruptive warnings, revealing two research gaps in the lack of signals that represent scam risk within conversational dynamics and the underexplored design of non-interruptive interaction. To address these gaps, we introduce multi-level alignment-based hints, informed by the Interactive Alignment Model, as a new detection signal for supporting sensemaking in scam-related conversations. These hints operationalize low-level lexical and syntactic alignments and high-level semantic and situation-model alignments between conversational participants, making conversational dynamics visible to users. We first conduct a preliminary evaluation on real-life scam dialogues, showing that as conversations approach scam attempts, low-level alignment scores remain stable while high-level alignment scores systematically decline, revealing a consistent cross-level pattern indicative of scam progression. Building on this insight, we conduct a user study with thirty participants, indicating that relative to the no-hint baseline, multi-level alignment-based hints increase precision by 0.25, recall by 0.16, and F1 score by 0.21, yielding substantially larger gains than the marginal improvements achieved by keyword-triggered alerts. Statistical analyses reveal that the proposed hints support earlier and more stable confidence formation over time, with ablation results further highlighting the effectiveness of combining alignment hints across levels in achieving these advantages.
翻译:在线诈骗通常通过逐步交互展开,然而现有检测系统主要依赖快照式信号和中断性警告,揭示了两个研究空白:缺乏表征对话动态中诈骗风险的信号,以及非中断式交互设计的探索不足。为解决这些问题,我们基于交互对齐模型引入多层级对齐提示,作为支持诈骗相关对话意义构建的新型检测信号。这些提示将对话参与者之间的低层词汇和句法对齐、高层语义和情境模型对齐操作化,使用户能够感知对话动态。我们首先对真实诈骗对话进行初步评估,结果显示:当对话接近诈骗企图时,低层对齐得分保持稳定,而高层对齐得分系统性下降,揭示出指示诈骗进程的跨层级一致性模式。基于此发现,我们开展了一项包含三十名参与者的用户研究,结果表明:与无提示基线相比,基于多层级对齐的提示将精确率提升0.25、召回率提升0.16、F1得分提升0.21,其提升幅度显著大于关键词触发警报带来的边际改进。统计分析显示,所提出的提示能支持用户更早形成更稳定的信心,而消融实验结果进一步凸显了跨层级对齐提示组合在实现这些优势中的有效性。