The whole slide image (WSI) classification is often formulated as a multiple instance learning (MIL) problem. Since the positive tissue is only a small fraction of the gigapixel WSI,existing MIL methods intuitively focus on identifying salient instances via attention mechanisms. However, this leads to a bias towards easy-to-classify instances while neglecting hard-to-classify instances.Some literature has revealed that hard examples are beneficial for modeling a discriminative boundary accurately.By applying such an idea at the instance level,we elaborate a novel MIL framework with masked hard instance mining (MHIM-MIL), which uses a Siamese structure (Teacher-Student) with a consistency constraint to explore the potential hard instances. With several instance masking strategies based on attention scores, MHIM-MIL employs a momentum teacher to implicitly mine hard instances for training the student model, which can be any attention-based MIL model.This counter-intuitive strategy essentially enables the student to learn a better discriminating boundary.Moreover, the student is used to update the teacher with an exponential moving average (EMA), which in turn identifies new hard instances for subsequent training iterations and stabilizes the optimization.Experimental results on the CAMELYON-16 and TCGA Lung Cancer datasets demonstrate that MHIM-MIL outperforms other latest methods in terms of performance and training cost. The code is available at:https://github.com/DearCaat/MHIM-MIL.

翻译：全切片图像（WSI）分类通常被构建为多实例学习（MIL）问题。由于阳性组织仅占千兆像素级WSI的一小部分，现有MIL方法直观地通过注意力机制聚焦于显著实例。然而，这导致模型偏向于易分类实例，而忽略了难分类实例。部分文献揭示，困难实例有助于精确建模判别边界。通过在实例层面应用这一思想，我们精心设计了一种新颖的带掩码困难实例挖掘的MIL框架（MHIM-MIL），该框架采用具有一致性约束的孪生结构（教师-学生）来探索潜在的困难实例。基于注意力分数的多种实例掩码策略，MHIM-MIL利用动量教师隐式挖掘困难实例以训练学生模型，该学生模型可为任意基于注意力的MIL模型。这种反直觉的策略本质上使学生能够学习到更优的判别边界。此外，学生模型通过指数移动平均（EMA）更新教师模型，进而为后续训练迭代识别新的困难实例并稳定优化过程。在CAMELYON-16和TCGA肺癌数据集上的实验结果表明，MHIM-MIL在性能和训练成本方面均优于其他最新方法。代码发布于：https://github.com/DearCaat/MHIM-MIL。