Audio can disclose PII, particularly when combined with related text data. Therefore, it is essential to develop tools to detect privacy leakage in Contrastive Language-Audio Pretraining(CLAP). Existing MIAs need audio as input, risking exposure of voiceprint and requiring costly shadow models. We first propose PRMID, a membership inference detector based probability ranking given by CLAP, which does not require training shadow models but still requires both audio and text of the individual as input. To address these limitations, we then propose USMID, a textual unimodal speaker-level membership inference detector, querying the target model using only text data. We randomly generate textual gibberish that are clearly not in training dataset. Then we extract feature vectors from these texts using the CLAP model and train a set of anomaly detectors on them. During inference, the feature vector of each test text is input into the anomaly detector to determine if the speaker is in the training set (anomalous) or not (normal). If available, USMID can further enhance detection by integrating real audio of the tested speaker. Extensive experiments on various CLAP model architectures and datasets demonstrate that USMID outperforms baseline methods using only text data.

翻译：音频数据可能泄露个人身份信息，尤其在与相关文本数据结合时。因此，开发检测对比语言-音频预训练中隐私泄露的工具至关重要。现有成员推断攻击方法需要音频作为输入，存在声纹暴露风险且需训练代价高昂的影子模型。我们首先提出PRMID——一种基于CLAP概率排序的成员推断检测器，该方法无需训练影子模型，但仍需同时输入个体的音频与文本。为突破这些限制，我们进一步提出USMID——一种文本单模态说话人级成员推断检测器，仅通过文本数据查询目标模型。我们随机生成明显不属于训练数据的无意义文本，利用CLAP模型提取其特征向量，并基于此训练一组异常检测器。在推断阶段，将每个测试文本的特征向量输入异常检测器，以判断说话人是否属于训练集（异常）或非训练集（正常）。若条件允许，USMID可通过融合被测说话人的真实音频数据进一步提升检测性能。在不同CLAP模型架构与数据集上的大量实验表明，USMID在仅使用文本数据的情况下优于基线方法。