Large language models (LLMs) are increasingly used in healthcare, education, public services, and everyday decision making. They should provide comparable assistance regardless of users' literacy, communication style, or prompt-engineering expertise. However, research on prompt robustness primarily focuses on adversarial attacks, prompt injection, and prompt optimization, overlooking whether semantically equivalent requests receive different responses simply because they are phrased differently. We call this accessibility challenge "Prompt Privilege": users with greater prompting expertise obtain better model performance despite expressing the same underlying intent. To address this problem, we propose the Prompt Equity Score (PES), a metric for evaluating performance consistency across user populations, and the Prompt Equity Transformer (PET), an LLM-based agent that automatically transforms user requests into semantically equivalent prompts while preserving their intent. PET shifts prompt optimization from users to AI systems, serving as an accessibility layer between users and foundation models. Experiments on MedQA reveal measurable prompt privilege, with statistically significant performance disparities between low-literacy and expert-prompting cohorts. Applying PET reduces these differences, with no pairwise cohort differences reaching statistical significance in our evaluation. These results suggest that accessibility-oriented prompt normalization can improve equitable AI access. By introducing prompt privilege as a new dimension of AI accessibility and PET as a practical solution, this work advances system-centered accessibility and provides a foundation for fairer, more trustworthy, and more inclusive AI systems.
翻译:暂无翻译