Online communities develop distinct norms for content they collectively value, yet it remains unclear whether current language models can recognize locally valued contributions in context. We formalize this as \textbf{community-conditioned preference prediction} and introduce \textsc{Vastu} (\underline{V}alue-\underline{A}ware \underline{S}ocial \underline{Tu}ning), a benchmark of 75,000 Reddit comments from 15 communities spanning Gaming, Science, Q\&A, Advice, and Politics. We evaluate four model families---prompted LLMs, LoRA-adapted SLMs, supervised encoders, and feature-based classifiers---across global, local, and context-conditioned settings. Our central finding is that parametric adaptation consistently outperforms prompting: supervised encoders reach 0.74 AUROC and fine-tuned SLMs 0.64--0.71, while the best prompted result is only 0.62. This gap is not merely quantitative---vanilla prompting yields over 80\% false-negative rates, systematically discarding content communities actually value. Conversational context narrows but does not close this divide. Together, these results suggest that local preference recognition requires community-specific training signal, not just better prompting. Our work supports future research on community-aware reward modeling, feed curation, and positive moderation.
翻译:暂无翻译