GenAI smartphones, which natively embed generative AI at the system level, are transforming mobile interactions by automating a wide range of tasks and executing UI actions on behalf of users. Their superior capabilities rely on continuous access to sensitive and context-rich data, raising privacy concerns that surpass those of traditional mobile devices. Yet, little is known about how users perceive the privacy implications of such devices or what safeguards they expect, which is especially critical at this early stage of GenAI smartphone adoption. To address this gap, we conduct 22 semi-structured interviews with everyday mobile users to explore their usage of GenAI smartphones, privacy concerns, and privacy design expectations. Our findings show that users engage with GenAI smartphones with limited understanding of how these systems operate to deliver functions, but show heightened privacy concerns once exposed to the technical details. Participants' concerns span the entire data lifecycle, including nontransparent collection, insecure storage, and weak data control. In a follow-up focus group, participants discuss a range of privacy-enhancing suggestions that call for coordinated changes across system-level controls, data management practices, and user-facing transparency. Their concerns and suggestions offer user-centered guidances for designing GenAI smartphones that balance functionality with privacy protection, offering valuable takeaways for system designers and regulators.

翻译：GenAI智能手机在系统层面原生嵌入生成式人工智能，通过自动执行各种任务并代表用户操作UI界面，正在改变移动交互方式。其卓越能力依赖于持续访问敏感且富含上下文的数据，这引发了超越传统移动设备的隐私担忧。然而，关于用户如何感知此类设备的隐私影响或他们期望何种保护措施，目前知之甚少，这在GenAI智能手机采用的早期阶段尤为关键。为填补这一空白，我们对22名普通移动用户进行了半结构化访谈，探究他们对GenAI智能手机的使用情况、隐私顾虑及隐私设计期望。我们的发现表明，用户在使用GenAI智能手机时，对其如何运作以提供功能的理解有限，但一旦接触技术细节，隐私担忧便会显著增强。参与者的担忧贯穿整个数据生命周期，包括不透明的收集、不安全的存储以及薄弱的数据控制。在后续的焦点小组中，参与者讨论了多种增强隐私的建议，呼吁在系统级控制、数据管理实践和面向用户的透明度方面进行协调变革。他们的担忧和建议为设计兼顾功能与隐私保护的GenAI智能手机提供了以用户为中心的指导，为系统设计者和监管者提供了宝贵的启示。