Foundation models (FMs), such as Large Language Models (LLMs), have revolutionized software development by enabling new use cases and business models. We refer to software built using FMs as FMware. The unique properties of FMware (e.g., prompts, agents, and the need for orchestration), coupled with the intrinsic limitations of FMs (e.g., hallucination) lead to a completely new set of software engineering challenges. Based on our industrial experience, we identified 10 key SE4FMware challenges that have caused enterprise FMware development to be unproductive, costly, and risky. In this paper, we discuss these challenges in detail and state the path for innovation that we envision. Next, we present FMArts, which is our long-term effort towards creating a cradle-to-grave platform for the engineering of trustworthy FMware. Finally, we (i) show how the unique properties of FMArts enabled us to design and develop a complex FMware for a large customer in a timely manner and (ii) discuss the lessons that we learned in doing so. We hope that the disclosure of the aforementioned challenges and our associated efforts to tackle them will not only raise awareness but also promote deeper and further discussions, knowledge sharing, and innovative solutions across the software engineering discipline.

翻译：基础模型（如大型语言模型）通过赋能新用例和商业模式，彻底革新了软件开发。我们将基于基础模型构建的软件称为FMware。FMware的独有特性（如提示词、智能体及编排需求）结合基础模型的内在局限（如幻觉），催生了一系列全新的软件工程挑战。基于我们的工业实践经验，我们识别出10项关键的SE4FMware挑战，这些挑战导致企业级FMware开发低效、高风险且成本高昂。本文详细探讨了这些挑战，并阐述了我们所构想的创新路径。随后，我们介绍了FMArts——这是一个长期项目，旨在打造覆盖FMware工程全生命周期的可信平台。最后，我们（i）展示了FMArts的独特特性如何助力我们及时为大型客户设计开发复杂的FMware，以及（ii）讨论了过程中的经验教训。我们期望通过公开上述挑战及应对举措，不仅能提升行业认知，更能促进软件工程领域更深入、更广泛的讨论、知识共享与创新解决方案的涌现。