We introduce TorchOpera, a compound AI system for enhancing the safety and quality of prompts and responses for Large Language Models. TorchOpera ensures that all user prompts are safe, contextually grounded, and effectively processed, while enhancing LLM responses to be relevant and high quality. TorchOpera utilizes the vector database for contextual grounding, rule-based wrappers for flexible modifications, and specialized mechanisms for detecting and adjusting unsafe or incorrect content. We also provide a view of the compound AI system to reduce the computational cost. Extensive experiments show that TorchOpera ensures the safety, reliability, and applicability of LLMs in real-world settings while maintaining the efficiency of LLM responses.

翻译：我们介绍TorchOpera，一种用于提升大语言模型提示与响应安全性与质量的复合AI系统。TorchOpera确保所有用户提示均安全、基于上下文且得到有效处理，同时增强大语言模型的响应，使其相关且高质量。TorchOpera利用向量数据库实现上下文锚定，基于规则的封装器进行灵活修改，并采用专门机制检测与调整不安全或不正确的内容。我们还提供了一种复合AI系统视图以降低计算成本。大量实验表明，TorchOpera在保持大语言模型响应效率的同时，确保了其在现实场景中的安全性、可靠性与适用性。