With rapid advances in generative artificial intelligence, the text-to-music synthesis task has emerged as a promising direction for music generation from scratch. However, finer-grained control over multi-track generation remains an open challenge. Existing models exhibit strong raw generation capability but lack the flexibility to compose separate tracks and combine them in a controllable manner, differing from typical workflows of human composers. To address this issue, we propose JEN-1 Composer, a unified framework to efficiently model marginal, conditional, and joint distributions over multi-track music via a single model. JEN-1 Composer framework exhibits the capacity to seamlessly incorporate any diffusion-based music generation system, \textit{e.g.} Jen-1, enhancing its capacity for versatile multi-track music generation. We introduce a curriculum training strategy aimed at incrementally instructing the model in the transition from single-track generation to the flexible generation of multi-track combinations. During the inference, users have the ability to iteratively produce and choose music tracks that meet their preferences, subsequently creating an entire musical composition incrementally following the proposed Human-AI co-composition workflow. Quantitative and qualitative assessments demonstrate state-of-the-art performance in controllable and high-fidelity multi-track music synthesis. The proposed JEN-1 Composer represents a significant advance toward interactive AI-facilitated music creation and composition. Demos will be available at https://www.jenmusic.ai/audio-demos.

翻译：随着生成式人工智能的快速发展，文本到音乐合成任务已成为从零开始生成音乐的一个有前景的方向。然而，对多轨生成的细粒度控制仍是一个开放挑战。现有模型具备强大的原始生成能力，但缺乏分轨创作并以可控方式组合的灵活性，这与人类作曲家的典型工作流程存在差异。为解决此问题，我们提出JEN-1 Composer，一个通过单一模型高效建模多轨音乐边际分布、条件分布与联合分布的统一框架。JEN-1 Composer框架能够无缝集成任何基于扩散的音乐生成系统（例如Jen-1），增强其实现多样多轨音乐生成的能力。我们引入一种课程训练策略，旨在逐步引导模型从单轨生成过渡到灵活的多轨组合生成。在推理阶段，用户能够迭代生成并选择符合偏好的音乐轨道，随后遵循所提出的“人机协作创作”工作流程，逐步构建完整的音乐作品。定量与定性评估表明，该方法在可控且高保真的多轨音乐合成中达到了最先进性能。所提出的JEN-1 Composer代表了向交互式人工智能辅助音乐创作与谱写的重要进展。示例音频将发布于https://www.jenmusic.ai/audio-demos。