Designed light is an established modality for live performance and music playback. Despite the growing availability of consumer smart lighting, the creation of designed light for music visualization remains limited to professional contexts due to time and skill constraints. To address this, we present an AI-assisted system for generating ambient light sequences for music videos. Informed by professional design heuristics, the system extracts salient features from source video and audio to generate an editable preliminary design of object based ambient light effect. We evaluated the system by comparing its autonomous output against hand-authored designs for three music videos. Findings from responses by 32 participants indicate that the initial output provides a viable baseline for further refinement by human authors. This work demonstrates the utility of AI-assisted workflows in supporting the creation and adoption of designed light beyond professional venues.
翻译:设计光照是现场表演和音乐播放的成熟表现形式。尽管消费级智能照明设备日益普及,但由于时间与技能限制,面向音乐可视化的设计光照创作仍局限于专业领域。为此,我们提出一种AI辅助系统,用于为音乐视频生成环境光序列。该系统基于专业设计启发式方法,从源视频与音频中提取显著特征,生成可编辑的基于物体的环境光效初步设计方案。我们通过将系统自主输出与三个音乐视频的人工设计进行对比来评估系统性能。32位参与者的反馈结果表明,初始输出为人工作者的进一步优化提供了可行的基准。本工作证明了AI辅助工作流程在支持设计光照创作及其向专业场所以外场景推广方面的实用价值。