$100 AI Music Video: Claude Fable 5 vs. GPT-5.6 Sol
为了探索最前沿模型在复杂创意任务中的能力,研究人员让 Claude Fable 5 和 GPT-5.6 Sol 执行一项自主的长期项目:为 Bruno Mars 和 Mark Ronson 的 Uptown Funk 指导整部音乐视频。每个模型都获得了限定预算、网络搜索权限、本地 ffmpeg 工具以及一组生成视频的 API 。模型独立运行,自行负责调研、图像生成、片段筛选与最终剪辑。
结果显示两款模型在策略上存在显著差异。四次实验中有三次完全依赖文本到视频生成,但在 $25 预算下,GPT-5.6 Sol 采用了更有创意的图像到视频流程:先生成静帧,再对其动画化。 $100 预算下的 GPT-5.6 Sol 则通过混合三个不同视频模型的输出,表现出更大的多样性。相比之下,Claude Fable 5 虽然成本更高但运行更快,并且每次基本只使用单一的生成模型。
尽管具备自主性,模型仍遭遇明显的创意瓶颈。没有一个生成作品在角色一致性或叙事连贯性上表现良好,人物常在镜头间产生漂移;模型倾向于过度字面化地解读歌词,导致视觉表现重复或突兀,并且难以将画面运动的节奏与音乐节拍对齐。它们的自我批评与迭代编辑能力也很有限:一旦生成片段,代理通常便直接拼接成片,不会停下来修正或剔除低质量素材。
总体而言,实验表明,尽管当前的前沿模型能在复杂的多步骤工具调用流程中完成并交付成品,但它们仍缺乏人类导演的风格把控与自我反思能力。 $100 的预算本可提供更多发挥空间,表明模型错过了使用更复杂手段的机会,比如在动画前先生成一致的角色参考。尽管这些自主系统已经能产出可用的视频,但自动生成与真正引人入胜的创意叙事之间的差距依然显著。
To explore the capabilities of frontier-level AI in complex creative tasks, researchers tasked Claude Fable 5 and GPT-5.6 Sol with an autonomous, long-horizon project: directing a complete music video for Bruno Mars and Mark Ronson's Uptown Funk. Each model was provided with a specific dollar budget, access to web search, local ffmpeg tools, and a set of generative video APIs. The models operated independently, making their own decisions about research, image generation, clip selection, and final editing.
The results revealed significant differences in strategy between the models. While three of the four runs relied exclusively on text-to-video generation, the GPT-5.6 Sol model at the $25 budget level took a more inventive approach by utilizing an image-to-video pipeline, where it generated stills before animating them. Additionally, the $100 GPT-5.6 Sol run demonstrated greater variety by mixing outputs from three distinct video models. In contrast, Claude Fable 5 proved to be a more expensive, though faster, operator that largely stuck to a single generative model per run.
Despite their autonomy, the models faced notable creative hurdles. None of the outputs achieved high levels of character consistency or a coherent narrative, with characters often drifting between shots. The models frequently interpreted song lyrics with excessive literalism, leading to repetitive or jarring visual choices, and struggled to synchronize the tempo of the visual motion with the rhythm of the music. Furthermore, the models showed a limited capacity for self-criticism or iterative editing. Once the clips were generated, the agents largely proceeded to concatenation without pausing to refine their work or discard low-quality footage.
Ultimately, the experiment highlighted that while current frontier models can successfully navigate a complex, multi-step tool-calling loop to produce a finished product, they still lack the stylistic nuance and self-reflective capabilities of a human director. The $100 budget provided more headroom than the models effectively utilized, suggesting that they missed opportunities to employ more sophisticated techniques, such as generating consistent character references prior to animation. While these autonomous systems have reached a point where they can deliver a functional video, the gap between automated generation and truly compelling creative storytelling remains substantial.
411 comments • Comments Link
• 目前 AI 生成的音乐视频常被批评为缺乏艺术意图与灵魂、叙事零散,被称为"grey goo",主要只是对歌词的字面化和平庸的视觉呈现。
• 尽管底层技术近年来进步显著,但其产出常被斥为"AI slop"——表现出令人不适的近似视觉、与节奏不同步,以及重复、缺乏创意的套路。
• 重视人类背景、挣扎与创作意图的艺术观,与优先看重技术能力与创作工具民主化(不论是否有传统艺术血统)的观点之间,存在明显张力。
• AI 模型对歌词进行通俗直译式的意象解读,被拿来与那些通过隐喻、叙事弧线和风格化晦涩手法提升原始素材的标志性音乐视频形成鲜明对比。
• 一些观察者认为,即便这些作品在艺术上被视为拙劣或难以观看,作为测试性技术——即 agent 编排的实验——它们仍可视为成功。
• 与其追求无缝的逼真,不如拥抱 AI 固有的"怪异感"或故障美,这被认为更有可能创作出有说服力的 AI 辅助艺术。
• 怀疑者认为,推进自动化与大规模内容生产会导致文化商品化,用迎合短注意力的廉价"中庸"内容取代有意义且以人为本的创造工作。
• 业内有人指出,音乐视频在很大程度上已沦为社交媒体上的一次性"视觉口香糖",显示出该类内容的专业标准正在下降。
• 有人把这与 Autotune 或数字 VFX 等技术的出现相类比,指出各行业在找到成熟艺术应用之前,常会经历一段衍生性滥用的时期。
• 关于缺乏人类意图的创作是否能称为"艺术",哲学争论仍在。有观点认为艺术由观众的接受度决定,而非由创作者的身份决定。
这场讨论反映了快速演进的技术能力与创造性表达本质之间的深刻分歧。尽管多数人承认视频生成技术进步惊人,但普遍认为,目前自动化"agent"工作流产出的多为缺乏灵魂的衍生内容,未达到参与艺术创作所需的基本标准。反复出现的张力在于:一方将这些成果视为 AI 工具编排的技术里程碑,另一方则担心完全剥离人类能动性和策划会带来空洞的"停滞时代"。这场讨论折射出对未来的焦虑:市场可能被自动化、廉价的内容充斥,数量被置于优先,而非定义有意义艺术的人类叙事与工艺。 • Current AI-generated music videos are criticized as "grey goo" that lack artistic intent, soul, and coherent storytelling, serving primarily as literal, banal visual interpretations of lyrics.
• While the underlying technology is technically impressive compared to recent years, the output is frequently described as "AI slop" due to its uncanny valley visuals, lack of rhythm synchronization, and repetitive, uninspired tropes.
• A clear tension exists between those who value art for its human context, struggle, and intentionality and those who prioritize technical capability and the democratization of creative tools regardless of traditional artistic pedigree.
• The "literalism" of AI models—interpreting lyrics through generic imagery—is often contrasted unfavorably against iconic music videos that use metaphor, narrative arcs, and stylistic obscurity to elevate the source material.
• Some observers suggest that these projects are successful as technical "agent" experiments testing tool orchestration, even if the artistic result is considered abysmal or unwatchable.
• Leaning into the inherent "weirdness" or glitchiness of AI, rather than striving for seamless realism, is identified as a more viable strategy for creating compelling AI-assisted art.
• Skeptics argue that the push toward automated, mass-produced content threatens to commodify culture, replacing meaningful, human-led creative work with cheap, "mid" content that appeals to shortened attention spans.
• The industry argument is raised that music videos have largely become disposable "visual chewing gum" for social media, suggesting that professional standards for such content are declining anyway.
• Parallels are drawn to the emergence of other technologies like Autotune or digital VFX, noting that industries often go through cycles of derivative misuse before finding a mature, artistic application.
• Philosophical debate remains regarding whether a creation is "art" if it lacks human intention, with some arguing that art is defined by the viewer's reception rather than the provenance of the creator.
The discussion reflects a deep divide regarding the intersection of rapid technological capability and the nature of creative expression. While many participants acknowledge the staggering pace of progress in video generation, there is a strong consensus that current automated "agent" workflows produce soulless, derivative content that fails to meet basic standards of artistic engagement. A recurring tension appears between those who view these outputs as technical milestones of AI tool orchestration and those who believe the total removal of human agency and curation results in a hollow "Age of the Plateau." Ultimately, the thread captures the anxiety surrounding a potential future where the marketplace is flooded with automated, cheap content that prioritizes volume over the human narrative and craftsmanship that historically define meaningful art.