Why I Left Google DeepMind
358 points
• 1 day ago
• Article
Link
Alex Turner 解释了自己从 Google DeepMind 辞职的原因,源于 2026 年初发生的一系列事件。 Department of Homeland Security 的特工在致人死亡事件后,他发现 Google 向该机构提供云服务,从而对科技公司参与政府行动感到越来越不安。特别是在 Pentagon 向 Anthropic 等公司施压,要求签署在致命性自主武器和大规模监控方面几乎不设限制的军事 AI 合同时,他认为这是 AI 业界划定伦理底线的关键时刻,但许多知名人士和组织并未明确表态,这让他深感失望。
Turner 一开始试图在公司内部推动改变,并动员有影响力的 AI 研究人员。他曾尝试与 Stuart Russell(长期致力于反对自主武器)和 Yoshua Bengio 等人接触。尽管这些人在公众面前以重视 AI 安全著称,Turner 认为在面对来自 U.S. government 的具体且高风险的政治压力时,他们未能采取实质性行动。 Turner 对 International Association for Safe and Ethical AI (iaseai) 尤为失望,认为该组织未能兑现支持 Anthropic 拒绝不道德合同条款的承诺。
在公司内部,Turner 向 Google 领导层游说,主张对政府合同建立一套有原则、约束力强的框架。他获得了同事广泛支持,在致 Jeff Dean(Google Chief Scientist)的一封请愿书上收集了超过 250 个签名。 Turner 希望通过增加内部成本并提出清晰、合乎伦理的替代方案,迫使公司在签署无限制军事协议时优先考虑其公开宣示的 AI 原则。他甚至与 Jeff Dean 进行了直接会面,希望借此争取其在反对 Pentagon 最后通牒中的领导作用。
尽管有这些努力,Google 最终仍与 Pentagon 签署了一份机密协议,允许将相关技术用于"任何合法的政府目的",但在防止自主武器或大规模监控方面几乎没有具有约束力的保护条款。 Turner 认为,Google 的领导层,包括此前曾签署反对致命性自主武器承诺的高层,最终将政治权宜和公司利益置于所宣称的道德承诺之上。他注意到 Demis Hassabis 和其他高管在协议签署后仍留任,这让他判断公司管理层奉行的"参与决策(seat at the table)"策略并未带来实质性的伦理护栏。
在耗尽了所有内部影响途径后,Turner 认为自己已无法凭良心继续在该公司工作。他认为 Google DeepMind 的内部治理实践以失败告终,原因在于追逐利润和对政治报复的恐惧最终压倒了组织的道德承诺。协议签署后他选择辞职,认为要实现真正改变需要有打破既有界限的勇气,并且仅依赖有权势领导人的私人道德承诺而缺乏制度化的执行,无法有效应对存在性的 AI 风险。
Alex Turner explains his reasons for resigning from Google DeepMind, stemming from a series of events in early 2026. Following the killing of citizens by Department of Homeland Security agents, Turner discovered that Google provided cloud services to the agency. He grew increasingly concerned about the tech industry's involvement in government operations, particularly when the Pentagon pressured companies like Anthropic to sign contracts for military AI without restrictions on lethal autonomous weapons or mass surveillance. Turner viewed this as a critical moment for the AI industry to establish ethical boundaries, yet he found that prominent figures and organizations often failed to take a stand.
Turner initially sought to influence change by working within Google and by mobilizing influential AI researchers. He attempted to engage leaders such as Stuart Russell, who had built a long career campaigning against autonomous weapons, and Yoshua Bengio. Despite their public reputations for prioritizing AI safety, Turner felt these luminaries avoided taking meaningful action when faced with specific, high-stakes political pressure from the U.S. government. Turner was particularly disappointed by the International Association for Safe and Ethical AI (iaseai), which he believes failed to fulfill its promise to support Anthropic's right to refuse unethical contract terms.
Internally, Turner lobbied Google leadership to adopt a robust, principled framework for government contracts. He garnered significant support from colleagues, collecting over 250 signatures on a petition addressed to Jeff Dean, Google's Chief Scientist. Turner hoped that by creating internal costs and presenting a clear, ethically sound counteroffer, he could force the company to prioritize its stated AI principles over the pressure to sign unrestricted military deals. He even held a direct meeting with Jeff Dean, hoping to secure his leadership in opposing the Pentagon's ultimatum.
Despite these efforts, Google ultimately signed a classified agreement with the Pentagon, allowing for "any lawful government purpose" with few binding protections against autonomous weaponry or mass surveillance. Turner felt that Google's leadership, including those who had previously signed pledges against lethal autonomous weapons, prioritized political expediency and corporate interests over their stated ethical commitments. He observed that Demis Hassabis and other senior figures remained at the company even after the deal was signed, leading Turner to conclude that the "seat at the table" strategy favored by management had failed to produce meaningful ethical guardrails.
Having exhausted his internal avenues for influence, Turner decided he could no longer work for the company in good conscience. He argues that the internal governance experiment at Google DeepMind failed because the pressure for profit and the fear of political retribution ultimately outweighed the organization's moral commitments. Following the signing of the deal, Turner chose to resign, believing that real change requires a willingness to break established boundaries and that relying on the private ethical pledges of powerful leaders without institutional enforcement is an insufficient strategy for mitigating existential AI risk.
166 comments • Comments Link
一位人工智能(AI)研究员因辞职而广受赞誉,许多人把这视为在一个常被质疑道德底线的行业中罕见且勇敢的正直之举。
围绕 AI 在军事领域的应用存在重大争议。反对者认为自动化系统缺乏做出生死决策所需的人类问责机制,且有可能被用于扩大侵犯人权的行为;支持者则认为更先进的技术理论上能提高判断准确性、将附带损害降到最低,并将其类比于自动驾驶带来的安全收益。
人们对政府和企业领导常用的"定时炸弹"论调感到不安,认为这是一种试图绕过伦理审查和内部红线协议的说辞,并被用来将反对声音塑造成妨碍国家安全的行为。
企业员工常在职业生存与个人价值观之间挣扎,导致一些人在雇主行为与自身伦理标准发生冲突时感到被困。关于个人抗议的有效性仍有争论——有人认为必须通过集体行动或系统性变革才能产生影响,而另一些人坚持认为基于原则的个人拒绝是挑战既定权力的重要第一步。
对现代军事 AI 的可靠性依然存在怀疑,批评者指出当前自动系统的失败案例,并批评开发者倾向于将可能造成严重伤害的错误视为轻微的技术问题。
在移民与边境执法问题上意见分歧严重:一些参与者强调法治与国家主权,另一些则关注现行执法政策带来的人道主义后果。有人认为,当代企业更倾向于优先考虑与政府的政治与联邦合作而非道德立场,导致内部的伦理承诺在面临有利可图的政府合同时基本失效。
批评那位辞职研究员做法的人则认为,过分关注高层企业头衔会忽视更深层的系统性激励结构——这些问题多年来一直是劳工组织关注的重点。
这场讨论反映出人们对科技在全球冲突中作用的担忧,以及在大型跨国公司内部个人能动性逐渐丧失的深层焦虑。尽管许多人对将伦理原则置于职业稳定之上的人表示由衷敬意,但参与者对于在巨大的经济与政治压力下,个体举报是否真的能改变企业或政府策略仍存在分歧。归根结底,这场对话突显了人们对科技行业"行善"理念的日益幻灭,因该行业正越来越多地与国家权力和军事目标结盟。 • An AI researcher is being widely commended for resigning from their position, with many viewing it as a rare and courageous act of moral integrity in an industry often seen as ethically compromised.
• Significant debate exists regarding AI in military applications, with opponents arguing that automated systems lack the human accountability necessary for life-or-death decisions and risk being used to scale human rights abuses.
• Proponents of AI in defense suggest that superior technology could theoretically increase accuracy and minimize collateral damage, comparing it to the safety gains seen in autonomous driving.
• Concerns were raised regarding the "ticking time bomb" rhetoric often used by government and corporate leaders to bypass ethical oversight and internal red-line agreements, framing such resistance as a barrier to national security.
• Corporate employees frequently grapple with the tension between professional survival and personal values, leading some to feel trapped when their employer's actions conflict with their ethical standards.
• The effectiveness of individual protests remains a point of contention, with some arguing that collective action or systemic change is necessary, while others maintain that an individual's principled refusal is a vital first step in challenging entrenched power.
• Skepticism persists regarding the reliability of modern military AI, with critics pointing to failures in current autonomous systems and the tendency of developers to dismiss harmful errors as minor technical bugs.
• Perspectives on immigration and border enforcement reveal a sharp divide, with some participants emphasizing the rule of law and national sovereignty, while others focus on the humanitarian consequences of current enforcement policies.
• The argument was made that modern corporations prioritize political and federal cooperation over moral stances, rendering internal ethics pledges largely ineffective when they conflict with lucrative government contracts.
• Critics of the departing researcher's approach suggested that focusing on high-level corporate titles overlooks deeper, systemic incentive structures that have been targeted by labor organizers for years.
The discussion reflects a deep anxiety regarding the role of technology in global conflict and the erosion of individual agency within massive, multinational corporations. While there is a strong sentiment of respect for those who prioritize ethical principles over career stability, the participants remain divided on whether individual whistleblowing can truly shift corporate or government strategy in the face of immense economic and political pressures. Ultimately, the conversation highlights a growing disillusionment with the tech industry's "do-good" ethos as it increasingly aligns with state power and military objectives.