为AI训练破坏性扫描珍本
TECH

为AI训练破坏性扫描珍本

31+
Signals

战略概览

  • 01.
    破坏性扫描是指使用液压切割机切断书籍的书脊,使散页能够通过高速扫描仪(每分钟处理80至120页),随后原始副本被粉碎并回收。
  • 02.
    Anthropic在2024年初启动了一项名为‘Project Panama’的秘密内部计划,旨在为AI训练进行破坏性书籍扫描,一份内部文件显示该公司希望将该计划保密。
  • 03.
    2025年6月,威廉·阿尔斯普法官裁定,将合法购买的纸质书籍数字化用于大语言模型训练属于合理使用;但同时裁定Anthropic保留来自LibGen等网站的盗版书籍不属于合理使用,导致2026年7月批准了一项15亿美元的和解协议。
  • 04.
    ISBNdb曾明确以‘合规路径’为名,向市场推广1,000至100万册图书的大宗采购服务,专为LLM训练需求设计;但后来向《财富》杂志表示,该服务从未上线,也从未为AI公司购买或扫描过书籍。
  • 05.
    Zoom Books是一家自称图书回收商的加拿大公司,已被荷兰、德国、澳大利亚和新西兰的二手书商指认为异常大宗订单的来源;该公司否认对书籍进行数字化,并拒绝透露其客户身份。
  • 06.
    Anthropic已公开否认其数据获取项目从Zoom Books购书或销毁稀有或古籍类书籍,称其通过常规商业市场购买书籍。

深度分析

揭秘‘Project Panama’:Anthropic不希望被发现的备忘录

2026年初解封的法庭文件显示,自2024年初以来,Anthropic一直在秘密推进一项代号为‘Project Panama’的大规模图书收购计划,用于AI训练。该公司聘请了前Google Books合作伙伴负责人汤姆·特维(Tom Turvey)来主导与分销商和零售商的接洽,内部供应商提案讨论了在六个月内转换50万至200万册书籍的计划[1]。这些文件引人注目的不仅是其规模,更是其中的坦率表述:一份内部规划文件明确写道:‘Project Panama是我们努力扫描世界上所有书籍的项目’,紧接着是一条明确指示:‘我们不希望外界知道我们正在做这件事’[2]

这一内部承认与其公开立场形成了尴尬对比。该公司曾向记者表示,其通过常规商业市场购买书籍,且其任何数据获取项目均未收购或销毁稀有或古籍类书籍[3]。泄露备忘录中围绕保密的设计与公开声明中围绕安抚公众的说辞之间的巨大差距本身就是一个故事——并非因为背后‘购买+扫描’的法律模式违法,而是因为构建该模式的公司显然早已预见到如今面临的舆论反弹。

销毁副本才是关键:合理使用如何依赖碎纸机

这一切的法律基础源于2025年6月威廉·阿尔斯普法官在Bartz诉Anthropic案中的裁决,该裁决将公司的图书获取行为分为截然不同的两类。将合法购买的纸质书籍数字化并用于训练被视为具有转化性,受合理使用保护;而保留由盗版电子书构成的图书馆则不然,这一区别使Anthropic支付了15亿美元的和解金,涵盖超过40万部注册作品,平均每部约3,000美元,这是有史以来最大的版权和解金额,于2026年7月最终确定[4]

正是这一法律架构使得物理销毁成为核心环节而非附带结果。液压切割机切断所购书籍的书脊,以便散页能以每分钟80至120页的速度通过扫描仪[5]。书籍不会在流程中幸存是设计使然:一旦原始副本被销毁,公司仅持有数字形式的一份合法购买副本,而非在印刷原版旁保留未经授权的复制品。令人不安的不仅仅是书籍被毁,更在于销毁行为近乎合规要求而非副产品——它是使数字化在法院眼中避免被视为盗版的机制。

采购的‘套娃游戏’:Anthropic、ISBNdb与Zoom Books都指向他人

支撑‘Project Panama’所需规模的背后,是一条无人愿意完全承担的供应链。图书元数据公司ISBNdb曾公开推销1,000至100万册图书的大宗订单,作为通往LLM训练数据的‘合规路径’——明确排除AI生成内容污染,因这些书籍早于AI热潮——但后来告诉《财富》杂志,该服务从未真正推出,也从未为AI公司购买或扫描过书籍[3]。加拿大公司Zoom Books自称图书回收商,却独立地被荷兰、德国、澳大利亚和新西兰的二手书商标记为异常大量、时间奇怪、价格高昂的冷门及本地书籍订单来源。Zoom Books否认为AI用途对书籍进行数字化,并拒绝透露其客户[6]

相关报道将此结构描述为AI公司专门通过中间商采购书籍作为训练材料,从而避免直接向卖家暴露自身身份[7]。链条中的每一方——AI实验室、元数据中介、回收商——都有一个以他人负责结尾的故事,而这正是‘Project Panama’保密备忘录所预见的动态:一个从一开始就设计成足迹无法追溯回单一公司门口的项目。

是平装重印本还是无价孤本?关于实际损失的争论

文化遗产倡导者认为,损失远不止文本本身。初版书、手写批注、所有权题词和原始装订承载着历史证据,这些是扫描无法捕捉的,因此当实体副本被粉碎时,这些证据便永远消失,无论文字是否以数字形式留存[8]。此外,幸存的数字副本通常进入仅供AI训练使用的私有数据库,而非公共档案,因此一本被扫描的书可能同时被‘保存’却又实际上对扫描公司以外的任何人不可见[9]

但最强烈的网络反弹挑战的是前提本身:Reddit等平台上的大量评论者坚称,被销毁的大多数书籍是原本就将被粉碎回收的大批量平装重印本,而非博物馆级别的珍品——他们认为真正独特或有价值的初版书早已被图书馆或现有数字档案保存,不会经由大宗图书回收商流转。另有观点从相反方向反驳叙事,认为‘销毁’的说法低估了一个更平凡的经济驱动因素:这些书籍现有的数字扫描(如果存在的话)往往质量太低,无法用于训练,因此无论单本书籍多么‘稀有’,重新干净地扫描实体副本才是更实用的选择。这两种解读都无法完全化解紧张关系,因为AI实验室及其经纪商之外的任何人都无法核实究竟哪些书正被拆解。就连马斯克的公开回应也采取折中态度,而非彻底否定破坏性扫描:他指示自己的团队,遇到真正稀有的书籍时应采用更困难的非破坏性方式扫描,而非切断书脊[10]——这隐含承认大宗采购中的大多数书籍可能不值得额外关照,同时坚持那些真正重要的书籍不应为扫描速度牺牲。

历史背景

Anthropic聘请了前Google Books合作伙伴负责人汤姆·特维(Tom Turvey),负责主导与分销商和零售商的大宗图书采购接洽。
‘Project Panama’始于2024年初,内部供应商提案讨论了通过破坏性扫描在六个月内转换50万至200万册书籍的计划。
法院裁定,使用合法获取并数字化的书籍训练AI属于合理使用,但保留由盗版书籍构成的图书馆则不属于合理使用。
联邦案件中解封了描述‘Project Panama’及其保密性的Anthropic内部规划文件。
法院最终批准了涵盖盗版书籍的15亿美元和解协议,这是有记录以来最大的版权和解案。
报道称,一名荷兰古籍书商收到了一笔可疑的3,001册图书大宗订单,与AI训练数据采购有关。
澳大利亚和新西兰的本地二手书商报告称,Zoom Books发出了可疑的大宗订单,怀疑与生成式AI训练数据供应有关。

关键关系图

关键玩家
主题

为AI训练破坏性扫描珍本

AN

Anthropic

AI lab that ran 'Project Panama,' buying millions of print books, cutting bindings with hydraulic cutters, scanning pages at high speed, and discarding originals to build a private training library; publicly denies buying from Zoom Books or destroying rare or antiquarian books; separately paid $1.5B to settle piracy claims.

ZO

Zoom Books

Canadian company describing itself as a book recycler; identified by booksellers in the Netherlands, Germany, Australia, and New Zealand as the source of unusually large, oddly timed bulk orders; denies digitizing or destroying books for AI purposes and will not name its customers.

IS

ISBNdb

Book metadata and data broker that publicly pitched bulk book acquisition of 1,000 to 1,000,000 books as a compliant path to AI training data, then later claimed to Fortune the service was never launched or used to supply AI companies.

JU

Judge William Alsup (N.D. Cal.)

Presided over Bartz v. Anthropic; ruled in June 2025 that training on legally acquired, digitized books is fair use, but that retaining pirated books was not; approved the $1.5B settlement in July 2026.

EL

Elon Musk

Publicly criticized the destructive-scanning practice and directed his SpaceXAI team to preserve rare books by scanning them non-destructively instead of cutting spines.

SE

Secondhand and antiquarian booksellers (Netherlands, Germany, Australia, New Zealand)

Report receiving suspicious bulk orders at odd hours, high prices, for obscure or local titles that they suspect are tied to AI training data sourcing, though they cannot definitively trace the books to AI scanning operations.

AU

Authors Guild and plaintiff authors (Andrea Bartz, Charles Graeber, Kirk Wallace Johnson)

Filed the copyright lawsuit against Anthropic over pirated books and secured the $1.5 billion settlement, roughly $3,000 per registered work.

事实来源

10 条引用
  1. [1] Anthropic's Secret Book-Scanning Operation, 'Project Panama'
  2. [2] Anthropic Is Secretly Destroying Books to Train Its AI
  3. [3] Dutch Bookseller Thought a 3,000-Book Order Was AI Spam - It Wasn't
  4. [4] Anthropic Is Paying $1.5 Billion Over Pirated Books, But It Can Still Legally Cut Up Purchased Ones
  5. [5] AI Firms Destroying Millions of Rare Books for Training Data, Raising Alarms Over Cultural Heritage
  6. [6] Local Secondhand Booksellers Suspect AI Companies Behind Bulk Orders
  7. [7] AI Companies Are Reportedly Shredding Millions of Books to Train Models
  8. [8] 'A Cultural Crime Against Humanity': AI Firms Are Destroying Ultra-Rare Books So Nobody Else Can Read Them
  9. [9] AI Companies Are Purchasing and Destroying Millions of Used Books for Training Data
  10. [10] Elon Musk Directs Team to Preserve Rare Books Instead of Destructively Scanning Them

来源文章

Top 4

THE SIGNAL.

Analysts

批评破坏性扫描,并指示其团队通过非破坏性扫描方法保存稀有书籍,而非切断书脊。

Elon Musk
指导其SpaceXAI团队的公众人物

认为图书语料库将教会模型写出高质量文本,而非模仿低质量互联网内容,以此阐述采购项目的合理性。

Unnamed Anthropic co-founder
根据解封的内部文件,Anthropic领导层成员

形容他对一笔异常大宗订单请求的怀疑感如同遇到垃圾邮件或钓鱼攻击,说明传统古籍经销商对这类与AI相关的批量订单多么陌生。

Pieter de Vries
荷兰哈勒姆市古籍书商
The Crowd

THIS IS F*CKING DISTURBING!!! A leaked Anthropic document just came out in court. Their own words: "Project Panama is our effort to destructively scan all the books in the world." Next line: "We don't want it to be known that we are working on this." They planned to shred

@@EvanLuthra32458

ANTHROPIC BOUGHT MILLIONS OF BOOKS, SLICED OFF THEIR SPINES, AND SHREDDED THEM. THE INTERNAL NAME WAS PROJECT PANAMA. The planning document said it plainly: an "effort to destructively scan all the books in the world." The same document told staff: "we don't want it to be known

@@Sancho_Wizard11

Project Panama: The AI industry's biblioclasm In early 2024, Anthropic executives launched a secret project codenamed "Project Panama" with an audacious goal: "destructively scan all the books in the world". Please watch and share

@@ABridgen76

AI companies are buying rare and out-of-print books, scanning them for training data, then destroying the physical copies forever

@u/Delicious-Act-860117000
Broadcast
AI Companies Are Destroying Rare Physical Books To Feed Their Chatbots | Vantage on Firstpost | 4K

AI Companies Are Destroying Rare Physical Books To Feed Their Chatbots | Vantage on Firstpost | 4K

AI vendors destroying rare books to feed the chatbot

AI vendors destroying rare books to feed the chatbot

Anthropic Destroyed Millions of Books. Here's Why.

Anthropic Destroyed Millions of Books. Here's Why.