Foundation Model Transparency Reports

📄 arXiv: 2402.16268v1 📥 PDF

作者: Rishi Bommasani, Kevin Klyman, Shayne Longpre, Betty Xiong, Sayash Kapoor, Nestor Maslej, Arvind Narayanan, Percy Liang

分类: cs.LG, cs.AI, cs.CY

发布日期: 2024-02-26

期刊: Published in AIES 2024

💡 一句话要点

提出基础模型透明报告以解决透明性不足问题

🎯 匹配领域: 支柱九：具身大模型 (Embodied Foundation Models)

关键词: 基础模型 透明性 社会影响 合规成本 政府政策 透明报告 人工智能

📋 核心要点

  1. 现有基础模型缺乏透明性，导致社会影响和潜在危害难以评估。
  2. 提出基础模型透明报告，旨在规范开发者提供透明性，借鉴社交媒体的透明报告实践。
  3. 通过对透明指标的评估，发现与政府政策的重叠，降低合规成本，促进透明性。
  4. method_zh

📝 摘要（中文）

基础模型是具有广泛社会影响的重要数字技术，因此需要透明性。为了规范基础模型开发者在模型开发和部署中提供透明性，我们提出了基础模型透明报告，借鉴社交媒体的透明报告实践。我们的目标是在行业尚处于初期阶段时，制度化基础模型的透明报告。为设计这些报告，我们识别了六项设计原则，并基于基础模型透明指数的100个透明指标，评估其与六项主要政府政策（如欧盟人工智能法案和美国安全、可靠和可信的人工智能行政命令）中的透明性要求的重叠程度。设计良好的透明报告可以降低合规成本，部分原因是不同司法管辖区之间的监管要求重叠。我们鼓励基础模型开发者定期发布透明报告，基于G7和白宫的建议。

📊 实验亮点

研究表明，设计良好的透明报告能够显著降低合规成本，尤其是在不同司法管辖区之间的监管要求重叠方面。通过对100个透明指标的评估，发现与主要政府政策的透明性要求存在较高的重叠度。

🎯 应用场景

该研究的潜在应用领域包括人工智能模型的开发、监管合规和社会责任。透明报告能够帮助开发者更好地理解和应对社会影响，提升公众信任，并推动行业的可持续发展。

📄 摘要（原文）

Foundation models are critical digital technologies with sweeping societal impact that necessitates transparency. To codify how foundation model developers should provide transparency about the development and deployment of their models, we propose Foundation Model Transparency Reports, drawing upon the transparency reporting practices in social media. While external documentation of societal harms prompted social media transparency reports, our objective is to institutionalize transparency reporting for foundation models while the industry is still nascent. To design our reports, we identify 6 design principles given the successes and shortcomings of social media transparency reporting. To further schematize our reports, we draw upon the 100 transparency indicators from the Foundation Model Transparency Index. Given these indicators, we measure the extent to which they overlap with the transparency requirements included in six prominent government policies (e.g., the EU AI Act, the US Executive Order on Safe, Secure, and Trustworthy AI). Well-designed transparency reports could reduce compliance costs, in part due to overlapping regulatory requirements across different jurisdictions. We encourage foundation model developers to regularly publish transparency reports, building upon recommendations from the G7 and the White House.