BrowserForge: Scaling Web Episode via Parallel Browser Sandboxes
作者: Fei Tang, Huawen Shen, Zhiqiong Lu, Zhengxi Lu, Pengyuan Lyu, Chengquan Zhang, Weiming Lu, Jun Xiao, Yueting Zhuang, Yongliang Shen
分类: cs.CL
发布日期: 2026-08-25
💡 一句话要点
提出BrowserForge以解决大规模生成网页交互数据的问题
🎯 匹配领域: 支柱九:具身大模型 (Embodied Foundation Models)
关键词: 网页交互数据 浏览器沙箱 数据生成 多样性提升 自动化测试 人工智能代理 深度学习
📋 核心要点
- 现有方法在生成网页交互数据时,通常受限于固定的网站列表,导致数据多样性不足。
- BrowserForge框架通过并行浏览器沙箱在开放网络上生成大量网页交互数据,提升了数据的多样性和质量。
- 在使用新生成的数据集进行微调后,模型在在线任务的成功率从25.66%提升至33.33%,显示出显著的性能提升。
📝 摘要(中文)
Web代理通过渲染像素进行操作,避免了读取HTML或可访问性树的脆弱性和高昂的代币成本,但训练这些代理需要大量高质量的交互轨迹,而如何大规模生成这些数据仍然是一个未解的问题。现有公共数据集通常只包含来自固定网站的几千条轨迹,且自动合成管道受限于预定义的网站列表。为此,本文提出了BrowserForge框架,通过并行驱动多个浏览器沙箱在开放网络上生成网页交互数据。BrowserForge结合了开放网络源阶段、沙箱集群管理器和双代理循环,最终生成了203,238条来自不同网站的轨迹,显著提升了模型在在线和静态任务上的成功率。
🔬 方法详解
问题定义:本文旨在解决现有网页交互数据生成方法在多样性和规模上的不足,现有公共数据集的轨迹数量有限且来源单一,无法满足训练需求。
核心思路:提出BrowserForge框架,通过并行运行多个浏览器沙箱,广泛接触开放网络上的真实网站,从而生成丰富的网页交互数据。
技术框架:BrowserForge包含三个主要模块:开放网络源阶段,负责从数十万个真实网站收集数据;沙箱集群管理器,调度并高效利用多个并发浏览器;双代理循环,将原始页面转化为可执行任务并收集验证轨迹。
关键创新:最重要的创新在于通过开放网络源和广泛的网站覆盖,显著提升了生成数据的多样性和质量,这与以往受限于固定网站列表的方法有本质区别。
关键设计:在数据清理过程中,采用规则加模型的清理管道,去除失败的运行并将成功的推理重写为统一的思维链风格,确保生成数据的质量。
🖼️ 关键图片
📊 实验亮点
实验结果显示,使用BrowserForge生成的数据集使得模型在在线任务上的成功率从25.66%提升至33.33%,在静态任务上的步准确率也得到了持续改善,随着数据集规模的扩大,性能提升更加显著。
🎯 应用场景
该研究的潜在应用领域包括自动化网页测试、智能代理系统和人机交互等。通过生成多样化的网页交互数据,BrowserForge能够为训练更强大的AI代理提供基础,推动相关领域的技术进步和应用落地。
📄 摘要(原文)
Web agents that act from rendered pixels avoid the fragility and heavy token cost of reading a page's HTML or accessibility tree, but training them depends on large amounts of high-quality interaction trajectories, and how to produce such data at scale remains an open problem. Public datasets typically contain only a few thousand trajectories drawn from a fixed and narrow set of websites, and even recent automated synthesis pipelines stay bound to predefined site lists or tutorial sources, so the number of distinct websites the agent ever sees barely grows. We present BrowserForge, a framework that generates web interaction data at scale by driving many browser sandboxes in parallel over the open web. BrowserForge couples three components: an open-web sourcing stage that exposes the agent to hundreds of thousands of real, openly reachable websites; a sandbox cluster manager that schedules hundreds of concurrent browsers with high utilization; and a Proposer-Solver dual-agent loop that turns a raw page into an executable task and then collects a verified trajectory for it. A rule-plus-model cleaning pipeline removes failed runs and rewrites the surviving reasoning into a single unified chain-of-thought style. Page structure such as the accessibility tree is used only as a synthesis-time signal; the agent we train and release acts purely from the screenshot. The resulting corpus contains 203,238 trajectories, each collected from a distinct website, larger and more diverse than prior trajectory datasets. Fine-tuning a compact multimodal model on this corpus raises its success rate on the live Online-Mind2Web from 25.66% to 33.33% and consistently improves step accuracy on the static Multimodal-Mind2Web, with the gain growing as the corpus scales. Controlled analyses further confirm that open-web sourcing and broad website coverage are key contributors to the observed improvement.