Enhancing Decision-Making with Large Language Models through Multi-Agent Fictitious Play
作者: Leyang Shen, Yang Zhang, Xiaoyan Zhao, Chun Kai Ling, Tat-Seng Chua
分类: cs.CL, cs.MA
发布日期: 2026-06-17
备注: 18 pages, 8 figures
💡 一句话要点
提出多代理虚拟博弈以解决决策复杂性问题
🎯 匹配领域: 支柱九:具身大模型 (Embodied Foundation Models)
关键词: 多代理系统 决策优化 博弈论 虚拟博弈 立场纠缠 执行复杂性 鲁棒性 策略学习
📋 核心要点
- 现有的多代理系统在处理决策任务时,无法有效应对利益相关者之间的相互依赖性,导致决策质量下降。
- 本文提出的MAFP通过将利益相关者的立场建模为代理,利用博弈论中的虚拟博弈原理进行决策优化。
- 实验结果显示,MAFP在两个补充指标上超越了单轮和多轮基线,证明了其在复杂决策任务中的优势。
📝 摘要(中文)
基于大型语言模型的多代理系统在解决执行复杂性任务方面展现了巨大潜力,但在决策任务中却面临挑战。本文提出了多代理虚拟博弈(MAFP),将利益相关者的立场视为代理,并将决策过程视为寻求均衡的过程。MAFP通过迭代更新每个代理的决策,逐步提高决策质量和鲁棒性。实验结果表明,MAFP在竞争场景下的决策任务中优于单轮和多轮基线,显示出其在解决立场纠缠问题上的有效性。
🔬 方法详解
问题定义:本文旨在解决多代理系统在决策任务中面临的立场纠缠问题。现有方法在处理利益相关者相互依赖的决策时,往往无法有效整合信息,导致决策效果不佳。
核心思路:MAFP的核心思想是将每个利益相关者的立场视为一个代理,并通过博弈论中的虚拟博弈原理,迭代更新代理的决策,以实现均衡。这样的设计使得代理能够相互学习和适应,从而提高决策的质量和鲁棒性。
技术框架:MAFP的整体架构包括多个代理,每个代理根据其他代理的历史决策进行最佳响应。该过程通过迭代进行,直到达到均衡状态。主要模块包括代理建模、决策更新和均衡检测。
关键创新:MAFP的创新之处在于将决策过程视为一个动态的博弈过程,强调了代理之间的相互影响和学习能力。这与传统的单一决策模型有本质区别,后者往往忽视了多方利益的相互依赖性。
关键设计:在MAFP中,代理的决策更新基于对其他代理历史决策的统计分析,采用了特定的损失函数来衡量决策的有效性。此外,代理的学习率和更新策略也经过精心设计,以确保收敛性和稳定性。
🖼️ 关键图片
📊 实验亮点
实验结果表明,MAFP在两个补充指标上超越了单轮和多轮基线,具体表现为在竞争场景中的决策强度和鲁棒性均有显著提升,展示了MAFP在复杂决策任务中的有效性。
🎯 应用场景
该研究的潜在应用领域包括金融决策、市场竞争策略、资源分配等复杂决策场景。MAFP能够有效处理多方利益相关者的决策问题,提升决策的质量和效率,具有重要的实际价值和广泛的应用前景。
📄 摘要(原文)
Large language model (LLM)-based multi-agent systems (MAS) have demonstrated great potential in solving tasks with execution complexity, by distributing subtasks across cooperative agents. However, this divide-and-conquer paradigm falls short on decision-making tasks that are also prevalent in the real world. These tasks require simultaneous reasoning from the stances of all involved stakeholders whose decisions are mutually dependent and thus cannot be solved in isolation. We characterize this challenge as stance entanglement, a form of decision complexity distinct from execution complexity. To address it, we propose Multi-Agent Fictitious Play (MAFP), a novel MAS paradigm that represents stakeholder stances as agents and formulates decision-making as an equilibrium-seeking process. Built on the game-theoretic principle of fictitious play, MAFP iteratively updates each agent's decision by best responding to the empirical mixture of other agents' past decisions. This enables agents to expose and address one another's weaknesses, progressively improving decision quality and robustness. We evaluate MAFP on challenging decision-making tasks that test the capability of deciding strategies for competitive scenarios prior to acting. MAFP outperforms both single-round and multi-round baselines on two complementary metrics, tournament strength and robustness, demonstrating its effectiveness in addressing stance entanglement.