[arXiv] A preprint compared a central commander, an auction-based consensus team and independent agents as large language model (LLM) multi-agent architectures in a deliberately simplified perimeter-defense simulation against LLM-controlled intruders under five network conditions. Khawaja Abaid Ullah, Ananya Acharya and Mohammad Javad Khojasteh reported breach rates of 15% for the consensus team, 32% for the commander and 29% for independent agents, according to the paper. Of the network conditions, only limited radio range changed a team's breach rate, raising the commander's, the authors said. Giving a low-cost LLM more authority over bid computation in the consensus team raised breaches by 38 percentage points, according to the paper. When birds and civilian drones were added to the airspace with a photograph of each in the input text state, only the near-frontier model treated them apart from intruders; intruders disguised as existing taxidermy bird drones were mistaken for birds by both low-cost and near-frontier LLMs and went unpursued in 59-61% of near-frontier decisions, versus 1-16% before, the authors said, adding that a one-sentence forewarning in the prompt lowered that to 0-25%. The authors concluded that an LLM team with a dedicated external conflict resolution protocol produced the fewest breaches. The paper is a preprint and has not been peer-reviewed.
arXiv paper: Decentralized LLM teams breach perimeter 15% of the time versus 32% for central commander
Sourcesarxiv.org