home bbs files messages ]

Just a sample of the Echomail archive

<< oldest | < older | list | newer > | newest >> ]

 Message 1933 
 Mike Powell to All 
 MS built a fake online ma 
 09 Nov 25 10:28:15 
 
TZUTC: -0500
MSGID: 1690.consprcy@1:2320/105 2d75efa9
PID: Synchronet 3.21a-Linux master/123f2d28a Jul 12 2025 GCC 12.2.0
TID: SBBSecho 3.28-Linux master/123f2d28a Jul 12 2025 GCC 12.2.0
BBSID: CAPCITY2
CHRS: ASCII 1
FORMAT: flowed
Microsoft built a fake online marketplace to see how its AI agents would work
selling unsupervised - and let's just say the results were... unsurprising

Date:
Sat, 08 Nov 2025 19:34:00 +0000

Description:
Microsofts Magentic Marketplace shows AI tools still cannot reliably act
independently in complex multi-agent simulations.

FULL STORY

A new Microsoft study has raised questions on the current suitability of AI
agents operating without full human supervision/ 

The company recently built a synthetic environment, the  Magentic Marketplace
", designed to observe how AI agents perform in unsupervised situations. 

The project took the form of a fully simulated ecommerce platform which
allowed researchers to study how AI agents behave as customers and businesses
- with possible predictable results.

Testing the limits of current AI models 

The project included 100 customer-side agents interacting with 300
business-side agents, giving the team a controlled setting to test agent
decision-making and negotiation skills. 

The source code for the marketplace is open source; therefore, other
researchers can adopt it to reproduce experiments or explore new variations. 

Ece Kamar, CVP and managing director of Microsoft Researchs AI Frontiers Lab,
noted this research is vital for understanding how AI agents collaborate and
make decisions. 

The initial tests used a mix of leading models, including GPT-4o, GPT-5, and
Gemini-2.5-Flash. 

The results were not entirely unexpected, as several models showed 
weaknesses. 

Customer agents could easily be influenced by business-side agents into
selecting products, revealing potential vulnerabilities when agents interact
in competitive environments. 

The agents efficiency dropped sharply when faced with too many options,
overwhelming their attention span and leading to slower or less accurate
decisions. 

AI agents also struggled when asked to work toward shared goals, as the 
models were often unsure which agent should take on which role, which reduced
their effectiveness in joint tasks. 

However, their performance improved only when step-by-step instructions were
provided. 

We can instruct the models - like we can tell them, step by step. But if we
are inherently testing their collaboration capabilities, I would expect these
models to have these capabilities by default, Kamar noted. 

The results show AI tools still need substantial human guidance to function
effectively in multi-agent environments. 

Often promoted as capable of independent decision-making and collaboration,
the results show unsupervised agent behavior remains unreliable, so humans
must improve coordination mechanisms and add safeguards against AI
manipulation. 

Microsofts simulation shows that AI agents remain far from operating
independently in competitive or collaborative scenarios and may never achieve
full autonomy. 

======================================================================
Link to news story:
https://www.techradar.com/pro/microsoft-built-a-fake-marketplace-to-see-how-it
s-ai-agents-would-work-selling-unsupervised-and-lets-just-say-the-results-were
-unsurprising

$$
--- SBBSecho 3.28-Linux
 * Origin: capitolcityonline.net * Telnet/SSH:2022/HTTP (1:2320/105)
SEEN-BY: 105/81 106/201 128/187 129/14 305 153/7715 154/110 218/700
SEEN-BY: 226/30 227/114 229/110 206 300 307 317 400 426 428 470 664
SEEN-BY: 229/700 705 266/512 291/111 320/219 322/757 342/200 396/45
SEEN-BY: 460/58 633/280 712/848 902/26 2320/0 105 304 3634/12 5075/35
PATH: 2320/105 229/426


<< oldest | < older | list | newer > | newest >> ]

(c) 1994,  bbs@darkrealms.ca