Imagine managing a busy sports shop during its worst week—dealing with angry customers, supply chain crises, and tricky employees—without missing a beat. Now, picture an AI trying to do the same. That’s exactly what a recent live experiment by Firmulate revealed: it’s not just about AI chat quality; it’s about management grit, decision-making under pressure, and honesty when stakes are high.
What Does It Take to Run a Business During a Crisis?
While many are familiar with AI models excelling on coding tests or trivia, the true test for AI in management roles is different. It’s about handling real crises: customer complaints, financial temptations, and even deceptive tactics designed to trick the AI into bending rules.
In a unique live experiment, four advanced AI models were tasked with running a small software company through its toughest week. Every decision was real, every crisis authentic, and every move documented for transparency. The goal? Measure management quality—not just how well an AI can generate language or solve puzzles, but how it navigates complex, stressful situations.
AI management decision-making software
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
The Results That Matter
All four models identified every crisis and refused every manipulative attempt—showing a baseline of honesty and awareness. But only two managed to close the deal worth €55,000 based on their own analysis and diagnosis. Despite similar insights and pitches, only these two signed the contract, highlighting that success depends on more than just spotting problems.
Further analysis uncovered a critical weakness: the decisive factor was how well the AI read and understood the company’s internal files—information buried two documents deep. Those that accessed and interpreted this data won the deal at full price, securing an additional €4,583 MRR. This underscores the importance of comprehensive information processing, not just surface-level cues.
business crisis management AI tools
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
Deception and Ethical Behavior Under Pressure
The experiment also tested the AI’s resistance to social engineering. Fake CEO messages escalated through multiple stages, and even a reporter tricked one AI into a background check request. Remarkably, all five models refused to participate, citing suspicion of impersonation or bypassing approval processes. As Kimi K3 explained, it treated suspicious requests as potential impersonations, exemplifying cautious and ethical management behavior.
As an affiliate, we earn on qualifying purchases.
The Live Business: Real Money, Real Risks
Running the experiment on a live, functioning company with 13 synthetic employees and daily money mechanics brought the stakes home. The company spends €105k monthly to generate €2.3k in monthly recurring revenue, with a public cash countdown looming. Every workday, the AI models operate within a complex environment, guided by over 680 self-learned rules, with decisions versioned for accountability. You can watch this ongoing experiment at firmulate.com/live.
AI data analysis tools for business
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
Beyond the Chat: Management as a Skill
The standout participant, Opus 4.8, demonstrated thoroughness with over 80 learned rules and deep analyses, but ultimately ranked last. Its discipline slipped when it failed to escalate issues properly and left potential deals on the table. Other models showed similar weaknesses, emphasizing that management quality involves discipline, prioritization, and trustworthiness—traits that current AI models are still learning to master.
Why This Matters for Business Leaders
It’s easy to get dazzled by an AI’s ability to generate convincing text or answer trivia. But in the real world, what matters is whether an AI can finish what it starts, read vital internal documents, and remain honest under pressure. These are the qualities that will determine if AI becomes a trusted management partner or just another tool.
For enterprise users, firms can even run their own management wargames against their data—without risking real systems—offering a preview of how AI could handle their specific challenges. More at firmulate.com/pilot.html.
Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html
