firmulate.com/benchmarks.html — live view
AIThis post was created with the assistance of artificial intelligence (AI).
Firmulate — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
Live on firmulate.com.

Imagine if your child’s school project was judged not just on ideas but on actual results—showing whether they could finish what they started, stay honest under pressure, and read their own notes carefully. That’s the challenge now facing AI tools in the workplace. Instead of mere talk or shiny demos, real-world AI must demonstrate trustworthiness and discipline when it counts.

For listenersOffer from Amazon

Turn the school run and nap time into listening time

  • Thousands of audiobooks, podcasts and originals
  • Listen on your phone, tablet or Echo — also offline
  • Cancel anytime
Try Audible free Free trial for new members
As an affiliate, we earn on qualifying purchases.

Introducing a Unique Live Experiment in AI Performance

Recently, a groundbreaking trial put four leading AI models through the ultimate test: managing a small, real-world software company during its most difficult week. Unlike typical AI demos that showcase impressive chat skills, this experiment measured how well each AI could handle crises, resist manipulation, and close deals—under real business conditions.

Amazon

AI business crisis management tools

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Benchmarks and Results

In the July 2026 Crucible League, AI models were scored based on their ability to identify buried information, stay disciplined, and make honest decisions. The scores ranged from a high of 95 for gpt-5.6-sol to 73 for Opus 4.8. The Moonshot company’s own AI—Kimi K3—secured an impressive 93, just behind the top scorer, and notably beat three Western frontier models in this challenging test.

What the scores reveal

  • The top scorer, gpt-5.6-sol, found a hidden fact buried deep in company documents, enabling it to close a €55,000 deal and secure €4,583 in monthly revenue.
  • Kimi K3, the newcomer from Moonshot, also closed the deal at full price, demonstrating the cleanest discipline among all models tested.
  • Other models like Sonnet 5 and Fable 5 managed to close the deal but with a few slips in process discipline and trustworthiness.

Key Insights from the Experiment

Every model successfully identified crises and refused manipulative social engineering attempts—fake CEO messages and reporter tricks—showing they can resist deception. The critical differentiator was how deeply each model read into the company’s own files: those that accessed and understood buried information won the deal at full value.

Why does this matter for your family or business?

Just as children need to learn discipline, honesty, and thoroughness to succeed, AI models must demonstrate these qualities to be truly trustworthy partners. The experiment highlights that performance is not just about generating convincing chat responses but about finishing tasks honestly and thoroughly under pressure—something that’s vital whether you’re managing a family budget or a business project.

The Discipline and Fairness in AI Testing

This experiment was conducted fairly—K3 ran without an effort parameter, meaning it operated at the default level, while the others ran at a higher effort setting xhigh. Despite this, K3 proved its mettle, showing that reliable performance isn’t just about more effort but about disciplined decision-making.

Beyond the Demos: Real-World Readiness

The company used in this test is real, with 13 simulated employees managing real money—burning €105,000 monthly against a modest €2,300 in monthly revenue. All decisions were versioned, auditable, and made in real-time, making this a true live battleground for AI accountability.

What Can Families Learn From This?

Much like children navigating trust and honesty, AI models in business must demonstrate integrity and discipline. The experiment shows that the strongest AI—like Kimi K3—can identify buried truths, resist manipulation, and follow through on commitments. For parents, this underscores the importance of teaching children to be disciplined, honest, and thorough—traits that even AI is now being tested for.

Infographic — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
The findings at a glance — source: firmulate.com.

The real lesson isn’t just about AI scoring high in demos but about whether these tools can reliably finish what they start, access and interpret critical information, and stay honest under pressure. As AI becomes a partner in your work or family life, choosing models that demonstrate discipline and integrity—like Kimi K3—may be the most important decision of all.

Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html

Powered by Thorsten Meyer AI

Parenting content here is informational. For medical questions about your child, consult a pediatrician.


COLD & FLU SEASO

Cold & flu season Picks

As an affiliate, we earn on qualifying purchases.

You May Also Like

Why Brushing Stations Matter More in Shared Kid Bathrooms

No matter how many kids share a bathroom, well-designed brushing stations are key to safety and independence—discover how to set them up effectively.

The Gross Reason You Need to Change Your Child's Toothbrush More Often

Wondering why your child's toothbrush could be a hidden breeding ground for harmful bacteria? Discover the shocking truth inside!

How to Set Up a Shared Sink Area Without Toothbrush Confusion

A well-organized shared sink area prevents toothbrush confusion and keeps everyone’s essentials easily accessible; discover how to create an efficient setup.

The Mattress Mistake That Can Make Allergy Nights Feel Worse

Knowing the right mattress and cleaning strategies can drastically improve allergy nights, but there’s a crucial mistake many overlook—discover what it is.