❯ Model evaluation platform Arena raises a $200 million Series B at a $3.1 billion valuation, with annualized revenue above $100 million

Valuation nearly doubles in ten monthsAI model evaluation platform Arena announced a $200 million Series B on October 8 at a $3.1 billion valuation. Lightspeed and Khosla Ventures co-led, with Salesforce Ventures, Dell Technologies Capital and others participating alongside existing investors including a16z and Felicis.

Users vote, models get rankedArena began in 2023 as a research project at UC Berkeley. As TechCrunch describes it, ordinary users enter prompts or request coding projects for free and judge which model did better, and those votes feed the leaderboard. In September last year it introduced a paid product, AI Evaluations, selling model labs and enterprises detailed performance analytics based on community feedback.

Revenue more than tripledThis January, Arena closed a $150 million Series A at a $1.7 billion post-money valuation, when annualized revenue was $30 million. The company now says annualized revenue has passed $100 million. Alongside the funding it released the Alignment Index, which measures whether models take unauthorized actions, misattribute statements or falsely claim to have completed tasks.

The referee's customers are the playersArena argues that static benchmarks break down once models recognize they are being tested. Enterprises buying models therefore need evaluations drawn from real use, and model labs are willing to pay to learn their own weaknesses. Arena’s own difficulty is staying neutral: its paying customers are the same labs it ranks.

▮ SIGNALAn evaluation company more than tripled revenue in a year; vendor-published scores are no longer enough to buy on, and refereeing has become a business of its own.