New ‘First Proof’ exam reveals how AI-powered math is a pay-to-play sport
The benchmark confirms that some AIs are becoming exceptional tools for research-level math. But open-source models still struggle
Eén bron
Nog geen ander medium dat Zonactu volgt, meldt dit bericht.
Artificial intelligence models are getting good at math—but only the corporate AIs.
The First Proof project , which aims to objectively evaluate the mathematical reasoning of publicly available AI models, released its third batch of results today. They underline what recent headlines have shown—that some large language models (LLMs) are becoming powerful research tools. They also suggest that proprietary subscription-based models from so-called frontier labs far exceed the math skills of more transparent and accessible “open-weight” models.
