Close Menu
New York Examiner News

    Subscribe to Updates

    Get the latest creative news from FooBar about art, design and business.

    What's Hot

    Grammys 2027: Check out the full list of nominations here

    November 17, 2026

    The Voice Live Blog: Who Will Make the Top 10?

    November 17, 2026

    Star Trek: Return To Duty Officially Announced

    November 17, 2026
    Facebook X (Twitter) Instagram
    New York Examiner News
    • Home
    • US News
    • Politics
    • Business
    • Science
    • Technology
    • Lifestyle
    • Music
    • Television
    • Film
    • Books
    • Contact
      • About
      • Amazon Disclaimer
      • DMCA / Copyrights Disclaimer
      • Terms and Conditions
      • Privacy Policy
    New York Examiner News
    Home»Science»New ‘First Proof’ exam reveals how AI-powered math is a pay-to-play sport
    Science

    New ‘First Proof’ exam reveals how AI-powered math is a pay-to-play sport

    By AdminOctober 15, 2026
    Facebook Twitter Pinterest LinkedIn WhatsApp Email Reddit Telegram
    New ‘First Proof’ exam reveals how AI-powered math is a pay-to-play sport

    [ad_1]

    Artificial intelligence models are getting good at math—but only the corporate AIs.

    The First Proof project, which aims to objectively evaluate the mathematical reasoning of publicly available AI models, released its third batch of results today. They underline what recent headlines have shown—that some large language models (LLMs) are becoming powerful research tools. They also suggest that proprietary subscription-based models from so-called frontier labs far exceed the math skills of more transparent and accessible “open-weight” models.

    “The gap between the open-weight models and frontier models is very large in research mathematics—much larger than in other domains,” says Mohammed Abouzaid, a mathematician at Stanford University and a member of the First Proof team.


    On supporting science journalism

    If you’re enjoying this article, consider supporting our award-winning journalism by subscribing. By purchasing a subscription you are helping to ensure the future of impactful stories about the discoveries and ideas shaping our world today.


    In February a team of top mathematicians started First Proof as a rigorous, independent exam for cutting through the proliferation of imperfect “benchmarks” for scoring different models. The AI race to conquer math has accelerated dramatically since those quaint days, when its greatest successes concerned problems that were scarcely connected to actual research. OpenAI’s “slop drop” last week has put to rest scores of more pressing questions, many of which had stood unresolved for decades. And the company’s solution of the Navier-Stokes problem last month convinced many that LLMs are on the verge of superseding human mathematicians—if they have not already.

    But these breakthroughs are far from controlled experiments. For the slop drop, OpenAI didn’t disclose the thousands of problems that the company’s new model attempted, most of which it didn’t solve. And that internal model remains completely inaccessible to outside mathematicians, preventing a direct comparison of its performance with others.

    First Proof’s mathematicians solicited problems from experts in a broad range of subdisciplines and then selected 10. They asked each model under evaluation to answer the problems as written, with no further human input. Then they had three graders per problem evaluate the answers in a mock “peer review.”

    First Proof’s rules require any entrants to be openly available, so OpenAI’s blockbuster new model was excluded. The team tested OpenAI’s GPT 6 Astra, Anthropic’s Claude Opus 5.5, an aggregate model called “ProofCouncil” that combines an Astra agent with other agents to check its work and a similar “harness” built on Kimi K3, the leading open-weight model—one whose inner workings are made completely public, among other entrants. Producers of other major models, including Google, did not participate.

    The best performer—ProofCouncil—solved nine out of the 10 research problems in a manner the judges deemed acceptable with “minor revisions” for publication in a peer-reviewed journal. This helped quantify the models’ rapid ascent at math over the course of 2026. (In the round one results that First Proof released in February, the top model got just a few problems correct. And in the round two results released in June, the winner got six or seven.)

    For the main skill that First Proof tests—proving well-defined statements—“the models have become very good,” Abouzaid says, “so good that testing the frontier models on this task might not be that relevant in the future.”

    Notably, the best open-weight model, Kimi K3, solved exactly zero problems. “It really fell flat on its face,” says Lauren Williams, a mathematician at Harvard University and a member of the First Proof team. “The open models are really, really far behind, so we would urge the community to invest a lot into improving them.”

    The First Proof team has received many requests to test open-weight models from mathematicians concerned about privacy after recent high-profile controversies. “I know people who use open-source models exclusively because they’re so paranoid about data leakage with the frontier models,” Williams says.

    “We have a lot of questions from mathematicians telling us, ‘I would like to look for alternatives to using OpenAI’s or Anthropic’s models, but I don’t know whether they would work,’” Abouzaid says .

    For now, it seems, they don’t.

    Subscribe to Support Independent Journalism

    Great science journalism requires human expertise, time, effort and creativity. And it costs money. That’s why I and the journalists here at Scientific American hope you’ll join our community.

    When you subscribe, you are supporting staff and freelance journalists who are passionate about telling science stories that are true, important and compelling. Our editors and reporters are often experts in their fields, which means they understand the nuances of big discoveries and can untangle the breakthroughs from the hype. With a subscription, you are also supporting rigorous fact-checking to ensure the words we publish are precise and accurate. And you’re supporting original illustrations, graphics and photos that bring you closer to an advanced laboratory, an ice sheet in Antarctica or a space mission in orbit. You’re helping us craft other types of high-quality journalism as well: Our newsletters are carefully written, edited and curated by staffers you have or will come to know and love. Our Science Quickly podcast is based on original reporting, collaboration with editors and scientists and exacting production.

    Subscriptions keep this engine running so we can continue to deliver thoughtful, rigorous and independent science journalism to you. In an era of viral misinformation, this work is crucial. If you value what we do, I hope you’ll consider joining us as a subscriber

    [ad_2]

    Original Source Link

    Share. Facebook Twitter Pinterest LinkedIn WhatsApp Email Reddit Telegram
    Previous ArticleHarvey Keitel Threw ‘Bad Lieutenant’ in the Trash Before Saying Yes
    Next Article A Cup of Comfort and Connection in Michiko Aoyama’s “Matcha on Monday”

    RELATED POSTS

    Climate Change Has Pushed the World's Ice Out of Its Safe Zone

    November 12, 2026

    Synchron Pauses Trials of Its Brain Implant Due to Performance Issues

    November 12, 2026

    The Polar Vortex Is About to Make Weather Weird From the UK to the US

    November 12, 2026

    A Startup Wants to Fight AI Bioweapons With AI

    November 11, 2026

    Michigan Residents Voted to Get Corporate Money Out of Politics. Now Utilities Are Suing

    November 11, 2026

    A New Benchmark for De-Aging Comes From Slowly Turning Back Cells Clocks

    November 11, 2026
    latest posts

    Grammys 2027: Check out the full list of nominations here

    The full nominations for the 2027 Grammys have been announced, with Raye, Rosalía, Taylor Swift…

    The Voice Live Blog: Who Will Make the Top 10?

    November 17, 2026

    Star Trek: Return To Duty Officially Announced

    November 17, 2026

    Robert Pattinson Cast as the Next James Bond

    November 16, 2026

    US tightens AI chip export controls to deter Chinese companies from accessing compute remotely | TechCrunch

    November 16, 2026

    Garrick Merrifield Resurfaces With AI Harem Of Wives, Cult Vibes

    November 16, 2026

    Karol G Postpones Show in Mexico City Due to Health Reasons: Heres the New Date

    November 16, 2026
    Categories
    • Books (1,590)
    • Business (6,481)
    • Events (85)
    • Film (6,451)
    • Lifestyle (4,502)
    • Music (6,584)
    • Politics (6,447)
    • Science (5,852)
    • Technology (6,439)
    • Television (6,143)
    • US News (6,486)
    popular posts

    Ti West Sets ‘MaXXXine’ as Third Film in ‘X’ World With A24 – The Hollywood Reporter

    [ad_1] A24 and director Ti West have unveiled MaXXXine as the third film set in…

    People Are More Likely to Cheat When They Use AI

    September 28, 2025

    Republicans Have Turned On Their Own House Majority

    October 24, 2023

    Polymarket users have wagered $3.2 billion on the outcome of the election—and the majority of bets are on Trump winning

    November 5, 2024
    Archives
    Browse By Category
    • Books (1,590)
    • Business (6,481)
    • Events (85)
    • Film (6,451)
    • Lifestyle (4,502)
    • Music (6,584)
    • Politics (6,447)
    • Science (5,852)
    • Technology (6,439)
    • Television (6,143)
    • US News (6,486)
    About Us

    We are a creativity led international team with a digital soul. Our work is a custom built by the storytellers and strategists with a flair for exploiting the latest advancements in media and technology.

    Most of all, we stand behind our ideas and believe in creativity as the most powerful force in business.

    What makes us Different

    We care. We collaborate. We do great work. And we do it with a smile, because we’re pretty damn excited to do what we do. If you would like details on what else we can do visit out Contact page.

    Our Picks

    Garrick Merrifield Resurfaces With AI Harem Of Wives, Cult Vibes

    November 16, 2026

    Karol G Postpones Show in Mexico City Due to Health Reasons: Heres the New Date

    November 16, 2026

    Angels & Demons: Ken Russell's The Devils

    November 15, 2026
    © 2026 New York Examiner News. All rights reserved. All articles, images, product names, logos, and brands are property of their respective owners. All company, product and service names used in this website are for identification purposes only. Use of these names, logos, and brands does not imply endorsement unless specified. By using this site, you agree to the Terms & Conditions and Privacy Policy.

    Type above and press Enter to search. Press Esc to cancel.

    We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept All”, you consent to the use of ALL the cookies. However, you may visit "Cookie Settings" to provide a controlled consent.
    Cookie SettingsAccept All
    Manage consent

    Privacy Overview

    This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
    Necessary
    Always Enabled
    Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
    CookieDurationDescription
    cookielawinfo-checkbox-analytics11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
    cookielawinfo-checkbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
    cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
    cookielawinfo-checkbox-others11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
    cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
    viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
    Functional
    Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
    Performance
    Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
    Analytics
    Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
    Advertisement
    Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.
    Others
    Other uncategorized cookies are those that are being analyzed and have not been classified into a category as yet.
    SAVE & ACCEPT