Trending News: RLWRLD raises $14.8M to build a foundational model for roboticsDebates over AI benchmarking have reached PokémonGoogle’s newest AI model is designed to help study dolphin ‘speech’OpenAI’s new GPT-4.1 AI models focus on codingOpenAI plans to phase out GPT-4.5, its largest-ever AI model, from its APIGoogle Classroom gives teachers an AI feature for quiz questionsHugging Face buys a humanoid robotics startupMeta to start training its AI models on public content in the EUNvidia says it plans to manufacture some AI chips in the U.S.Access to future AI models in OpenAI’s API may require a verified IDOpenAI co-founder Ilya Sutskever’s Safe Superintelligence reportedly valued at $32BApple’s ‘Mythic Quest’ is ending with an updated Season 4 finaleThe xAI–X merger is a good deal — if you’re betting on Musk’s empireMeta’s vanilla Maverick AI model ranks below rivals on a popular chat benchmarkThe most interesting startups showcased at Google Cloud Next Law professors side with authors battling Meta in AI copyright caseEx-OpenAI staffers file amicus brief opposing the company’s for-profit transitionChatGPT became the most downloaded app globally in MarchIreland’s data regulator investigates X’s use of European user data to train GrokMeta’s Llama drama and how Trump’s tariffs could hit moonshot projectsLess than a month to get your exhibit table for TechCrunch Sessions: AIOpenAI is winding down its GPT-4 AI model in ChatGPTHow Chef Robotics found success by turning away its original customersDeepMind CEO Demis Hassabis says Google will eventually combine its Gemini and Veo AI modelsMira Murati’s AI startup is reportedly aiming for a massive $2B seed roundAI models still struggle to debug software, Microsoft study showsThe US Secretary of Education referred to AI as ‘A1,’ like the steak sauceYouTube rolls out a free AI music-making tool for creatorsLiveKit’s tools power real-time communications, including OpenAI’s Voice ModeCanva is getting AI image generation, interactive coding, spreadsheets and moreOpenAI updates ChatGPT to reference your past chatsNetflix’s latest season of ‘Black Mirror’ comes with a mobile gameGoogle thinks AI can untangle the electrical grid’s bureaucracyAmazon CEO Andy Jassy urges companies to invest heavily in AIThe rise of AI ‘reasoning’ models is making benchmarking more expensiveIncident.io raises $62M at a $400M valuation to help IT teams move fast when things breakAI insurtech Ominimo bags its first investment at a $220M valuationElon Musk’s AI company, xAI, launches an API for Grok 3Google says it’ll embrace Anthropic’s standard for connecting AI models to dataOpenAI counter-sues, calls for Musk to be enjoined from ‘further unlawful and unfair action’Nvidia’s H20 AI chips may be spared from export controls — for nowIlya Sutskever taps Google Cloud to power his AI startup’s researchOpenAI launches program to design new ‘domain-specific’ AI benchmarksSolve Intelligence raises fresh $12M to bring AI to IP, patent workflowsYouTube expands its ‘likeness’ detection technology, which detects AI fakes, to a handful of top creatorsMIT study finds that AI doesn’t, in fact, have valuesAnthropic rolls out a $200-per-month Claude subscriptionUS may fine TSMC $1B over chip allegedly used in Huawei AI processor WordPress.com launches a free AI-powered website builderArtisan, the ‘stop hiring humans’ AI agent startup, raises $25M – and is still hiring humans The complete agenda for TechCrunch Sessions: AI unveiledTessell snags $60M to drive data management at scaleReddit’s conversational AI search tool leverages Google GeminiGemini Code Assist, Google’s AI coding assistant, gets ‘agentic’ abilitiesGoogle’s enterprise cloud gets a music-generating AI modelGoogle’s newest Gemini AI model focuses on efficiencyIronwood is Google’s newest AI accelerator chipGoogle Workspace gets automation flows, podcast-style summariesSamsung adds Google’s Gemini to its home robot BallieDeep Cogito emerges from stealth with hybrid AI ‘reasoning’ modelsA nonprofit is using AI agents to raise money for charityVolunteer your time for a free ticket to TechCrunch Sessions: AITrump to endorse coal for data center power in the face of grim market realitiesMeet the new Audience Choice winners to lead breakouts at TechCrunch Sessions: AIAmazon unveils a new AI voice model, Nova SonicSnapchat rolls out Sponsored AI Lenses for brandsMira Murati’s AI startup gains prominent ex-OpenAI advisorsIBM releases a new mainframe built for the age of AIGoogle is allegedly paying some AI staff to do nothing for a year rather than join rivalsAmazon says its AI video model can now generate minutes-long clipsMeta exec denies the company artificially boosted Llama 4’s benchmark scoresShopify CEO tells teams to consider using AI before growing headcountGoogle’s AI Mode now lets users ask complex questions about imagesWaymo may use interior camera data to train generative AI models, sell adsNintendo says it is ‘actively assessing’ the impact of U.S. tariffsKrea raises $83M to be the one-stop shop for genAI creativesAI video startup Moonvalley raised a fresh $43M, SEC filing showsIBM acquires consultancy Hakkoda in continued AI investment pushOpenAI reportedly mulls buying Jony Ive and Sam Altman’s AI hardware startupMeta’s benchmarks for its new AI models are a bit misleadingMicrosoft releases AI-generated Quake II demo, but admits ‘limitations’Meta releases Llama 4, a new crop of flagship AI models‘A Minecraft Movie’ is on-track for a $135M opening weekendChatGPT adoption skyrockets in India, but monetization may be trailingOpenAI’s models ‘memorized’ copyrighted content, new study suggestsGitHub Copilot introduces new limits, charges for ‘premium’ AI modelsSpy games in HR tech: Inside Rippling’s wild lawsuit against DeelMicrosoft’s Copilot can now browse the web and perform actions for youGemini 2.5 Pro is Google’s most expensive AI model yetOpenAI says it’ll release o3 after all, delays GPT-5Nintendo delays Switch 2 preorders in response to tariffsMidjourney releases its first new AI image model in nearly a yearAmazon’s new AI agent will shop third-party sites for youOpenAI just made its first cybersecurity investment Teen with 4.0 GPA who built the viral Cal AI app was rejected by 15 top universitiesIntel and TSMC are reportedly launching a joint chipmaking ventureAmazon Kindle’s new feature uses AI to generate recaps for books in a seriesDevin, the viral coding AI agent, gets a new pay-as-you-go planMicrosoft reportedly pulls back on its data center plansStudio Ghibli hasn’t commented on OpenAI’s onslaught of AI copies, but the fan subreddit has
Tue. Apr 15th, 2025
Trending News: RLWRLD raises $14.8M to build a foundational model for roboticsDebates over AI benchmarking have reached PokémonGoogle’s newest AI model is designed to help study dolphin ‘speech’OpenAI’s new GPT-4.1 AI models focus on codingOpenAI plans to phase out GPT-4.5, its largest-ever AI model, from its APIGoogle Classroom gives teachers an AI feature for quiz questionsHugging Face buys a humanoid robotics startupMeta to start training its AI models on public content in the EUNvidia says it plans to manufacture some AI chips in the U.S.Access to future AI models in OpenAI’s API may require a verified IDOpenAI co-founder Ilya Sutskever’s Safe Superintelligence reportedly valued at $32BApple’s ‘Mythic Quest’ is ending with an updated Season 4 finaleThe xAI–X merger is a good deal — if you’re betting on Musk’s empireMeta’s vanilla Maverick AI model ranks below rivals on a popular chat benchmarkThe most interesting startups showcased at Google Cloud Next Law professors side with authors battling Meta in AI copyright caseEx-OpenAI staffers file amicus brief opposing the company’s for-profit transitionChatGPT became the most downloaded app globally in MarchIreland’s data regulator investigates X’s use of European user data to train GrokMeta’s Llama drama and how Trump’s tariffs could hit moonshot projectsLess than a month to get your exhibit table for TechCrunch Sessions: AIOpenAI is winding down its GPT-4 AI model in ChatGPTHow Chef Robotics found success by turning away its original customersDeepMind CEO Demis Hassabis says Google will eventually combine its Gemini and Veo AI modelsMira Murati’s AI startup is reportedly aiming for a massive $2B seed roundAI models still struggle to debug software, Microsoft study showsThe US Secretary of Education referred to AI as ‘A1,’ like the steak sauceYouTube rolls out a free AI music-making tool for creatorsLiveKit’s tools power real-time communications, including OpenAI’s Voice ModeCanva is getting AI image generation, interactive coding, spreadsheets and moreOpenAI updates ChatGPT to reference your past chatsNetflix’s latest season of ‘Black Mirror’ comes with a mobile gameGoogle thinks AI can untangle the electrical grid’s bureaucracyAmazon CEO Andy Jassy urges companies to invest heavily in AIThe rise of AI ‘reasoning’ models is making benchmarking more expensiveIncident.io raises $62M at a $400M valuation to help IT teams move fast when things breakAI insurtech Ominimo bags its first investment at a $220M valuationElon Musk’s AI company, xAI, launches an API for Grok 3Google says it’ll embrace Anthropic’s standard for connecting AI models to dataOpenAI counter-sues, calls for Musk to be enjoined from ‘further unlawful and unfair action’Nvidia’s H20 AI chips may be spared from export controls — for nowIlya Sutskever taps Google Cloud to power his AI startup’s researchOpenAI launches program to design new ‘domain-specific’ AI benchmarksSolve Intelligence raises fresh $12M to bring AI to IP, patent workflowsYouTube expands its ‘likeness’ detection technology, which detects AI fakes, to a handful of top creatorsMIT study finds that AI doesn’t, in fact, have valuesAnthropic rolls out a $200-per-month Claude subscriptionUS may fine TSMC $1B over chip allegedly used in Huawei AI processor WordPress.com launches a free AI-powered website builderArtisan, the ‘stop hiring humans’ AI agent startup, raises $25M – and is still hiring humans The complete agenda for TechCrunch Sessions: AI unveiledTessell snags $60M to drive data management at scaleReddit’s conversational AI search tool leverages Google GeminiGemini Code Assist, Google’s AI coding assistant, gets ‘agentic’ abilitiesGoogle’s enterprise cloud gets a music-generating AI modelGoogle’s newest Gemini AI model focuses on efficiencyIronwood is Google’s newest AI accelerator chipGoogle Workspace gets automation flows, podcast-style summariesSamsung adds Google’s Gemini to its home robot BallieDeep Cogito emerges from stealth with hybrid AI ‘reasoning’ modelsA nonprofit is using AI agents to raise money for charityVolunteer your time for a free ticket to TechCrunch Sessions: AITrump to endorse coal for data center power in the face of grim market realitiesMeet the new Audience Choice winners to lead breakouts at TechCrunch Sessions: AIAmazon unveils a new AI voice model, Nova SonicSnapchat rolls out Sponsored AI Lenses for brandsMira Murati’s AI startup gains prominent ex-OpenAI advisorsIBM releases a new mainframe built for the age of AIGoogle is allegedly paying some AI staff to do nothing for a year rather than join rivalsAmazon says its AI video model can now generate minutes-long clipsMeta exec denies the company artificially boosted Llama 4’s benchmark scoresShopify CEO tells teams to consider using AI before growing headcountGoogle’s AI Mode now lets users ask complex questions about imagesWaymo may use interior camera data to train generative AI models, sell adsNintendo says it is ‘actively assessing’ the impact of U.S. tariffsKrea raises $83M to be the one-stop shop for genAI creativesAI video startup Moonvalley raised a fresh $43M, SEC filing showsIBM acquires consultancy Hakkoda in continued AI investment pushOpenAI reportedly mulls buying Jony Ive and Sam Altman’s AI hardware startupMeta’s benchmarks for its new AI models are a bit misleadingMicrosoft releases AI-generated Quake II demo, but admits ‘limitations’Meta releases Llama 4, a new crop of flagship AI models‘A Minecraft Movie’ is on-track for a $135M opening weekendChatGPT adoption skyrockets in India, but monetization may be trailingOpenAI’s models ‘memorized’ copyrighted content, new study suggestsGitHub Copilot introduces new limits, charges for ‘premium’ AI modelsSpy games in HR tech: Inside Rippling’s wild lawsuit against DeelMicrosoft’s Copilot can now browse the web and perform actions for youGemini 2.5 Pro is Google’s most expensive AI model yetOpenAI says it’ll release o3 after all, delays GPT-5Nintendo delays Switch 2 preorders in response to tariffsMidjourney releases its first new AI image model in nearly a yearAmazon’s new AI agent will shop third-party sites for youOpenAI just made its first cybersecurity investment Teen with 4.0 GPA who built the viral Cal AI app was rejected by 15 top universitiesIntel and TSMC are reportedly launching a joint chipmaking ventureAmazon Kindle’s new feature uses AI to generate recaps for books in a seriesDevin, the viral coding AI agent, gets a new pay-as-you-go planMicrosoft reportedly pulls back on its data center plansStudio Ghibli hasn’t commented on OpenAI’s onslaught of AI copies, but the fan subreddit has
Tue. Apr 15th, 2025

Meta’s benchmarks for its new AI models are a bit misleading

  • staffstaff
  • AI
  • April 6, 2025
  • 0 Comments

One of the new flagship AI models Meta released on Saturday, Maverick, ranks second on LM Arena, a test that has human raters compare the outputs of models and choose which they prefer. But it seems the version of Maverick that Meta deployed to LM Arena differs from the version that’s widely available to developers. […]

    • staff

    Related Posts

    RLWRLD raises $14.8M to build a foundational model for robotics

    As robotics has advanced, industry has steadily adopted more robots to automate away many kinds of grunt work. More than 540,000 new industrial robots were installed worldwide in 2023, taking…

    Continue reading
    Debates over AI benchmarking have reached Pokémon

    Not even Pokémon is safe from AI benchmarking controversy. Last week, a post on X went viral, claiming that Google’s latest Gemini model surpassed Anthropic’s flagship Claude model in the…

    Continue reading

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    AI

    RLWRLD raises $14.8M to build a foundational model for robotics

    • By staff
    • April 15, 2025
    • 0 views
    AI

    Debates over AI benchmarking have reached Pokémon

    • By staff
    • April 14, 2025
    • 1 views
    AI

    Google’s newest AI model is designed to help study dolphin ‘speech’

    • By staff
    • April 14, 2025
    • 2 views
    AI

    OpenAI’s new GPT-4.1 AI models focus on coding

    • By staff
    • April 14, 2025
    • 1 views
    AI

    OpenAI plans to phase out GPT-4.5, its largest-ever AI model, from its API

    • By staff
    • April 14, 2025
    • 1 views
    AI

    Google Classroom gives teachers an AI feature for quiz questions

    • By staff
    • April 14, 2025
    • 1 views