Trending News: Why Intempus thinks robots should have a human physiological stateLast 24 hours: TechCrunch Disrupt 2025 Early Bird Deals will fly away after today48 hours left: What you won’t want to miss at the 20th TechCrunch Disrupt in OctoberKhosla Ventures among VCs experimenting with AI-infused roll-ups of mature companiesOpenAI upgrades the AI model powering its Operator agentMarjorie Taylor Greene picked a fight with GrokMicrosoft says its Aurora AI can accurately predict air quality, typhoons, and moreOpenAI goes all in with Jony Ive as Google plays AI catchupAt TechCrunch Sessions: AI, Artemis Seaford and Ion Stoica confront the ethical crisis — when AI crosses the lineTick tock: Just 3 days left to save up to $900 on your TechCrunch Disrupt 2025 passFounders First: Iliana Quinonez of Google Cloud on AI agents, infrastructure, and democratization at TechCrunch Sessions: AIAfter Klarna, Zoom’s CEO also uses an AI avatar on quarterly callAnthropic CEO claims AI models hallucinate less than humansAnthropic’s latest flagship AI sure seems to love using the ‘cyclone’ emojiA safety institute advised against releasing an early version of Anthropic’s Claude Opus 4 AI modelAnthropic’s new AI model turns to blackmail when engineers try to take it offlineAnthropic’s new Claude 4 AI models can reason over many stepsMeta adds another 650 MW of solar power to its AI pushVercel debuts an AI model optimized for web developmentOpenAI teams up with Cisco, Oracle to build UAE data centerThe complete Side Events lineup at TechCrunch Sessions: AI4 days left: Up to $900 off your ticket and 90% off for your +1 at TechCrunch Disrupt 2025OpenAI’s next big bet won’t be a wearable: reportKlarna used an AI avatar of its CEO to deliver earnings, it saidLM Arena, the organization behind popular AI leaderboards, lands $100MMeta launches program to encourage startups to use its Llama AI modelsJony Ive to lead OpenAI’s design work following $6.5B acquisition of his companyTensions flare between the US and China over Huawei’s AI chipsGoogle is bringing ads to AI ModeAmazon rolls out short-form AI-powered audio product summaries for select itemsMistral’s new Devstral AI model was designed for codingTechCrunch Disrupt 2025 Early Bird savings end on May 25Shopify launches an AI-powered store builder as part of its latest updateGoogle’s AI agents will bring you the web nowUber Freight bets big on AI tools to grow its businessFortnite returns to the US App Store after a five-year gapGoogle’s Sergey Brin: ‘I made a lot of mistakes with Google Glass’Google commits $150M to develop AI glasses with Warby ParkerThe latest Google Gemma AI model can run on phonesGoogle is launching a Gemini integration in ChromeGoogle AI Ultra: You’ll have to pay $249.99 per month for Google’s best AIVeo 3 can generate videos — and soundtracks to go along with themGoogle introduces Shop with AI Mode with price tracking, agentic checkout and virtual try-onStitch is Google’s AI-powered tool to help design appsProject Astra comes to Google Search, Gemini, and developersIntel is reportedly exploring a sale for its networking and edge unitGoogle’s AI Mode rolls out to US, will add support for deeper research, comparison shopping, and moreGoogle’s Gemini AI app has 400M monthly active usersGoogle’s NotebookLM is getting Video OverviewsGoogle shows off Android XR-based glasses, announces Warby Parker team-upGoogle’s 3D teleconferencing platform, now called Beam, will ship later in 2025Google unveils new AI features coming to Gmail, Docs, and VidsGoogle updates the Gemini app with real-time AI video, Deep Research, and moreGoogle rolls out Project Mariner, its web-browsing AI agentYou’ve got 6 days to save $900 on TechCrunch Disrupt 2025 ticketsApple reportedly plans to let developers build on top of its AITwelve Labs CEO Jae Lee is coming to TechCrunch Sessions: AIAmazon’s Danielle Perszyk is coming to TechCrunch Sessions: AIAgentic AI platform Manus launches a paid plan for teamsOnce worth over $1B, Microsoft-backed Builder.ai is running out of moneyGoogle DeepMind’s Logan Kilpatrick is coming to TechCrunch Sessions: AIOpenAI’s Codex is part of a new cohort of agentic coding toolsAlation acquires Numbers Station to bolster its AI agent offeringsKlarna’s revenue per employee soars to nearly $1M thanks to AI efficiency pushJudge pressures Apple to approve Fortnite or return to courtAMD strikes a deal to sell ZT Systems’ server-manufacturing business for $3BTrump to sign bill criminalizing revenge porn and explicit deepfakesGoogle launches standalone NotebookLM app for AndroidxAI’s Grok 3 comes to Microsoft AzureMicrosoft open-sources a command-line text editor and more at BuildGitHub, Microsoft embrace Anthropic’s spec for connecting AI models to data sourcesDevs can now tap Microsoft Edge to power AI web appsNLWeb is Microsoft’s project to bring more chatbots to webpagesMicrosoft wants to tap AI to accelerate scientific discoveryAI dev tools for Windows get a fresh coat of paintClock’s ticking: Save up to $900 on TechCrunch Disrupt 2025 tickets before prices riseEx-Siri head reportedly wanted Apple to choose Google’s Gemini over ChatGPTGrok says it’s ‘skeptical’ about Holocaust death toll, then blames ‘programming error’U.S. lawmakers have concerns about Apple-Alibaba dealMicrosoft’s Satya Nadella is choosing chatbots over podcastsMIT disavows doctoral student paper on AI’s productivity benefitsEpic Games asks judge to force Apple to approve FortniteY Combinator startup Firecrawl is ready to pay $1M to hire three AI agents as employeesOpenAI’s planned data center in Abu Dhabi would be bigger than MonacoAI startup Cohere acquires Ottogrid, a platform for conducting market researchAI video startup Moonvalley lands $53M, according to filingOpenAI launches Codex, an AI coding agent, in ChatGPTIs $1 billion a lot of money these days?Epic Games says Apple is blocking Fortnite from the US and EU App StoresxAI blames Grok’s obsession with white genocide on an ‘unauthorized modification’Sam Altman’s goal for ChatGPT to remember ‘your whole life’ is both exciting and disturbingFake fired Twitter worker ‘Rahul Ligma’ is a real engineer with an AI data startup used by HarvardVibe coding startup Windsurf launches in-house AI modelsAnthropic’s lawyer was forced to apologize after Claude hallucinated a legal citationProgrammers bore the brunt of Microsoft’s layoffs in its home state as AI writes up to 30% of its codeGoogle rolls out new AI and accessibility features to Android and ChromeCognichip emerges from stealth with the goal of using generative AI to develop new chipsHedra, the app used to make talking baby podcasts, raises $32M from a16zHarvey reportedly in discussions to raise $250M at $5B valuationGrok is unpromptedly telling X users about South African ‘white genocide’
Mon. May 26th, 2025 4:23:00 AM
Trending News: Why Intempus thinks robots should have a human physiological stateLast 24 hours: TechCrunch Disrupt 2025 Early Bird Deals will fly away after today48 hours left: What you won’t want to miss at the 20th TechCrunch Disrupt in OctoberKhosla Ventures among VCs experimenting with AI-infused roll-ups of mature companiesOpenAI upgrades the AI model powering its Operator agentMarjorie Taylor Greene picked a fight with GrokMicrosoft says its Aurora AI can accurately predict air quality, typhoons, and moreOpenAI goes all in with Jony Ive as Google plays AI catchupAt TechCrunch Sessions: AI, Artemis Seaford and Ion Stoica confront the ethical crisis — when AI crosses the lineTick tock: Just 3 days left to save up to $900 on your TechCrunch Disrupt 2025 passFounders First: Iliana Quinonez of Google Cloud on AI agents, infrastructure, and democratization at TechCrunch Sessions: AIAfter Klarna, Zoom’s CEO also uses an AI avatar on quarterly callAnthropic CEO claims AI models hallucinate less than humansAnthropic’s latest flagship AI sure seems to love using the ‘cyclone’ emojiA safety institute advised against releasing an early version of Anthropic’s Claude Opus 4 AI modelAnthropic’s new AI model turns to blackmail when engineers try to take it offlineAnthropic’s new Claude 4 AI models can reason over many stepsMeta adds another 650 MW of solar power to its AI pushVercel debuts an AI model optimized for web developmentOpenAI teams up with Cisco, Oracle to build UAE data centerThe complete Side Events lineup at TechCrunch Sessions: AI4 days left: Up to $900 off your ticket and 90% off for your +1 at TechCrunch Disrupt 2025OpenAI’s next big bet won’t be a wearable: reportKlarna used an AI avatar of its CEO to deliver earnings, it saidLM Arena, the organization behind popular AI leaderboards, lands $100MMeta launches program to encourage startups to use its Llama AI modelsJony Ive to lead OpenAI’s design work following $6.5B acquisition of his companyTensions flare between the US and China over Huawei’s AI chipsGoogle is bringing ads to AI ModeAmazon rolls out short-form AI-powered audio product summaries for select itemsMistral’s new Devstral AI model was designed for codingTechCrunch Disrupt 2025 Early Bird savings end on May 25Shopify launches an AI-powered store builder as part of its latest updateGoogle’s AI agents will bring you the web nowUber Freight bets big on AI tools to grow its businessFortnite returns to the US App Store after a five-year gapGoogle’s Sergey Brin: ‘I made a lot of mistakes with Google Glass’Google commits $150M to develop AI glasses with Warby ParkerThe latest Google Gemma AI model can run on phonesGoogle is launching a Gemini integration in ChromeGoogle AI Ultra: You’ll have to pay $249.99 per month for Google’s best AIVeo 3 can generate videos — and soundtracks to go along with themGoogle introduces Shop with AI Mode with price tracking, agentic checkout and virtual try-onStitch is Google’s AI-powered tool to help design appsProject Astra comes to Google Search, Gemini, and developersIntel is reportedly exploring a sale for its networking and edge unitGoogle’s AI Mode rolls out to US, will add support for deeper research, comparison shopping, and moreGoogle’s Gemini AI app has 400M monthly active usersGoogle’s NotebookLM is getting Video OverviewsGoogle shows off Android XR-based glasses, announces Warby Parker team-upGoogle’s 3D teleconferencing platform, now called Beam, will ship later in 2025Google unveils new AI features coming to Gmail, Docs, and VidsGoogle updates the Gemini app with real-time AI video, Deep Research, and moreGoogle rolls out Project Mariner, its web-browsing AI agentYou’ve got 6 days to save $900 on TechCrunch Disrupt 2025 ticketsApple reportedly plans to let developers build on top of its AITwelve Labs CEO Jae Lee is coming to TechCrunch Sessions: AIAmazon’s Danielle Perszyk is coming to TechCrunch Sessions: AIAgentic AI platform Manus launches a paid plan for teamsOnce worth over $1B, Microsoft-backed Builder.ai is running out of moneyGoogle DeepMind’s Logan Kilpatrick is coming to TechCrunch Sessions: AIOpenAI’s Codex is part of a new cohort of agentic coding toolsAlation acquires Numbers Station to bolster its AI agent offeringsKlarna’s revenue per employee soars to nearly $1M thanks to AI efficiency pushJudge pressures Apple to approve Fortnite or return to courtAMD strikes a deal to sell ZT Systems’ server-manufacturing business for $3BTrump to sign bill criminalizing revenge porn and explicit deepfakesGoogle launches standalone NotebookLM app for AndroidxAI’s Grok 3 comes to Microsoft AzureMicrosoft open-sources a command-line text editor and more at BuildGitHub, Microsoft embrace Anthropic’s spec for connecting AI models to data sourcesDevs can now tap Microsoft Edge to power AI web appsNLWeb is Microsoft’s project to bring more chatbots to webpagesMicrosoft wants to tap AI to accelerate scientific discoveryAI dev tools for Windows get a fresh coat of paintClock’s ticking: Save up to $900 on TechCrunch Disrupt 2025 tickets before prices riseEx-Siri head reportedly wanted Apple to choose Google’s Gemini over ChatGPTGrok says it’s ‘skeptical’ about Holocaust death toll, then blames ‘programming error’U.S. lawmakers have concerns about Apple-Alibaba dealMicrosoft’s Satya Nadella is choosing chatbots over podcastsMIT disavows doctoral student paper on AI’s productivity benefitsEpic Games asks judge to force Apple to approve FortniteY Combinator startup Firecrawl is ready to pay $1M to hire three AI agents as employeesOpenAI’s planned data center in Abu Dhabi would be bigger than MonacoAI startup Cohere acquires Ottogrid, a platform for conducting market researchAI video startup Moonvalley lands $53M, according to filingOpenAI launches Codex, an AI coding agent, in ChatGPTIs $1 billion a lot of money these days?Epic Games says Apple is blocking Fortnite from the US and EU App StoresxAI blames Grok’s obsession with white genocide on an ‘unauthorized modification’Sam Altman’s goal for ChatGPT to remember ‘your whole life’ is both exciting and disturbingFake fired Twitter worker ‘Rahul Ligma’ is a real engineer with an AI data startup used by HarvardVibe coding startup Windsurf launches in-house AI modelsAnthropic’s lawyer was forced to apologize after Claude hallucinated a legal citationProgrammers bore the brunt of Microsoft’s layoffs in its home state as AI writes up to 30% of its codeGoogle rolls out new AI and accessibility features to Android and ChromeCognichip emerges from stealth with the goal of using generative AI to develop new chipsHedra, the app used to make talking baby podcasts, raises $32M from a16zHarvey reportedly in discussions to raise $250M at $5B valuationGrok is unpromptedly telling X users about South African ‘white genocide’
Mon. May 26th, 2025 4:23:00 AM

Crowdsourced AI benchmarks have serious flaws, some experts say

  • staffstaff
  • AI
  • April 22, 2025
  • 0 Comments

AI labs are increasingly relying on crowdsourced benchmarking platforms such as Chatbot Arena to probe the strengths and weaknesses of their latest models. But some experts say that there are serious problems with this approach from an ethical and academic perspective. Over the past few years, labs including OpenAI, Google, and Meta have turned to […]

    • staff

    Related Posts

    48 hours left: What you won’t want to miss at the 20th TechCrunch Disrupt in October

    ​​There are just 48 hours left to save up to $900 on your ticket to TechCrunch Disrupt 2025 — and get 90% off the second. After May 25 at 11:59…

    Continue reading
    Last 24 hours: TechCrunch Disrupt 2025 Early Bird Deals will fly away after today

    Just 24 hours left to lock in Early Bird pricing for TechCrunch Disrupt 2025 — happening October 27–29 at Moscone West in San Francisco. Save up to $900 on your…

    Continue reading

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    AI

    Why Intempus thinks robots should have a human physiological state

    • By staff
    • May 25, 2025
    • 1 views
    AI

    Last 24 hours: TechCrunch Disrupt 2025 Early Bird Deals will fly away after today

    • By staff
    • May 25, 2025
    • 1 views
    AI

    48 hours left: What you won’t want to miss at the 20th TechCrunch Disrupt in October

    • By staff
    • May 25, 2025
    • 1 views
    AI

    Khosla Ventures among VCs experimenting with AI-infused roll-ups of mature companies

    • By staff
    • May 23, 2025
    • 3 views