Trending News: The US is reviewing Benchmark’s investment into Chinese AI startup Manus Google I/O 2025: What to expect, including updates to Gemini and Android 16SoundCloud changes policies to allow AI training on user contentCoreWeave reportedly looks to raise $1.5B in debt as IPO disappointsMeta’s speeding up the ‘Mad Men to Math Men’ pipelineThis is your last chance to exhibit at TechCrunch Sessions: AI — don’t miss outMicrosoft employees are banned from using DeepSeek app, president says ChatGPT’s deep research tool gets a GitHub connector to answer questions about codeGoogle launches ‘implicit caching’ to make accessing its latest AI models cheaperMeta taps former Google DeepMind director to lead its AI research labEx-Synapse CEO reportedly trying to raise $100M for his new humanoid robotics ventureExhibit your startup at TechCrunch Sessions: AI while you still can! Google rolls out AI tools to protect Chrome users against scamsSequoia leads $1.5B tender offer for sales automation startup ClayOpenAI launches a data residency program in AsiaAmazon’s newest AI tool is designed to enhance product listingsWhy Hims & Hers turned to the autonomous vehicle industry to find an AI-savvy CTOAsking chatbots for short answers can increase hallucinations, study findsInstacart CEO Fidji Simo is joining OpenAIFastino trains AI models on cheap gaming GPUs and just raised $17.5M led by KhoslaAnthropic rolls out an API for AI-powered web searchOpenAI and the FDA are reportedly discussing AI for drug evaluationsAmazon debuts a warehouse robot with a sense of ‘touch’OpenAI wants to team up with governments to grow AI infrastructureApple is looking to add AI search engines to SafariServiceNow acquires Data.World months after snatching up MoveworksMicrosoft adopts Google’s standard for linking up AI agentsFigma releases new AI-powered tools for creating site, app prototypes, and marketing assetsMistral claims its newest AI model delivers leading performance for the priceMark Zuckerberg’s AI ad tool sounds like a social media nightmareAI data startup WisdomAI nabs $23M with a smart way to avoid hallucinationsGame, Sett, Funding: a startup building AI agents for game development emerges from stealth with $27MNetflix debuts its generative AI-powered search toolOx Security lands a fresh $60M to scan for vulnerabilities in codeAmazon is working on an AI code generation toolOpenAI expects to cut share of revenue it pays Microsoft by 2030Hugging Face releases a free Operator-like agentic AI toolReddit will tighten verification to keep out human-like AI botsIBM CEO urges the Trump Administration to increase — not cut — federal AI R&D fundingTechCrunch Sessions: AI welcomes Tanka CEO Kisson Lin to talk AI-native startupsFutureHouse previews an AI tool for ‘data-driven’ biology discoveryWhat OpenAI’s restructuring plan means for its corporate futureGoogle debuts an updated Gemini 2.5 Pro AI model ahead of I/OGoogle’s new ‘Simplify’ feature for iOS uses AI to make dense text easier to understand Particle brings its AI-powered news reader to the webNewLimit, founded by Coinbase CEO Brian Armstorng, raises $130M to develop age-reversing treatmentsUnblocked raises $20M for AI to help devs understand codebasesRelevance AI raises $24M to help businesses build AI agentsBoosted by defense and Starlink, Orca AI pulls in $72.5M for its autonomous shipping platformAnduril is working on the difficult AI-related task of real-time edge computingGoogle accidentally reveals details about its new Android design language, Material 3 ExpressivePeople struggle to get useful health advice from chatbots, study finds11x CEO Hasan Sukkar steps downOver 250 CEOs sign open letter supporting K-12 AI and computer science educationOpenAI reverses course, says its nonprofit will remain in control of its business operationsAnthropic launches a program to support scientific researchRork’s founders were almost broke when a viral tweet led to $2.8M and a16zPinterest updates visual search with more AI-powered featuresAnysphere, which makes Cursor, has reportedly raised $900M at $9B valuationIs Duolingo the face of an AI jobs crisis?Revelo’s LatAm talent network sees strong demand from US companies, thanks to AIGoogle’s Gemini has beaten Pokémon Blue (with a little help)How Riot Games is fighting the war against video game hackersAI chatbots are ‘juicing engagement’ instead of being useful, Instagram co-founder warnsApple and Anthropic reportedly partner to build an AI coding platformOne of Google’s recent Gemini AI models scores worse on safetyGoogle will soon start letting kids under 13 use its Gemini chatbotDamn, the Cluely ragebait got usGoogle’s NotebookLM Android and iOS apps are available for pre-orderOpenAI pledges to make changes to prevent future ChatGPT sycophancyAirbnb is quietly rolling out an AI customer service bot in the USReddit’s AI play is for the Google crowd, not just the community scrollersAmazon CEO says 100,000 users now have Alexa+FutureHouse releases AI tools it claims can accelerate scienceAi2’s new small AI model outperforms similarly-sized models from Google, MetaNvidia takes aim at Anthropic’s support of chip export controlsFivetran acquires Census to become end-to-end data movement platformAnthropic lets users connect more apps to ClaudeEpic Games is launching webshops to allow developers to circumvent app store fees after new rulingGoogle’s AI Mode gets expanded access and additional functionalityLast call to volunteer at TechCrunch Sessions: AIXbox consoles, controllers, and games are getting more expensiveFortnite plans return to the US iOS App Store next weekGoogle is reportedly showing ads in chats with some third-party AI chatbotsMicrosoft’s most capable new Phi 4 AI model rivals the performance of far larger systemsMeta forecasted it would make $1.4T in revenue from generative AI by 2035Sam Altman’s World unveils a mobile verification deviceWorld partners with Tinder, Visa to bring its ID-verifying tech to more placesEpic Games just scored a win against AppleAmazon launches Nova Premier, its most capable AI model yetStudy accuses LM Arena of helping top AI labs game its benchmarkGoogle’s Gemini chatbot gets upgraded image creation toolsMicrosoft expects some AI capacity constraints this quarterVisa and Mastercard unveil AI-powered shoppingAmazon updates Q Business to let companies build public-facing chatbotsPinterest launches new tools to fight AI slopIf you own Ray-Ban Meta glasses, you should double-check your privacy settingsJetBrains releases Mellum, an ‘open’ AI coding modelGruve.ai promises software-like margins for AI tech consulting, disrupting decades-old IndustryAnthropic suggests tweaks to proposed US AI chip export controls
Sat. May 10th, 2025
Trending News: The US is reviewing Benchmark’s investment into Chinese AI startup Manus Google I/O 2025: What to expect, including updates to Gemini and Android 16SoundCloud changes policies to allow AI training on user contentCoreWeave reportedly looks to raise $1.5B in debt as IPO disappointsMeta’s speeding up the ‘Mad Men to Math Men’ pipelineThis is your last chance to exhibit at TechCrunch Sessions: AI — don’t miss outMicrosoft employees are banned from using DeepSeek app, president says ChatGPT’s deep research tool gets a GitHub connector to answer questions about codeGoogle launches ‘implicit caching’ to make accessing its latest AI models cheaperMeta taps former Google DeepMind director to lead its AI research labEx-Synapse CEO reportedly trying to raise $100M for his new humanoid robotics ventureExhibit your startup at TechCrunch Sessions: AI while you still can! Google rolls out AI tools to protect Chrome users against scamsSequoia leads $1.5B tender offer for sales automation startup ClayOpenAI launches a data residency program in AsiaAmazon’s newest AI tool is designed to enhance product listingsWhy Hims & Hers turned to the autonomous vehicle industry to find an AI-savvy CTOAsking chatbots for short answers can increase hallucinations, study findsInstacart CEO Fidji Simo is joining OpenAIFastino trains AI models on cheap gaming GPUs and just raised $17.5M led by KhoslaAnthropic rolls out an API for AI-powered web searchOpenAI and the FDA are reportedly discussing AI for drug evaluationsAmazon debuts a warehouse robot with a sense of ‘touch’OpenAI wants to team up with governments to grow AI infrastructureApple is looking to add AI search engines to SafariServiceNow acquires Data.World months after snatching up MoveworksMicrosoft adopts Google’s standard for linking up AI agentsFigma releases new AI-powered tools for creating site, app prototypes, and marketing assetsMistral claims its newest AI model delivers leading performance for the priceMark Zuckerberg’s AI ad tool sounds like a social media nightmareAI data startup WisdomAI nabs $23M with a smart way to avoid hallucinationsGame, Sett, Funding: a startup building AI agents for game development emerges from stealth with $27MNetflix debuts its generative AI-powered search toolOx Security lands a fresh $60M to scan for vulnerabilities in codeAmazon is working on an AI code generation toolOpenAI expects to cut share of revenue it pays Microsoft by 2030Hugging Face releases a free Operator-like agentic AI toolReddit will tighten verification to keep out human-like AI botsIBM CEO urges the Trump Administration to increase — not cut — federal AI R&D fundingTechCrunch Sessions: AI welcomes Tanka CEO Kisson Lin to talk AI-native startupsFutureHouse previews an AI tool for ‘data-driven’ biology discoveryWhat OpenAI’s restructuring plan means for its corporate futureGoogle debuts an updated Gemini 2.5 Pro AI model ahead of I/OGoogle’s new ‘Simplify’ feature for iOS uses AI to make dense text easier to understand Particle brings its AI-powered news reader to the webNewLimit, founded by Coinbase CEO Brian Armstorng, raises $130M to develop age-reversing treatmentsUnblocked raises $20M for AI to help devs understand codebasesRelevance AI raises $24M to help businesses build AI agentsBoosted by defense and Starlink, Orca AI pulls in $72.5M for its autonomous shipping platformAnduril is working on the difficult AI-related task of real-time edge computingGoogle accidentally reveals details about its new Android design language, Material 3 ExpressivePeople struggle to get useful health advice from chatbots, study finds11x CEO Hasan Sukkar steps downOver 250 CEOs sign open letter supporting K-12 AI and computer science educationOpenAI reverses course, says its nonprofit will remain in control of its business operationsAnthropic launches a program to support scientific researchRork’s founders were almost broke when a viral tweet led to $2.8M and a16zPinterest updates visual search with more AI-powered featuresAnysphere, which makes Cursor, has reportedly raised $900M at $9B valuationIs Duolingo the face of an AI jobs crisis?Revelo’s LatAm talent network sees strong demand from US companies, thanks to AIGoogle’s Gemini has beaten Pokémon Blue (with a little help)How Riot Games is fighting the war against video game hackersAI chatbots are ‘juicing engagement’ instead of being useful, Instagram co-founder warnsApple and Anthropic reportedly partner to build an AI coding platformOne of Google’s recent Gemini AI models scores worse on safetyGoogle will soon start letting kids under 13 use its Gemini chatbotDamn, the Cluely ragebait got usGoogle’s NotebookLM Android and iOS apps are available for pre-orderOpenAI pledges to make changes to prevent future ChatGPT sycophancyAirbnb is quietly rolling out an AI customer service bot in the USReddit’s AI play is for the Google crowd, not just the community scrollersAmazon CEO says 100,000 users now have Alexa+FutureHouse releases AI tools it claims can accelerate scienceAi2’s new small AI model outperforms similarly-sized models from Google, MetaNvidia takes aim at Anthropic’s support of chip export controlsFivetran acquires Census to become end-to-end data movement platformAnthropic lets users connect more apps to ClaudeEpic Games is launching webshops to allow developers to circumvent app store fees after new rulingGoogle’s AI Mode gets expanded access and additional functionalityLast call to volunteer at TechCrunch Sessions: AIXbox consoles, controllers, and games are getting more expensiveFortnite plans return to the US iOS App Store next weekGoogle is reportedly showing ads in chats with some third-party AI chatbotsMicrosoft’s most capable new Phi 4 AI model rivals the performance of far larger systemsMeta forecasted it would make $1.4T in revenue from generative AI by 2035Sam Altman’s World unveils a mobile verification deviceWorld partners with Tinder, Visa to bring its ID-verifying tech to more placesEpic Games just scored a win against AppleAmazon launches Nova Premier, its most capable AI model yetStudy accuses LM Arena of helping top AI labs game its benchmarkGoogle’s Gemini chatbot gets upgraded image creation toolsMicrosoft expects some AI capacity constraints this quarterVisa and Mastercard unveil AI-powered shoppingAmazon updates Q Business to let companies build public-facing chatbotsPinterest launches new tools to fight AI slopIf you own Ray-Ban Meta glasses, you should double-check your privacy settingsJetBrains releases Mellum, an ‘open’ AI coding modelGruve.ai promises software-like margins for AI tech consulting, disrupting decades-old IndustryAnthropic suggests tweaks to proposed US AI chip export controls
Sat. May 10th, 2025

Crowdsourced AI benchmarks have serious flaws, some experts say

  • staffstaff
  • AI
  • April 22, 2025
  • 0 Comments

AI labs are increasingly relying on crowdsourced benchmarking platforms such as Chatbot Arena to probe the strengths and weaknesses of their latest models. But some experts say that there are serious problems with this approach from an ethical and academic perspective. Over the past few years, labs including OpenAI, Google, and Meta have turned to […]

    • staff

    Related Posts

    The US is reviewing Benchmark’s investment into Chinese AI startup Manus 

    Manus AI is one of the hottest AI agent startups around, recently raising $75 million at a half-billion-dollar valuation in a round led by Benchmark. But two unnamed sources told…

    Continue reading
    Google I/O 2025: What to expect, including updates to Gemini and Android 16

    Google I/O, Google’s biggest developer conference of the year, is nearly upon us. Scheduled for May 20 to 21 at the Shoreline Amphitheatre in Mountain View, I/O will showcase product announcements…

    Continue reading

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    AI

    The US is reviewing Benchmark’s investment into Chinese AI startup Manus 

    • By staff
    • May 9, 2025
    • 1 views
    AI

    Google I/O 2025: What to expect, including updates to Gemini and Android 16

    • By staff
    • May 9, 2025
    • 2 views
    AI

    SoundCloud changes policies to allow AI training on user content

    • By staff
    • May 9, 2025
    • 3 views
    AI

    CoreWeave reportedly looks to raise $1.5B in debt as IPO disappoints

    • By staff
    • May 9, 2025
    • 3 views
    AI

    Meta’s speeding up the ‘Mad Men to Math Men’ pipeline

    • By staff
    • May 9, 2025
    • 3 views
    AI

    This is your last chance to exhibit at TechCrunch Sessions: AI — don’t miss out

    • By staff
    • May 9, 2025
    • 5 views