A new research paper from OpenAI asks why large language models like GPT-5 and chatbots like ChatGPT still hallucinate and whether anything can be done to reduce those hallucinations. In a blog post summarizing the paper, OpenAI defines hallucinations as “plausible but false statements generated by language models,” and it acknowledges that despite improvements, hallucinations […]
Are bad incentives to blame for AI hallucinations? Read More »
Turns out, telling an AI chatbot to be concise could make it hallucinate more than it otherwise would have. That’s according to a new study from Giskard, a Paris-based AI testing company developing a holistic benchmark for AI models. In a blog post detailing their findings, researchers at Giskard say prompts for shorter answers to
Asking chatbots for short answers can increase hallucinations, study finds Read More »
In an announcement perhaps timed to divert attention away from OpenAI’s Operator, Anthropic Thursday unveiled a new feature for its developer API called Citations, which lets devs “ground” answers from its Claude family of AI in source documents such as emails. Anthropic says Citations allows its AI models to provide detailed references to “the exact
Anthropic’s new Citations feature aims to reduce AI errors Read More »
AI might excel at certain tasks like coding or generating a podcast. But it struggles to pass a high-level history exam, a new paper has found. A team of researchers has created a new benchmark to test three top large language models (LLMs) — OpenAI’s GPT-4, Meta’s Llama, and Google’s Gemini — on historical questions.
AI isn’t very good at history, new paper finds Read More »
Earlier this week, DeepSeek, a well-funded Chinese AI lab, released an “open” AI model that beats many rivals on popular benchmarks. The model, DeepSeek V3, is large but efficient, handling text-based tasks like coding and writing essays with ease. It also seems to think it’s ChatGPT. Posts on X — and TechCrunch’s own tests —
Why DeepSeek’s new AI model thinks it’s ChatGPT Read More »
Amazon Web Services (AWS), Amazon’s cloud computing division, is launching a new tool to combat hallucinations — that is, scenarios where an AI model behaves unreliably. Announced at AWS’ re:Invent 2024 conference in Las Vegas, the service, Automated Reasoning checks, validates a model’s responses by cross-referencing customer-supplied info for accuracy. AWS claims in a press
AWS’ new service tackles AI hallucinations Read More »
Every IPO S-1 prospectus includes a section listing all kinds risk factors for why its stock may not be a good buy. Many of them are boilerplate warnings, cautions over financial performance, or acts of war and nature. But some of them are more specific to the company. With ServiceTitan, a cloud service startup that
ServiceTitan names LLMs from Microsoft, OpenAI as risk factors Read More »
AI is a notorious liar, and Microsoft now says it has a fix for that. Understandably, that’s going to raise some eyebrows, but there’s reason to be skeptical. Microsoft today revealed Correction, a service that attempts to automatically revise AI-generated text that’s factually wrong. Correction first flags text that may be erroneous — say, a
Microsoft claims its new tool can correct AI hallucinations, but experts advise caution Read More »
All generative AI models hallucinate, from Google’s Gemini to Anthropic’s Claude to the latest stealth release of OpenAI’s GPT-4o. The models are unreliable narrators in other words — sometimes to hilarious effect, other times problematically so. But not all models make things up at the same rate. And the kinds of mistruths they spout depend
Study suggests that even the best AI models hallucinate a bunch Read More »
