What AI hallucinations are and how to reduce them

AIR Editorial Team
What does it mean when an AI hallucinates?An AI model hallucinates when it produces false or invented information, such as a date, a source or a quotation, and presents it with the same confidence as a true one.
The short version

A language model doesn't consult a store of facts: it generates the most plausible text based on what it has learned. When it doesn't know something, it often doesn't say "I don't know", but fills the gap with something that sounds right. A price, a date, the title of a court ruling, the name of a contact person.

Hallucinations can't be eliminated entirely, but they can be reduced a lot by giving the model the sources to answer from, asking it to cite them and telling it explicitly that it may answer "I don't know".

An example in a small business

An accountant asks a generic chatbot for the deadline of a tax filing and gets a precise date, complete with a legal reference. The reference doesn't exist. The same model, connected to the firm's documents and instructed to answer only from those, says instead that the information isn't in the documents. Less impressive, far more useful.

The most common mistakes

  • Trusting a figure because it is written with confidence: tone says nothing about truth.
  • Using AI as a search engine for specific facts without checking the source.
  • Thinking the newest model doesn't get things wrong: it gets fewer things wrong, but it still does.

Why it matters to you

For a business, the risk is not the wrong answer in itself, but the wrong answer that reaches the customer. Every process that uses AI needs a point where the important data is checked.

All the AI terms explained simply are in the glossary.

Frequently asked questions

Can hallucinations be eliminated?

No, but they can be reduced. The most effective techniques are giving the model the right sources, asking for citations and having a person check the answers that matter.

Does RAG solve hallucinations?

It reduces them, because the model answers from your documents. But it can still misread a document or mix up two pieces of information.

Read next

Want to understand what your business really needs, without the jargon? Let's talk.

Text and graphics created with the support of AI. Method and content are AIR's.

Talk to us