What AI hallucinations are and how to reduce them
A language model doesn't consult a store of facts: it generates the most plausible text based on what it has learned. When it doesn't know something, it often doesn't say "I don't know", but fills the gap with something that sounds right. A price, a date, the title of a court ruling, the name of a contact person.
Hallucinations can't be eliminated entirely, but they can be reduced a lot by giving the model the sources to answer from, asking it to cite them and telling it explicitly that it may answer "I don't know".
An example in a small business
An accountant asks a generic chatbot for the deadline of a tax filing and gets a precise date, complete with a legal reference. The reference doesn't exist. The same model, connected to the firm's documents and instructed to answer only from those, says instead that the information isn't in the documents. Less impressive, far more useful.
The most common mistakes
- Trusting a figure because it is written with confidence: tone says nothing about truth.
- Using AI as a search engine for specific facts without checking the source.
- Thinking the newest model doesn't get things wrong: it gets fewer things wrong, but it still does.
Why it matters to you
For a business, the risk is not the wrong answer in itself, but the wrong answer that reaches the customer. Every process that uses AI needs a point where the important data is checked.
All the AI terms explained simply are in the glossary.
Frequently asked questions
Can hallucinations be eliminated?
No, but they can be reduced. The most effective techniques are giving the model the right sources, asking for citations and having a person check the answers that matter.
Does RAG solve hallucinations?
It reduces them, because the model answers from your documents. But it can still misread a document or mix up two pieces of information.
Read next
What is RAG: AI that answers from your documents
RAG (Retrieval Augmented Generation) is a technique where, before answering, the AI searches your documents for the useful passages and uses them as the basis for its answer.
GlossaryWhat's an LLM? The model behind ChatGPT, Claude and Gemini
Almost every AI tool you are offered uses one. Often it is the same one, resold at different prices.
GlossaryWhat a knowledge base is and why AI needs one
A knowledge base is the organised set of your company's information, such as FAQs, procedures, product sheets and terms, from which an AI assistant takes its answers, kept up to date by someone responsible for it.
GlossaryWhat human in the loop means: a person in the AI process
Human in the loop means designing a process with AI so that a person checks or approves the important steps before they take effect.
Want to understand what your business really needs, without the jargon? Let's talk.
Text and graphics created with the support of AI. Method and content are AIR's.