← Back to articlesHow models work

What is RAG, and why use it for a knowledge base?

RAG retrieves relevant information before generating an answer from it.

The short answer

Retrieval can fail or return the wrong passage. A useful business requirement is a traceable source and a clear response when the information is absent.

Try it in three steps

  • Write a fictional returns policy with three rules.
  • Ask one question answered by the policy.
  • Ask one unsupported question and check that uncertainty is disclosed.

A practice prompt

Before you start

Append three fictional rules and two questions to the prompt. This starter exercise needs no knowledge-base setup.

Practice material (fictional)

Rule 1: Unopened items may be returned within 7 days. Rule 2: Damage needs human review. Rule 3: Refund arrival time is unspecified. Ask about day-3 returns and refund timing.

Replace placeholders in the prompt with this material, or append the material if there are no placeholders. Reading time excludes doing the exercise.

Answer using only these three practice rules, citing rule numbers. Say human confirmation is needed when the rules are silent.

What to look for (not a recorded test result)

The first answer is eligible under rule 1; timing needs confirmation. Pasting material tests grounding, while real RAG also needs implemented and checked retrieval.

If it goes wrong

If an answer is wrong despite a citation, inspect both retrieval and generation rather than only changing models.

Check your result

Pass when supported questions cite the right rules and unsupported questions stop short of guessing.

References and scope

The links below support the concepts or product navigation. The steps and exercises are our teaching suggestions, not official certification or measured customer outcomes. Product interfaces and availability may change. References checked on 2026-10-17.

Start with one task

Describe the current process and its slowest step. The initial conversation is free.

Let’s talk ↗
Need help? See small-scale implementation services ↗

Keep reading