How to Check an AI Answer
To check an AI answer, pull out each claim you would act on, then confirm it in the original source: the seller's page, the agency's own page, the document you pasted in. Do not ask the AI to vouch for itself, and do not trust a source until you have opened it. AI writes likely-sounding words, so a wrong answer can read exactly like a right one.
It is one of our How to Use AI guides.
Why checking matters
AI can state wrong things in a calm, sure voice, and it can invent sources. In a 2023 federal case in New York, Mata v. Avianca, the court sanctioned lawyers who filed court papers citing cases that an AI tool had made up. The court's opinion is a public record. The lesson is not "avoid AI". It is: whoever sends the words in their own name is responsible for them.
Five steps
- Sort by what is at stake. A casual wording suggestion needs a glance. A price, a date, a rule, a health or safety step, or anything you will send to a customer needs checking.
- List the claims. Ask the AI to number every fact in its answer, so none hides inside a smooth paragraph.
- Find each one at its source. Use the table below to know where to look.
- Open every link and source it gives you. If you cannot find the article, study or case by searching its exact title, treat it as invented.
- Decide: keep it, correct it, or cut it. If you cannot confirm a claim, leave it out.
| The claim is about | Check it against |
|---|---|
| A price or fee | The seller's or agency's own current page or price list |
| A law, license or tax rule | The government agency's own page, or ask a lawyer or accountant |
| A product detail | The maker's manual or label |
| A quote or a date | The original document, e-mail or contract |
| Health or safety | The label, or a qualified professional |
| A statistic | The named organization's own report; no named source, no number |
A worked example
You asked an assistant what to tell a customer about a product's warranty, and it gave you three confident paragraphs. Now send this in the same chat:
List every factual claim in your last answer as a numbered list. For each one, say what kind of source would confirm it, such as the maker's warranty page, the contract or a government site. Mark the ones you are unsure about. If you cited a source, give its exact title. Do not add new claims.
What to look for in the answer:
- More claims than you noticed. That is the point of the list. Each one needs a check.
- The "unsure" marks. Start with those, but do not skip the rest. An AI's own confidence rating is not proof.
- Source titles. Search for each exact title. If nothing real comes up, cut the claim.
- Claims about your own business. If it says you offer something you do not, it filled a gap. Give it the real facts and ask again.
Common mistakes
- Asking "are you sure?" It may say yes, or change a right answer to a wrong one. Check the source instead.
- Checking only the part that looks odd. Wrong details often sit in plausible sentences.
- Trusting an answer that came with links. Links help. Open them, and read the page, not just the title.
- Using a second AI as the proof. A second opinion is useful for finding problems, but two assistants can agree and both be wrong.
- Treating AI as a professional. It does not replace a lawyer, accountant, doctor or a tradesperson with the right license. Take what you learned to them as questions.
Learn it with one of us
Checking is a habit, and it sticks fastest when you practice on your own business facts. In a Build It With a Nerd session, we check what the AI writes together, on a shared screen, as we go. See how the five hours go, and book.
We also teach group AI classes: one five-hour class on one subject, for 7 to 10 people, online or at a booked venue. Reserve a seat without paying; the class runs once seven people have reserved. See the AI basics class.
Next: what not to paste into AI.
Questions people ask
How do I know the AI did not make something up?
You cannot tell from how it sounds. Confirm each fact you will act on in an original source you opened yourself.
Does an answer with web sources mean it is right?
No. Sources make checking easier, but the AI can misread or misreport a page. Open the page and read the part it relies on.
Can I use AI for legal, tax or medical questions?
To learn the vocabulary and prepare questions, yes. Do not act on the answer without a qualified professional or the official source. This page is general information, not legal advice.
Book your session
Build It With a Nerd is five hours with one of us, online on a shared screen or at your table anywhere in Dallas-Fort Worth, spent on your own website or project. Bring your partner, a co-owner or your staff: the price is for the session, not per person. Pick or type your kind of site, answer three short questions, choose an open time and pay on a secure online payment page. A few more questions follow once you have paid, and one of us gets in touch before your session to set up the connection.
Early Cyber Monday launch price: $400. Regular price from December 1: $1,600. The launch price runs through November 30. Pay now and schedule your session whenever you are ready.
Prefer to talk first? Call or text (682) 747-4232. If we are in a session, send us a message with your phone number and one of us will call you back.