AI assistants are right a lot of the time, which makes it easy to stop checking. But they can be wrong while sounding completely sure. Here's how much checking each kind of answer needs, and quick ways to do it.
How much checking does it need?
Match the checking to what's at stake.
| If the answer is... | Check it... | For example |
| Easy to judge yourself | By reading it | An email draft, a list of gift ideas, a summary of your own notes |
| A fact you'll pass on | Against one trusted source | A date, a statistic, a quote, a product detail |
| Something you'll act on | Against an official source, or a person who knows | A rule, a deadline, a recipe for someone with an allergy, a formula for your budget |
| About health, law, money, or safety | With a qualified professional | Medication, a contract, a tax question, an electrical repair |
Quick ways to check
- Ask where it came from. "What's your source for that?" Then open the source and make sure it exists and says what the assistant claims. Made-up sources are common.
- Ask how sure it is. "How confident are you?" and "What might be wrong with this answer?" often bring out the weak spots.
- Ask again, differently. Rephrase the question, or ask in a new chat. If the answers disagree, neither is safe to rely on.
- Try a second assistant. If two assistants agree, it's a good sign, though not proof.
- Search it yourself. For a fact or figure, a quick web search often settles it, especially on an official site.
- Test it. For a formula, a recipe, or instructions, try it on something small first: a few rows, a half batch, or a copy of the file.
- Check the date. Ask "Is this likely to be out of date?" for anything about prices, rules, or products.
Warning signs
Be extra careful when an answer:
- Gives very precise numbers, names, or quotes for something obscure.
- Cites a study, case, or article you can't find anywhere.
- Changes its answer as soon as you push back, or agrees with everything you say.
- Is about something very recent, very local, or very specialized.
- Sounds like exactly what you hoped to hear.
Checking summaries
When an assistant summarizes a document, meeting, or email thread for you:
- Skim the original for anything important the summary left out.
- Check that names, numbers, and dates in the summary match the original.
- Ask "What did you leave out?" or "Quote the part of the document that says this."
My page on the risks of using AI explains why assistants get things wrong in the first place.