Workbench guide

How to Use AI for Research Without Getting Fake Facts

AI can find, sort and summarize sources fast. It can also invent them. A simple four-step method: collect sources, pull out evidence, check it, then write.

A magnifying glass over a row of dark clay books on a desk. Through the lens, one book is revealed as a flat yellow cardboard cutout held up with tape.
AI can hand you a source that looks real and is not. Check before you trust it. The Engineer Desk, AI-generated illustration
In this piece

Why it matters

AI writes made-up facts in the same confident voice as true ones. If you cannot point to a source, you cannot trust the sentence.

AI is great at reading a pile of material and telling you what is in it. It is bad at knowing what is true. Ask it a question from memory and it may answer with a fact, a quote or a source that does not exist, written just as confidently as a real one.

In 2023, a New York lawyer filed a court brief that cited cases ChatGPT had made up. When the other side could not find them, the judge found they were fake and [2]. The cases looked real. They had names, dates and quotes.

The fix is simple: never let AI be the source. Let it work only with sources you found and opened yourself.

What you need

Tool Cost What it is for
An AI assistant such as Claude or ChatGPT Free plans available, with limits Sorting, summarizing and drafting
A search engine, plus Google Scholar for studies Free Finding real sources
A notes document Free Saving sources, quotes and links in one place

The method in four steps

  1. Sources: find real sources yourself and save the links.
  2. Evidence: have AI pull out the claims, with the exact words that support each one.
  3. Check: open the source and confirm each claim you plan to use.
  4. Draft: write only from the checked evidence.

Step 1: Collect real sources yourself

Search for your topic and open each result. Prefer original sources: the study itself, not a news story about it; the company's own announcement, not a blog's summary of it; the official documentation, not a forum post.

Save each source in your notes with its title, who published it, the date and the link. Copy the useful parts of the text into your notes too. Five good sources beat twenty weak ones.

AI can help you think of where to look. It should not give you the sources themselves.

PromptWhere to look
I am researching [YOUR QUESTION]. Do not give me facts, numbers or links. Instead, tell me:
1. What kinds of sources would answer this well (for example: government data, a specific type of study, official documentation).
2. Search terms I should try.
3. What a weak or misleading source on this topic usually looks like.

Step 2: Pull out the evidence

Paste the text from your sources into the AI and ask it to pull out claims. The key rule: every claim must come with the exact sentence that supports it, so you can check it.

PromptEvidence from my sources
Below is text I copied from my sources. Each source starts with its name and link.

Using ONLY this text, list the claims that help answer this question: [YOUR QUESTION].

For each claim, give:
- The claim in one plain sentence.
- The exact quote from my text that supports it.
- Which source it came from.

If my sources disagree, show both sides. If something is not in my text, do not add it, even if you know it. At the end, list what my sources do not answer.

MY SOURCES
[SOURCE 1 NAME, LINK]
[PASTED TEXT]

[SOURCE 2 NAME, LINK]
[PASTED TEXT]

The last line of the prompt matters. Knowing what your sources do not cover tells you what to look for next, and where you would otherwise be guessing.

Step 3: Check every claim you will use

For each claim you plan to use, open the source and find the quote. This takes a few minutes and catches the most common problems:

  • The quote is not there. AI sometimes rewrites a quote or blends two sources together.
  • The quote is there, but the meaning changed. "Up to 40%" became "40%". "In mice" disappeared.
  • The source is old. Prices, laws and product features change. Check the date.
  • The source is weak. One person's blog post is not the same as an official report.

Step 4: Write from checked evidence

Now give the AI only the claims you checked, and ask for a draft. It writes faster than you, but it can only use what you gave it.

PromptDraft from checked evidence
Write a [LENGTH, FOR EXAMPLE: 500-word] summary for [WHO WILL READ IT] that answers: [YOUR QUESTION].

Use ONLY the checked claims below. After each claim, add the source name in brackets. Do not add facts, numbers or examples that are not in the list. Where the evidence is weak or the sources disagree, say so plainly. Use simple words and short sentences.

CHECKED CLAIMS
[PASTE YOUR CHECKED CLAIMS WITH THEIR SOURCES]

Read the draft against your checked list one last time. Anything that is not on the list comes out.

Where AI helps, and where you must decide

AI helps with You must decide
Suggesting where to look Which sources are good enough
Summarizing long documents Whether a summary matches the source
Pulling out claims with quotes Whether each claim is true and current
A first draft in plain words What you publish under your name

Common mistakes

  • Asking AI for sources. It may invent them. Find sources yourself.
  • Trusting a summary of a summary. Go back to the original.
  • Ignoring dates. A correct fact from 2021 may be wrong today.
  • Hiding disagreement. If good sources disagree, your reader should know.
  • Checking only the surprising claims. Boring claims can be wrong too. Check everything you publish.

Frequently asked questions

Can I trust AI research tools that show sources?

They are better, because you can click the source. But a link next to a sentence does not prove the source says that. Open it and find the words yourself.

Why does AI make up facts?

AI writes the most likely next words based on patterns. It does not look facts up unless a tool makes it search, and even then it can mix things up. It has no built-in sense of true or false.

Is it okay to use AI for school or work research?

Usually, if you follow your school's or employer's rules and check everything. Many places require you to say when you used AI. Ask first.

What is the fastest way to check a claim?

Search for the exact quote in quotation marks, or open the source and use your browser's find feature (Ctrl+F, or Cmd+F on a Mac) to search for a key word.

Tools and resources

  • Google Scholar Free search for studies and academic papers. scholar.google.com
  • Mata v. Avianca The court case that made AI-invented sources famous. en.wikipedia.org

Sources

  1. ChatGPT cited 'bogus' cases for a New York federal court filing, CNBC (cnbc.com)
  2. Mata v. Avianca, Inc., Wikipedia (en.wikipedia.org)
  3. Google Scholar, Google (scholar.google.com)

Spot an error? Tell us. See how we handle sources and corrections in our editorial standards.

Found this useful? Get The Weekly Desk, one concise email a week.