# Can an AI tool tell us which of our docs are outdated or conflicting so we can fix them?


URL: https://getunblocked.com/answers/find-outdated-and-conflicting-docs-with-ai/
Published: 2026-11-02T17:00:00Z
Updated: 2026-11-01T13:40:31Z
Author: Dennis Pilarinos
Categories: Context Engine, Engineering Insights

**Short answer:** Partly. Wiki tools can list pages nobody has viewed or verified lately, and research tools can check reference docs against code. Neither tells you which popular page is wrong. The best list of outdated docs comes from questions people already ask: when an AI answer shows a doc disagreeing with the code or a newer thread, that doc goes on the fix list.

---
Partly. No tool today reads your whole wiki and hands back a complete, trustworthy list of every outdated or conflicting page. What you can get is three partial lists, each good at one kind of rot. Wiki tools flag pages that look abandoned. Code checks flag reference docs that no longer match the code. And an AI tool that answers questions across code, tickets, docs and chat flags the conflicts people actually run into. **Outdated docs** are pages whose claims no longer match what the code does or what the team decided since. The third list is the one worth fixing first, because it is the rot someone just tripped over.

|  | Wiki age filters | Code checks | Conflicts in answers |
| --- | --- | --- | --- |
| What it flags | Pages nobody viewed, edited or re-verified | Reference docs that no longer match the code | Any doc that disagrees with code or a newer source |
| Where it works | Confluence, Notion and similar wikis | API docs, docstrings, README examples | Wikis, tickets, chat, PRs and code together |
| What it misses | Busy pages that are wrong | Architecture, onboarding and decision docs | Wrong pages nobody asks about |


## What wiki tools can flag today: pages that look abandoned

The built-in tools work on activity and dates, not on meaning. Confluence's content manager has a "Last active" filter that "shows pages that haven't been viewed, updated, or commented on." You can archive "up to 500 items at a time," and the tool is limited to "Confluence Premium and Enterprise" ([Atlassian support](https://support.atlassian.com/confluence-cloud/docs/manage-your-content-tree)). Notion takes the other route. **Page verification** is Notion's way of marking a page as checked for a set period. Anyone with edit access can verify a page, and "when a page's verification expires, its owner will be notified in their Notion inbox as well as via email" ([Notion help](https://www.notion.com/help/guides/verify-knowledge-your-teammates-can-trust-with-page-verification)).

Both are worth turning on. Neither knows whether a page is right. A runbook that half the team opens every week never shows up as inactive, even if the deploy steps changed in March. A page someone re-verified by clicking a button looks just as fresh as one they actually re-read. Age is a weak hint, not proof. The pages that do the most damage are often the busy ones.

## What code checks can flag: reference docs that drifted

For docs that describe code, such as API references, docstrings and README examples, you can check the doc against the code itself. CASCADE, a tool from an April 2026 study, uses an LLM to "generate unit tests directly from natural-language documentation" and reports a mismatch only when the existing code fails a test that code written from the docs passes. On real open-source projects it "uncovered 13 previously unknown inconsistencies, of which 10 have subsequently been fixed" ([Kiecker et al., arXiv 2604.19400](https://arxiv.org/abs/2604.19400)).

That is a useful result, and a narrow one. It covers docs tied to a single function. It says nothing about the architecture page that still names a service you split last year, the onboarding guide that points to a retired dashboard, or the design doc whose decision got reversed in a Slack thread. A lot of the rot that hurts engineers and coding agents lives there, and no test can run against it.

## What answers can flag: the conflicts people actually hit

The best evidence of a wrong doc shows up when someone asks a question and two sources disagree. For example (a made-up case), an engineer asks for the public API's rate limit. The wiki says 100 requests a minute. The code says 300. A June pull request explains the change. A search-only tool returns the wiki page. A tool that reconciles sources shows both, says which one matches the code, and cites the PR. The answer contains the fix: update the wiki to 300 and link the PR.

**A context engine** is a service that pulls code, PRs, tickets, docs and chat together and settles conflicts between them. Unblocked is one. It treats code as the strongest evidence of how the system behaves now, and says so when sources conflict instead of picking one and hiding the other ([inside the Unblocked context engine](https://getunblocked.com/blog/inside-the-unblocked-context-engine/)).

From an answer, a user can archive an outdated source with a reason teammates can see. Unblocked then stops using it, and "all archived references will be listed on the Recently Archived page." Tagging a title `[deprecated]`, `[archived]` or `[outdated]` does the same automatically ([Unblocked docs](https://docs.getunblocked.com/unblocked-chat/archiving-cited-sources)). That list is your fix list.

The limit: a wrong page nobody asks about stays wrong. It also hurts nobody, and the age filter will archive it.

## A fix-up routine that uses all three

Put the three lists together and the cleanup gets small enough to finish.

1. Monthly, archive the dead pages. Run the Confluence "Last active" filter at six months, or let Notion verification expire on pages nobody renews. Archive rather than delete, so the pages can still be viewed and restored.
2. On every pull request, check reference docs. Keep API docs and READMEs in the repo and change them in the same PR as the code. Add a test-based check like the one above if your stack supports it.
3. Weekly, work the conflict list. Collect the sources your AI tool flagged or that people archived from answers. For each one, fix the page, mark it `[deprecated]` with a link to what replaced it, or delete it. Give the job to the page owner, not a docs team.

The third step is the easiest to skip, and it is the one that lines up with real pain. Our [roundup of tools that stop agents acting on stale documentation](https://getunblocked.com/blog/stop-agents-using-stale-documentation/) compares the verification, docs-from-code and answer-time approaches side by side. Our [comparison of tools that resolve conflicts between docs, code and Slack](https://getunblocked.com/blog/conflicting-context-tools/) covers the conflict side. For what an agent does when the wiki and the code disagree before anyone has fixed anything, see [which source an AI agent believes](https://getunblocked.com/answers/wiki-says-one-thing-code-does-another-which-does-ai-believe/). And [how an AI tool weighs a recent Slack message against an old Confluence doc](https://getunblocked.com/answers/how-an-ai-knowledge-tool-weighs-a-recent-slack-message-against-an-old-confluence-doc/) covers the tie-break between sources.

## Read more

- [Tools That Stop AI Agents From Acting on Stale Documentation (2026)](https://getunblocked.com/blog/stop-agents-using-stale-documentation/)
- [Tools That Resolve Conflicting Information Between Docs, Code, and Slack](https://getunblocked.com/blog/conflicting-context-tools/)

## Related answers

- [There is drift between our repos and our documentation and agents cannot tell. What handles this?](https://getunblocked.com/answers/documentation-drift-between-repos-and-docs-for-ai-agents/)
- [How do I mark old Confluence pages as deprecated so AI stops using them?](https://getunblocked.com/answers/mark-confluence-pages-deprecated-for-ai/)
- [MCP tools are eating the whole context window in Claude Code. How do other teams give agents company context?](https://getunblocked.com/answers/mcp-tools-filling-claude-code-context-window/)
- [We have context all over the place and constantly being generated. How do we organize it so AI pulls the right thing?](https://getunblocked.com/answers/organize-scattered-context-so-ai-pulls-the-right-thing/)