NewRun Searchiz from Claude, ChatGPT, Cursor, OpenClaw and Hermes through MCP and CLI. See agent setup

Free tool

AI bot access checker

Enter a domain, or paste a robots.txt, and see which AI crawlers may read your site: the ones that bring you into AI answers, the ones that fetch a page when a person asks, and the ones that only collect training data.

Why it matters

Search crawlers such as OAI-SearchBot, Claude-SearchBot and PerplexityBot read the pages AI answers cite. Blocking them can keep your pages out of those answers. Training crawlers are a separate choice: blocking GPTBot or ClaudeBot does not stop the search crawlers. Allowing a crawler makes a page eligible to be read; it does not guarantee a citation.

The rules are open source: searchiz-bots on GitHub.

Open source tells you what could be wrong. Searchiz tells you whether AI actually recommends you, and fixes it.