Log in

Product

Everything OpenCrawl measures for AI visibility

OpenCrawl combines crawler access checks, content-readiness signals, live ChatGPT prompts, and open-web search so you can see whether AI systems can find—and cite—your website.

Crawlability audit

Before an answer engine can recommend you, AI crawlers need a clear path to your pages. OpenCrawl audits robots rules and fetch behavior for major AI bots, including GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, PerplexityBot, Google-Extended, CCBot, and others.

  • robots.txt allow / block analysis for AI user-agents
  • Homepage fetch with a GPTBot user-agent when reachable
  • Discovery files: sitemap.xml, llms.txt, and llms-full.txt
  • Content readiness: title, meta description, Open Graph, JSON-LD, headings
  • Empty SPA-shell detection and Common Crawl presence checks

20 buyer-intent prompts

Each full scan runs 20 neutral buyer-intent prompts: 8 through live ChatGPT web search and 12 through Exa open-web semantic search. Prompts are written to reflect how buyers ask for solutions—not to stuff your brand name into every query.

Score, evidence, and competitors

Results roll into a five-pillar AI visibility score with citation sources, mention and recommendation rates, competitor appearances, and score history across scans. See the full weighting on themethodology page.

Actionable reports and exports

Findings become a prioritized action plan with concrete fixes. Export the report as PDF, CSV, or JSON when you need to share evidence with teammates or clients.

Start with ProView pricingRead methodology

FAQ

Which AI crawlers does OpenCrawl check?

OpenCrawl audits access signals for bots including GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-Web, anthropic-ai, PerplexityBot, Google-Extended, CCBot, Bytespider, Amazonbot, meta-externalagent, and Applebot-Extended.

What is included in a full visibility scan?

A full scan runs a crawlability audit plus 20 buyer-intent prompts—8 through live ChatGPT web search and 12 through Exa open-web search—then produces a composite score, evidence, competitors, and an action plan.