Why is there no SEO score?
Because no public formula would be honest. Google does not publish one, and a single number hides what matters: a noindex tag or a blocked Googlebot outweighs every other check combined. The audit instead counts, per area, what to fix and what to improve, ranks the fixes, and links the official source for each rule.
Why doesn’t it warn that my title or meta description is too long?
Google publishes no character limit for either. Its documentation says there is no limit on length and that results are truncated "as needed, typically to fit the device width" (title link and snippet docs). The audit therefore previews how your title renders at desktop and phone width and tells you where it would be cut, which is the part you can act on.
What does the AI & GEO section actually check?
What is documented. Google says a page must be indexed and eligible for a snippet to appear in its generative AI features, so noindex, nosnippet and a blocked Googlebot are reported as fixes. AI search products document their own search crawlers, so the audit checks those against your robots.txt. Signals that are sensible but not documented as ranking factors, such as a visible author or date, are labelled heuristics.
If I block GPTBot, will my site disappear from ChatGPT?
No. OpenAI documents two separate controls: OAI-SearchBot decides whether you can appear in ChatGPT search answers, and GPTBot covers model training. "Each setting is independent of the others", so blocking GPTBot while allowing OAI-SearchBot keeps you eligible for ChatGPT search (OpenAI crawler docs, read 2026-09-23).
Does blocking Google-Extended remove me from Google Search or AI Overviews?
Google says Google-Extended "does not impact a site's inclusion in Google Search nor is it used as a ranking signal". It controls use in Gemini training and grounding. Google Search features, including AI Overviews, run on the Googlebot crawl, so blocking Googlebot is what removes a page (Google common crawlers doc, read 2026-09-23).
Why does the tool call my Bytespider block "policy" instead of an error?
We found no first-party documentation for Bytespider, so its purpose is unknown and blocking it costs no visibility this tool can measure. Blocks of training, dataset or undocumented crawlers are treated as your policy. Only blocks that cost search or AI-search visibility you asked for are marked "Fix".
Do AI assistants obey robots.txt when a user asks them to open my page?
It depends on the vendor. OpenAI says robots.txt rules "may not apply" to ChatGPT-User; Perplexity says Perplexity-User "generally ignores robots.txt rules"; Meta says Meta-ExternalFetcher "may bypass robots.txt rules". Anthropic says its bots respect robots.txt and lists Claude-User among them. The reference table below carries each vendor’s wording and source.
Does the site scan send my pages to your server?
No. The scanner runs in your browser, on your own site: it reads your robots.txt, sitemap and pages from your own connection, without cookies, and sends only the findings to the pyralislabs.io tab you have open. Our Worker is not involved and makes no requests to your site. You can also download the results as a file and import them later.
Why does the site scan use a bookmarklet?
Browsers do not let one website read another (the same-origin policy), so a page on pyralislabs.io cannot fetch your pages. Running the scanner on your own site makes every request same-origin, the same as you opening those pages. If your site’s Content-Security-Policy blocks the scanner script, the report tab gives you the same code to paste into the browser console instead.
Do I need an llms.txt file?
It is optional. llms.txt is a proposed convention (llmstxt.org) for giving agents a curated, markdown map of a site. Google states the file is not needed for Google Search and does not affect rankings (Search Central changelog, 15 June 2026). If you publish one, this tool checks its structure and links; it never overwrites a file you already have.
Will the proposed robots.txt delete my existing rules?
No. The builder rewrites only the AI crawlers whose current verdict differs from the policy you picked. Every other line — comments, sitemaps, search-engine groups, private-path rules — is kept, and the diff view shows exactly which lines change. When it opens a crawler, it carries over your private-path Disallow rules.
Can I test a robots.txt before I deploy it?
Yes. Use "Paste robots.txt". The draft is parsed in your browser only; nothing is sent to us. Add a page path to see whether a specific URL is reachable for each crawler.