SEO · Operational
Robots and Indexability
Search engines need crawl and index signals that do not block important pages.
Version seo-v1.0
What is this benchmark?
Robots and Indexability
Search engines need crawl and index signals that do not block important pages.
Why it matters
Search engines need crawl and index signals that do not block important pages.
How SiteGlue evaluates it
First-party sampled HTML crawl with SSRF controls. Evidence is stored per check. Rankings and backlinks are not invented.
- Passing criteria
- Verified evidence meets the benchmark. Partial findings score 2.5 of 5.
- Failing criteria
- Verified evidence shows a blocking issue, such as homepage noindex.
- Not verified
- The crawler or PageSpeed Insights could not verify the check.
- Not applicable
- Rare. Most public sites should be evaluable.
Scoring weight: 5. Evidence: Crawled URLs, headers, markup, or labeled PageSpeed Insights vitals.
Example results
Pass
Publish a parseable robots.txt, and remove conflicting noindex signals from pages you want indexed.
Fail
The check failed on crawled evidence, or the report invented a ranking.
Recommended fixes
- Publish a parseable robots.txt, and remove conflicting noindex signals from pages you want indexed.
Frequently asked questions
Does this prove a Google ranking?
No. SEO-v1.0 scores crawlability and on-page evidence. Rankings, traffic, and backlinks stay Unable to Verify until a connected integration exists.
Run the SEO audit.