AI Crawler and Schema Checker
Enter a page and see which search and AI crawlers can fetch it, whether it can be indexed and what structured data it carries.
- What you need
- Nothing but the address of a public page on your site.
- How it works
- Fetches the page, robots.txt and site files the way a crawler would, before any JavaScript runs, then reports each finding in plain English with what to fix. Search crawlers and training crawlers are reported separately.
- What it is not
- Checks one page, from a server outside Australia. Allowed in robots.txt does not prove a firewall lets the real crawler through.