Check a site’s robots.txt for mistakes and test whether any URL is allowed for Googlebot, Bingbot or AI crawlers like GPTBot.
robots.txt tells crawlers which parts of a site they may visit. One wrong line can hide a whole section from Google, or let AI crawlers in when you meant to keep them out. Enter any page URL to fetch its site’s robots.txt, see which rule applies, and check every common crawler at once.
Validate JSON-LD and check it against Google’s rich-result rules.
See how a link looks on Facebook, LinkedIn, X and Slack.
See the H1–H6 outline and fix skipped or missing headings.
Check every page of your site, not just one URL.
Want every page of your site checked automatically?
Start a Free Audit