Check a robots.txt file
Paste your robots.txt content below to review common launch issues.
What to look for
A basic robots.txt file should usually allow crawlers to access your public pages and include your sitemap URL.
User-agent: *
Allow: /
Sitemap: https://www.example.com/sitemap.xml