Create or repair my sitemap.xml and robots.txt
A crawl-built XML sitemap (only 200-status, indexable canonical pages) and a validated robots.txt.
What you receive
- sitemap.xml (split into an index if over 50,000)
- robots.txt
- Excluded-URL report with reasons
Checked before you are charged
- Sitemap validates against the schema
- Every URL in it returned 200
What this task does not do
- –You upload the files to your site — or use the WordPress connector when it ships
Questions buyers ask
What exactly do I get back?
sitemap.xml (split into an index if over 50,000); robots.txt; Excluded-URL report with reasons.
How are credits calculated?
per site. We measure your files before anything runs and show the exact number. Estimates (where a page count cannot be read up front) are settled on the real count — never more than quoted.
What if it fails?
If the job fails our validation checks, every reserved credit is returned automatically. Credits are not refunded when a valid result simply does not match an unstated preference — the limits above say what this task does and does not do.
Is my data private?
Files are stored privately, processed in an isolated directory, and deleted after 7 days or when you press Delete now. We never train on your files.
Can I re-run with different settings?
Yes — from the job page. The incremental credits are shown before you confirm.