Sitemap: https://nzarchaeology.org/sitemap.xml User-agent: * Disallow: /wp-admin/ User-Agent: Googlebot Allow: .js Allow: .css User-agent: Amazonbot Disallow: / User-agent: TurnitinBot Disallow: / #Will disallow all urls on your site User-agent: serpstatbot Disallow: /