--- path: /robots.txt --- User-agent: * Disallow: /key/ Disallow: /dump/*/ Disallow: /pks/ Disallow: /d/ Disallow: /g/ Disallow: /s/ Disallow: /download/ Disallow: /get/ Disallow: /search/ Sitemap: {{ site.url }}/sitemap.xml