# www.robotstxt.org/ # http://code.google.com/web/controlcrawlindex/ User-agent: * Disallow: /cgi-bin/ Disallow: /cache Disallow: /rss/ Disallow: /shared/ Disallow: /logo/ Sitemap: https://inserbia.info/today/sitemap-news.xml Sitemap: https://inserbia.info/today/sitemap.xml Sitemap: https://inserbia.info/vesti/sitemap-news.xml Sitemap: https://inserbia.info/vesti/sitemap.xml