What code do I add to Robots.txt to allow:
?app=core&module=global§ion=sitemap&sitemap=sitemap_core_topics_4.xml.gz
But block all other links containing ?
Current Code: Disallow: /*? blocks the above link(s) containing the keyword sitemap.
What code do I add to Robots.txt to allow:
?app=core&module=global§ion=sitemap&sitemap=sitemap_core_topics_4.xml.gz
But block all other links containing ?
Current Code: Disallow: /*? blocks the above link(s) containing the keyword sitemap.
User-agent: *
Allow: /*?app=core&module=global§ion=sitemap&sitemap=sitemap_core_topics_4.xml.gz
Disallow: /*?