0

I have a sitemap file called links.txt, and I want only search engine/bots to access this file.

How can I do that via htaccess file.

Hamza
  • 1,087
  • 4
  • 21
  • 47
  • 1
    Generally you can't; you'll need to know all IP addresses that would be used by any search engine's bots that you wish to allow. Other access restriction mechanisms (user agent, for example) are circumventable. – lanzz Jun 22 '12 at 13:15
  • 1
    Just rename it to `links-with-url-nobody-will-ever-guess.txt` and submit that one. Or do you link to the file using some html meta element? – Gerben Jun 22 '12 at 19:29
  • 1
    `robots.txt` is a way to show files to the search engine bots. – Scott Stevens Jun 23 '12 at 04:52

0 Answers0