0

How to prevent search engines from indexing script URLs like:

domain.tld/?[whatever is here]

robots.txt

User-agent: *
Disallow: /?

does seem to work.

But still to allow indexing of the main page.

Alex G
  • 3,048
  • 10
  • 39
  • 78

1 Answers1

0

Use the URL-encoded "?" (%3D)

User-agent: *
Disallow: /%3D

source: http://www.robotstxt.org/norobots-rfc.txt

Aziz
  • 20,065
  • 8
  • 63
  • 69