robots.txt deny access to specific URL parameters with pretty urls

Question

I have a website that uses pretty urls and need to block certain parameters from search using robots.txt.

How can i use robots.txt to block urls only when features is a parameter of the url. I had read that you can do something like this:

Disallow: *features

And this will block bots from any url that has features in it. Is this true? But i need urls like: http://example.com/vcond/Used/make/mymake To work!!

Thank

score 2 · Accepted Answer · edited May 23 '17 at 12:08

2

Disallow: /*/features

edited May 23 '17 at 12:08

Community

answered Nov 11 '13 at 15:33

sillysaurus2

Note that this does not work for all robots.txt parsers, as the `*` wildcard in `Disallow` is not part of the original robots.txt specification. – unor Nov 12 '13 at 13:39

1 Answers1