x-robots tag for query string parameter

Question

I want to block a query string url's in .htaccess using x-robots tag. The url's are something like:

https://www.example.com/test?limit=60
https://www.example.com/test?limit=45
https://www.example.com/test?limit=all

I need to block the ?limit=xxx

Ive tried something like this but it doesnt work:

<IfModule mod_headers.c>
<Files "^limit=?$">
Header set X-Robots-Tag "noindex, nofollow"
</Files>
</IfModule>

Doesn't `^` mean "start of the string" there? If so, of cource it won't work, no URI would start with `limit=?`. — M. Prokhorov, Nov 14 '17 at 12:14

score 0 · Answer 1 · answered Nov 14 '17 at 17:47

0

Regular expressions don't work like that. Some pertinent differences:

? and * are quantifiers, not catch-all "match anything" tokens.
^ matches the beginning of the string.

This should work instead:

<IfModule mod_headers.c>
<Files "\?(.*&)?limit=(\d+|all)(&.*)$">
Header set X-Robots-Tag "noindex, nofollow"
</Files>
</IfModule>

answered Nov 14 '17 at 17:47

Nissa

4,636
8
29
37

How would i write it to block multiple query strings eg: https://www.example.com/?c2c_panels=4959 https://www.example.com/?c2c_finish=4708 ? – chappers Jun 28 '18 at 10:36
@chappers You can probably duplicate the `` tag for that. – Nissa Jun 28 '18 at 15:20

score 0 · Accepted Answer · answered Nov 15 '17 at 15:04

0

Got it working with this:

<IfModule mod_rewrite.c>
RewriteCond %{QUERY_STRING} ^limit=([a-zA-Z0-9]*)$
RewriteRule .* - [E=NOINDEX_HEADER:1] 
</IfModule>

<IfModule mod_headers.c>
Header set X-Robots-Tag "noindex" env=NOINDEX_HEADER
</IfModule>

answered Nov 15 '17 at 15:04

chappers

466
1
6
17

x-robots tag for query string parameter

2 Answers2