Stop google indexing subdomain

Question

I have subdomain "klient" for testing websites for our clients and I don't want that to be indexed. I have set in robots.txt (in root of our web) this:

User-agent: *
disallow: /subdom/klient/*

But I'm not sure, if it does really work, because I have now found testing site in google results...

Where could be problem or how could we stop google and other bots indexing this folder...?

Thank you

It is subdirectory, based in ./subdom/klient/ and with .htaccess, it is accessible like subdomain (klient.url.com) — stepik21, May 26 '17 at 12:24
From Google's perspective it is a subdomain, not a subdirectory. — John Kugelman, May 26 '17 at 12:58
@JohnKugelman yeah you are right... So what is right solution to go? — stepik21, May 26 '17 at 15:00
Possible duplicate of [How robots.txt file should be properly written for subdomains?](https://stackoverflow.com/questions/43320228/how-robots-txt-file-should-be-properly-written-for-subdomains) — , Jul 06 '17 at 12:17

score 15 · Accepted Answer · edited May 26 '17 at 13:13

15

You can do that by placing a robots.txt in the root directory of your subdomain.

So in your klient.example.com, place a robots.txt with the following content:

User-agent: *
Disallow: /

If you want to remove already indexed pages, create a new webconsole site with your subdomain and remove the indexed pages there.

edited May 26 '17 at 13:13

John Kugelman

349,597
67
533
578

answered May 26 '17 at 12:13

And will this affect all folders in this subdomain? Because the structure is for every client like this: klient.3angle.cz/ourClient/ – stepik21 May 26 '17 at 15:02
1

yes, this will affect all folders in subdomain. so: klient.3angle.cz/ourClient/ klient.3angle.cz/ourClient2/ klient.3angle.cz/newClient/ And every other folder and subfolder in klient.3angle.cz will get affected. – May 26 '17 at 15:08

Stop google indexing subdomain

1 Answers1