-1

I have placed my product showcase on subdomain such as http://demo.domain.com/productname/. Demo version of product is located at http://demo.domain.com/productname/demo/. I would like to disallow crawling demo version, can someone help me ?

w3bariak
  • 1
  • 1

1 Answers1

4

The robots.txt must be in the root; if you have placed your Demo Version Of product in subdomain's folder then you need to change subdomains robots.txt file which should be aka; http://demo.domain.com/robots.txt

robots.txt:

user-agent: *
disallow: /productname/demo
allow: /
Jason Clark
  • 103
  • 5
yagmoth555
  • 16,758
  • 4
  • 29
  • 50