I have
www.example.com
with WordPress
and
www.example.com/sitetwo
with another WordPress
I would allow crawling for the entire example.com
and only the home page of example.com/sitetwo
.
What I have to write in my robots.txt
?
I have
www.example.com
with WordPressand
www.example.com/sitetwo
with another WordPressI would allow crawling for the entire example.com
and only the home page of example.com/sitetwo
.
What I have to write in my robots.txt
?
Allow: /sitetwo/$
Disallow: /sitetwo/
$
means "exact match" in this context.