0

I have

  • www.example.com with WordPress

and

  • www.example.com/sitetwo with another WordPress

I would allow crawling for the entire example.com and only the home page of example.com/sitetwo. What I have to write in my robots.txt?

Stephen Ostermiller
  • 23,933
  • 14
  • 88
  • 109
michele
  • 26,348
  • 30
  • 111
  • 168

1 Answers1

1
Allow: /sitetwo/$
Disallow: /sitetwo/

$ means "exact match" in this context.

Stephen Ostermiller
  • 23,933
  • 14
  • 88
  • 109
Mike
  • 1,979
  • 2
  • 16
  • 29