Stack Overflow
Stack Overflow

Questions tagged [noindex]

The noindex value of an HTML robots meta tag requests that automated Internet bots avoid indexing a web page.

The noindex value of an HTML robots meta tag requests that automated Internet bots avoid indexing a web page.

Example:

<html>
<head>
 <meta name="robots" content="noindex" />
 <title>Don't index this page</title>
</head>
128 questions
0
votes
1 answer

Can I store a page with the NOINDEX metatag?

I'm doing a webcreawler and now I'm trying to follow the robots.txt and the metatags NOINDEX and NOFOLLOW. NOFOLLOW says me to not follow the links in the page, but and the NOINDEX? I understand that it's to not index the page on the searches, but I…
Renato Dinhani
  • 35,057
  • 55
  • 139
  • 199
0
votes
1 answer

Noindex specific category pagination pages

WooCommerce is creating category pagination pages for parent categories. We don't want these indexed, but I can't work out how best to do this. For instance I have https://www.i-hled.co.uk/product-category/light-engines/led-count-one/page/2/ This…
Ruth
  • 71
  • 7
0
votes
1 answer

Do not index all stores in multi-store prestashop 1.7

I have a multi-shop and I want one of the stores not to be indexed in any browser. What do I have to do to avoid indexing? The problem is that they share the robots. What I can do? Can you do that a domain is not indexed in the robots? Being a…
sourcer
  • 67
  • 1
  • 9
0
votes
2 answers

robots.txt handling a # in a URL

Given the following URLs: example.com/products example.com/products#/page-2 example.com/products#/page-3 ... By using the robots.txt file, the first URL (example.com/products) is supposed to be indexed, every other one should be blocked from being…
Marco
  • 1
  • 1
0
votes
2 answers

How to Add noindex for specific page in Shopify store

I have a Shopify store and I want to block search engines to index some products pages, I found this solution…
Sara
  • 11
  • 1
  • 3
0
votes
1 answer

How to use noindex when my is included in all pages with php include?

I need to use in my "thank you page". Google instructions says that I need to put it between tags but my head tags are shared (php included) from same file for all pages, even for those pages which I…
PeterVonSkala
  • 3
  • 3
0
votes
1 answer

How do I stop Wordpress from inserting a noindex meta tag?

I'm trying to get my website to be indexed by search engines. According to this, something from Wordpress is injecting a meta tag that's preventing search engines from crawling my site:…
Chris Pokrzywa
  • 63
  • 1
  • 2
  • 8
0
votes
1 answer

Prestashop - noindex, nofollow in Multistore

I have shop on PrestaShop with Multistore function. I want add "noindex, nofollow" to one of my stores. I have main shop: eg. www.shop.com and second shop eg. www.shop.com/shop2. I want add "noindex, nofollow" only to "shop2". Thanks for help!
Wojtek Jakieła
  • 21
  • 4
0
votes
2 answers

Prevent Search Engines From Crawling Specific Webpage

I have a web-page on which users can fill some data and to do so they need to be logged in. So, when I created the sitemap.xml using xml-sitemaps.com it created several locs asking for login first. Something like: …
user9649287
0
votes
1 answer

meta-robots in auth.php which is included in login.php

If I put in auth.php and include auth.php inside login.php page, the login.php page will not appear on Google or only auth.php won't appear?
John Wiky
  • 19
  • 5
0
votes
1 answer

noindex on pop-up comments

I'm using pop-up comments on my wordpress blog. I know that most people don't recommend this but my audience really likes the comments this way. But recently I discovered that Google is indexing the temporary pop-up comments pages generating a lot…
Evel
  • 67
  • 2
  • 6
0
votes
1 answer

wordpress - How to noindex plugin folders, but not block them

I've searched but haven't found quite what I need. What I'm trying to do is noindex a plugin folders. Google for some reason has indexed a bunch of urls like this for example: /wp-content/plugins/LayerSlider/static/public All that pulls up is a…
stinkysGTI
  • 573
  • 6
  • 21
0
votes
1 answer

Adding noindex tags in Prestashop

I need to add noindex tags for filters and I am not sure which files should I edit in Prestashop (1.6). Is it pagination.tpl or some other file? Also, how should I format the command? Appreciate all the help!
KatGreta
  • 11
  • 5
0
votes
1 answer

Allow Google to Index ONLY the pages I want

I have a large site (40,000+ pages) and want to minimise the level of pages that Google is Indexing, i.e. I wish to index only 500 pages. I can only seem to find the option of Noindex'ing pages and for me to Noindex 39,500 pages wouldn't make…
Owen O'Neill
  • 107
  • 1
  • 3
  • 13
0
votes
1 answer

Set noindex for Google structured data

I'm using multiple blocks of structured data on my website: