I have got troubles with Google indexing my homepage many times in different states of sorting and ordering products that I show on my homepage. The links that appear in google for my site are like this. Approximately 90 times. Obviously, I do not want my homepage indexed 90 times.
http:/www.my-url.com/?dir=desc&limit=12&mode=list&order=name
How do I go about making sure that these duplicate content pages are gone from google? I use this code in a CMSblock to show the products:
<div class="custom-products-widget" style="padding-bottom: 0;">{{block type="catalog/product_list" name="home.catalog.product.list" alias="products_homepage" category_id="5" template="catalog/product/list.phtml" columnCount="5"}}</div>
What I have done/tried so far in this order:
When it was already too late and google had indexed it all, I put this in my robots.txt:
Disallow: /*?*
After that: I removed all urls from google in the webmaster tools, but they came back in greater numbers.
Yesterday, in the Google webmaster tools, I made sure that the URL parameters that cause the duplicate content are not crawled anymore. Namely:
order
dir
limit
mode
I have put the following code in my local.xml, but I found out this only goes for category pages.
<catalog_category_layered> <reference name="head"> <action method="setRobots"><meta>NOINDEX,FOLLOW</meta></action> </reference> </catalog_category_layered> <catalog_category_layered_nochildren> <reference name="head"> <action method="setRobots"><meta>NOINDEX,FOLLOW</meta></action> </reference> </catalog_category_layered_nochildren>
My Question now is: Is there anything more I can or should do? How would I get them out of the google search results and get them de-indexed. Or would I just have to wait now?