-5

hy, every body, is there anyone that can help me to understand the code i want to know about what the meaning or below code, i am confusing to understand this code in robot.txt file.

Disallow: /?/*
in robot.txt
Alan Moore
  • 73,866
  • 12
  • 100
  • 156
  • It's a secret code; once deciphered it will output [this link](https://www.google.com.au/search?q=robots.txt&oq=robots.txt&aqs=chrome..69i57j5j0l4.1455j0j7&sourceid=chrome&es_sm=122&ie=UTF-8). – Marty Apr 17 '14 at 07:23

2 Answers2

0

This is robots excllusion protocol.This file is to give instructions about their site to web robots and

"Disallow: /"

tells the robot that it should not visit any pages on the site.

You will find more info here

Raj Sf
  • 1,408
  • 1
  • 17
  • 26
0

This robots.txt file is mainly used for the SEO purpose, by including this file, you can provide URLs which you don't want to visit for SEO. So basically, Which URLs you don't want to put on for SEO, just write that URLs in this file, so it will exclude those URLs from the SEO, google analytic

Keyur Mistry
  • 926
  • 6
  • 18