robots.txt in Laravel

Question

I just was wondering if the robots.txt file is supposed to work like general robots txt files. So, you type for example "disallow/admin/*" place it into the the root Laravel folder and that's it.

Is it like this ?

score 18 · Accepted Answer · edited Sep 13 '19 at 15:46

18

Remember, that website address is relevant to public dir. So, if you want robots.txt to work in Laravel, it must be placed in the public folder.

edited Sep 13 '19 at 15:46

Rik

3,647
2
25
34

answered Dec 16 '16 at 15:25

Michał G

2,234
19
27

Bruh, is it ok to let it being accessable from the site/browser? – Trisno Raynaldy Oct 30 '19 at 04:38
yes. robots.txt should be public – Kat Lim Ruiz Oct 30 '21 at 20:30

score 0 · Answer 2 · edited Sep 13 '19 at 18:23

0

robots.txt is a special file used by search bots to read and crawl the website resources.

robots.txt should be at the root of the website.

The root directory differs from OS to OS. I am giving a few of them. Better that you consult with your server admin.

Example:

/public_html
/htdocs
/html

edited Sep 13 '19 at 18:23

w5m

2,286
3
34
46

answered Dec 16 '16 at 15:37

Bikram Pahi

1,107
1
12
33

The OP asked about robots.txt specifically in a Laravel application. Your answer does not address the OP's question in any relative or meaningful way as the OP didn't ask WHAT a robots.txt file is, nor did the OP ask where you would place a traditional robots.txt file. In a Laravel app, the web entry point is at /public in the index.php file as pointed out by Michal G above. – Mark C. Feb 20 '22 at 06:33

robots.txt in Laravel

2 Answers2