Page 1 of 1

robots.txt

Posted: Thu Apr 30, 2020 12:33 am
by nicholsdr
please how to change robots.txt
because I change it in my domain in public_html
but when I enter to my site https://site.com/robots.txt
I found default configuration :

# vestacp autogenerated robots.txt
User-agent: *
Crawl-delay: 10

I want to add it to Google Search Console
thanks

Re: robots.txt

Posted: Thu Apr 30, 2020 1:21 am
by exclu254
That's weird! are you on WordPress? if so, you could try using an SEO plugin

Re: robots.txt

Posted: Thu Apr 30, 2020 4:27 pm
by nicholsdr
Yes i did that by adding plugin yoast seo
But nothing changed when I reload the page,
The default file for Vista appears and when the page is loaded again, the new file I made appears!
As if there are two files with the same name
Where could the problem be?

Re: robots.txt

Posted: Sat May 02, 2020 2:49 am
by exclu254
nicholsdr wrote:
Thu Apr 30, 2020 4:27 pm
Yes i did that by adding plugin yoast seo
But nothing changed when I reload the page,
The default file for Vista appears and when the page is loaded again, the new file I made appears!
As if there are two files with the same name
Where could the problem be?
Could be you are modifying the robots.txt in the wrong location, looking at my own structure, the output you got is founded in public_shtml, so, you d want to be modifying the one in public_html, not sure if it is going to help though. Again, you can try adding the necessary robots.txt in the two locations, hopefully, one of them would work out.

Re: robots.txt

Posted: Sun May 03, 2020 4:02 pm
by nicholsdr
I did it but doesn't work
I think it is somewhere else

Re: robots.txt

Posted: Fri May 22, 2020 7:53 pm
by SdeSergi
Hello,

See if the robots.txt file that are loaded by default are inside... usr/local/vesta/data/templates/web/skel/public_html

(Rookie response in Vesta CP)

Re: robots.txt

Posted: Tue May 26, 2020 10:26 am
by DanielLento
This file contains the following directives User-Agent, Allow and Disalov, Sitemap. Manual editing of the robots.txt file is not available, changes to page settings are added automatically. The article http://light-it.net/blog/ultimate-guide ... ne-school/ has information on how to edit robots.txt