robots.txt
robots.txt
please how to change robots.txt
because I change it in my domain in public_html
but when I enter to my site https://site.com/robots.txt
I found default configuration :
# vestacp autogenerated robots.txt
User-agent: *
Crawl-delay: 10
I want to add it to Google Search Console
thanks
because I change it in my domain in public_html
but when I enter to my site https://site.com/robots.txt
I found default configuration :
# vestacp autogenerated robots.txt
User-agent: *
Crawl-delay: 10
I want to add it to Google Search Console
thanks
Last edited by nicholsdr on Thu Apr 30, 2020 6:37 pm, edited 1 time in total.
Re: robots.txt
That's weird! are you on WordPress? if so, you could try using an SEO plugin
Re: robots.txt
Yes i did that by adding plugin yoast seo
But nothing changed when I reload the page,
The default file for Vista appears and when the page is loaded again, the new file I made appears!
As if there are two files with the same name
Where could the problem be?
But nothing changed when I reload the page,
The default file for Vista appears and when the page is loaded again, the new file I made appears!
As if there are two files with the same name
Where could the problem be?
Re: robots.txt
Could be you are modifying the robots.txt in the wrong location, looking at my own structure, the output you got is founded in public_shtml, so, you d want to be modifying the one in public_html, not sure if it is going to help though. Again, you can try adding the necessary robots.txt in the two locations, hopefully, one of them would work out.nicholsdr wrote: ↑Thu Apr 30, 2020 4:27 pmYes i did that by adding plugin yoast seo
But nothing changed when I reload the page,
The default file for Vista appears and when the page is loaded again, the new file I made appears!
As if there are two files with the same name
Where could the problem be?
Re: robots.txt
I did it but doesn't work
I think it is somewhere else
I think it is somewhere else
Re: robots.txt
Hello,
See if the robots.txt file that are loaded by default are inside... usr/local/vesta/data/templates/web/skel/public_html
(Rookie response in Vesta CP)
See if the robots.txt file that are loaded by default are inside... usr/local/vesta/data/templates/web/skel/public_html
(Rookie response in Vesta CP)
-
- Posts: 2
- Joined: Tue May 26, 2020 10:22 am
- Os: CentOS 6x
- Web: apache + nginx
Re: robots.txt
This file contains the following directives User-Agent, Allow and Disalov, Sitemap. Manual editing of the robots.txt file is not available, changes to page settings are added automatically. The article http://light-it.net/blog/ultimate-guide ... ne-school/ has information on how to edit robots.txt