Vesta Control Panel - Forum

Community Forum

Skip to content

Advanced search
  • Quick links
    • Main site
    • Github repo
    • Google Search
  • FAQ
  • Login
  • Register
  • Board index Main Section General Discussion
  • Search

robots.txt

General questions about VestaCP
Post Reply
  • Print view
Advanced search
7 posts • Page 1 of 1
nicholsdr
Posts: 3
Joined: Thu Apr 30, 2020 12:03 am

Os: Ubuntu 17x
Web: apache + nginx
robots.txt
  • Quote

Post by nicholsdr » Thu Apr 30, 2020 12:33 am

please how to change robots.txt
because I change it in my domain in public_html
but when I enter to my site https://site.com/robots.txt
I found default configuration :

# vestacp autogenerated robots.txt
User-agent: *
Crawl-delay: 10

I want to add it to Google Search Console
thanks
Last edited by nicholsdr on Thu Apr 30, 2020 6:37 pm, edited 1 time in total.
Top

exclu254
Posts: 44
Joined: Mon Dec 23, 2019 6:44 pm

Os: Ubuntu 15x
Web: nginx + php-fpm
Re: robots.txt
  • Quote

Post by exclu254 » Thu Apr 30, 2020 1:21 am

That's weird! are you on WordPress? if so, you could try using an SEO plugin
Top

nicholsdr
Posts: 3
Joined: Thu Apr 30, 2020 12:03 am

Os: Ubuntu 17x
Web: apache + nginx
Re: robots.txt
  • Quote

Post by nicholsdr » Thu Apr 30, 2020 4:27 pm

Yes i did that by adding plugin yoast seo
But nothing changed when I reload the page,
The default file for Vista appears and when the page is loaded again, the new file I made appears!
As if there are two files with the same name
Where could the problem be?
Top

exclu254
Posts: 44
Joined: Mon Dec 23, 2019 6:44 pm

Os: Ubuntu 15x
Web: nginx + php-fpm
Re: robots.txt
  • Quote

Post by exclu254 » Sat May 02, 2020 2:49 am

nicholsdr wrote: ↑
Thu Apr 30, 2020 4:27 pm
Yes i did that by adding plugin yoast seo
But nothing changed when I reload the page,
The default file for Vista appears and when the page is loaded again, the new file I made appears!
As if there are two files with the same name
Where could the problem be?
Could be you are modifying the robots.txt in the wrong location, looking at my own structure, the output you got is founded in public_shtml, so, you d want to be modifying the one in public_html, not sure if it is going to help though. Again, you can try adding the necessary robots.txt in the two locations, hopefully, one of them would work out.
Top

nicholsdr
Posts: 3
Joined: Thu Apr 30, 2020 12:03 am

Os: Ubuntu 17x
Web: apache + nginx
Re: robots.txt
  • Quote

Post by nicholsdr » Sun May 03, 2020 4:02 pm

I did it but doesn't work
I think it is somewhere else
Top

SdeSergi
Posts: 11
Joined: Fri May 15, 2020 9:39 am

Os: Ubuntu 17x
Web: apache + nginx
Re: robots.txt
  • Quote

Post by SdeSergi » Fri May 22, 2020 7:53 pm

Hello,

See if the robots.txt file that are loaded by default are inside... usr/local/vesta/data/templates/web/skel/public_html

(Rookie response in Vesta CP)
Top

DanielLento
Posts: 2
Joined: Tue May 26, 2020 10:22 am

Os: CentOS 6x
Web: apache + nginx
Re: robots.txt
  • Quote

Post by DanielLento » Tue May 26, 2020 10:26 am

This file contains the following directives User-Agent, Allow and Disalov, Sitemap. Manual editing of the robots.txt file is not available, changes to page settings are added automatically. The article http://light-it.net/blog/ultimate-guide ... ne-school/ has information on how to edit robots.txt
Top


Post Reply
  • Print view

7 posts • Page 1 of 1

Return to “General Discussion”



  • Board index
  • All times are UTC
  • Delete all board cookies
  • The team
Powered by phpBB® Forum Software © phpBB Limited
*Original Author: Brad Veryard
*Updated to 3.2 by MannixMD
 

 

Login  •  Register

I forgot my password