# 1) this filename (robots.txt) must stay lowercase # 2) this file must be in the servers root directory # ex: http://www.mydomain.com/pliggsubfolder/ -- you must move the robots.txt from # /pliggsubfolder/ to the root folder for http://www.mydomain.com/ # you must then add your subfolder to each 'Disallow' below # ex: Disallow: /cache/ becomes Disallow: /pliggsubfolder/cache/ User-agent: * Crawl-delay: 5 Disallow: Disallow: /3rdparty/ Disallow: /backup/ Disallow: /cache/ Disallow: /install/ Disallow: /internal/ Disallow: /libs/ Disallow: /modules/ Disallow: /plugins/ Disallow: /templates/ Disallow: /templates_c/ Disallow: /search.php Disallow: /admin_index.php Disallow: /search/ Disallow: /admin/ #Zablokuj następujące roboty: User-agent: mj12bot User-agent: Gulliver/1.3 User-agent: Lycos_Spider_(T-Rex) User-agent: Scooter/1.0 User-agent: Twiceler User-agent: Twiceler* User-agent: Yeti User-agent: WebAlta_Crawler User-agent: WebAlta/Crawler User-agent: WebAlta/Crawler* User-agent: DotBot/1.0.1 User-agent: ichiro/3.0 User-agent: DotBot* User-agent: Baiduspider User-agent: Gigabot User-agent: Teleport\sPro User-agent: LinkWalker/2.0 User-agent: Msnbot User-agent: szukacz User-agent: DotBot/1.1 User-agent: Twiceler-0.9 User-agent: cuil Disallow: /