<<<<<<< HEAD:public/robots.txt <<<<<<< HEAD:public/robots.txt # See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file # # To ban all spiders from the entire site uncomment the next two lines: # User-Agent: * # Disallow: / ======= ======= >>>>>>> af7f460e125c768f42b4a115c3de0de7e5ae2cde:public/robots.txt # See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file # # To ban all spiders from the entire site uncomment the next two lines: # User-Agent: * # Disallow: / <<<<<<< HEAD:public/robots.txt >>>>>>> af7f460e125c768f42b4a115c3de0de7e5ae2cde:public/robots.txt ======= >>>>>>> af7f460e125c768f42b4a115c3de0de7e5ae2cde:public/robots.txt