# This is a file retrieved by web crawlers and spiders which defines # what paths they should follow, or avoid. # It is a defacto standard documented at # http://www.robotstxt.org/ # User-agent: | * # Disallow: | # Separate blocks of related entries with a blank line. # ----------------------------------------------------------------------------- User-agent: * Disallow: