# File robots.txt # 20-04-2005 # Used to allow all robots to crawl the website User-agent: * Disallow: