Starts a HTTP server serving content of a robots.txt file disallowing all robots.