# file does not exist so using default file by Webservice # User-Agent: FacebookBot Crawl-delay: 5 User-Agent: Yandex Crawl-delay: 5 User-agent: 360Spider Disallow: / User-agent: GPTBot Disallow: /