User-agent: * Disallow: /json/ Allow: / Crawl-delay: 5