User-agent: * Crawl-delay: 2 Disallow: /template/ Disallow: /META-INF/ Disallow: /multimedia/ Disallow: /WEB-INF/ Disallow: /rss/ Disallow: /xsl/ Disallow: /import/ Disallow: /admin/ Request-rate: 1/2 User-agent: Meltwater Disallow: / ACAP-crawler: Meltwater ACAP-disallow-crawl: / ACAP-crawler: * # User-agent: * ACAP-disallow-crawl: /template/ # Disallow: /template/ ACAP-disallow-crawl: /META-INF/ # Disallow: /META-INF/ ACAP-disallow-crawl: /multimedia/ # Disallow: /multimedia/ ACAP-disallow-crawl: /WEB-INF/ # Disallow: /WEB-INF/ ACAP-disallow-crawl: /rss/ # Disallow: /rss/ ACAP-disallow-crawl: /xsl/ # Disallow: /xsl/ ACAP-disallow-crawl: /import/ # Disallow: /import/ ACAP-disallow-crawl: /admin/ # Disallow: /admin/