# Disallow all crawlers access to certain pages. User-agent: * Disallow: /admin/ Disallow: /cliweb/ Disallow: /help/ Disallow: /tinymce/ Disallow: /upload/ User-agent: webreaper Disallow: /