User-agent: * Disallow: /userguide/ Disallow: /knowledgebase/ User-agent: gsa-crawler-therap Allow: /