# All robots will spider the domain User-Agent: * Disallow: /captcha/ Disallow: /Scripts/ Disallow: /download/ Disallow: /upload/resumes/ Disallow: /careers/uploaded_docs/ Allow: /