# robots.txt for http://www.spring.gov.sg User-agent:* Disallow: /RESOURCES/COMPANY-DATABASE/Pages/ # Company Profile Pages Disallow: /sites/mobile/ # Do not crawl mobile site