# Allow only specific directories
User-agent: ScoutJet
Disallow: /
Allow: /public
User-agent: Yanga WorldSearch Bot v1.1/beta (http://www.yanga.co.uk/)
Disallow: /
Allow: /public
User-agent: Sogou web spider/4.0
Disallow: /
Allow: /public