# Robots.txt file created for domain: http://www.somethingjewish.co.uk # All robots will spider the domain User-agent: * Disallow: /templates/ Disallow: /ssi/ Disallow: /images/ Disallow: /aspseek/ Disallow: /javascript/ Disallow: /logs/ Disallow: /test/ Disallow: /UTM/