# robots.txt for http://www.unit.it/ User-agent: * Disallow: /adv Disallow: /images Disallow: /img Disallow: /includeunit Disallow: /unitadmin Disallow: /news Disallow: /temp_curriculum User-agent: UbiCrawler Disallow: /