# /robots.txt file for http://www.cat-it.co.nz/ (top level) User-agent: * Disallow: /mirrors Disallow: /cat-it/mirrors Disallow: /pub/linux Disallow: /pub/software