User-agent: * #disallow spiders to crawl through specific directories Disallow: /assets/ Disallow: /zAdmin/ Disallow: /zLibrary/ Disallow: /zProduction/ Disallow: /zProfile/ Disallow: /zServerError/ Disallow: /ztesting/ Disallow: /WebTrendReport/ Disallow: /Templates/