# Disallow all crawlers access to certain pages. User-agent: * Disallow: /html/ Disallow: /scripts/ Disallow: /remote Disallow: /beta/ Disallow: /blog/trackback/ Disallow: /blog/wp-admin/ Disallow: /blog/feed/ Disallow: /blog/archives/ Disallow: /*.js$ Disallow: /*.inc$ Disallow: /*.css$