# Robots.txt file from http://www.musicster.org # All robots will spider the domain User-agent: * Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /wp-content/ Disallow: /?s=* Disallow: /cse Disallow: /*.js$ Disallow: */feed/ Disallow: /*.php$ Disallow: /*.inc$ Disallow: /*.css$ Disallow: /comments Disallow: /trackback/ #Allow: /wp-content/uploads/ Sitemap: http://www.musicster.org/sitemap.xml