robots.txt
| 28 de julio de 2010 a las 01:49 | 18 comentarios
last.fm
El robots.txt de Last.fm es poesía geek pura: User-Agent: \* Disallow: /music? Disallow: /widgets/radio? Disallow: /show_ads.php Disallow: /affiliate/ Disallow: /affiliate_redirect.php Disallow: /affiliate_sendto.php Disallow: /affiliatelink.php Disallow: /campaignlink.php Disallow: /delivery.php Disallow: /music/+noredirect/ Disallow: /harming/humans Disallow: /ignoring/human/orders Disallow: /harm/to/self Allow: / ¿Qué es robots.txt? Vía: Boing Boing