# For domain: http://www.janneonnerud.se # All robots will spider the domain User-agent: * Disallow: # Disallow directory /cgi-bin/ User-agent: * Disallow: /cgi-bin/ # Disallow directory /update/ User-agent: * Disallow: /update/ # Disallow directory /MP3/ User-agent: * Disallow: /MP3/ # Disallow directory /oldstuff/ User-agent: * Disallow: /oldstuff/