# /robots.txt file for hetland.net User-agent: * Disallow: /bjarte/florida2000 Disallow: /bjarte/millennium Disallow: /bjarte/studietur2001 Disallow: /bjarte/skate # Mrk: # Wildcards are _not_ supported: instead of 'Disallow: /tmp/*' just say 'Disallow: /tmp' # You shouldn't put more than one path on a Disallow line # Disallow: /help disallows both /help.html and /help/index.html, whereas # Disallow: /help/ would disallow /help/index.html but allow /help.html. # tips til html-dokumentene # #