User-agent: *
Disallow: /images/
Disallow: /scripts/
Disallow: /styles/

User-Agent: W3C-checklink
Disallow: