User-agent: *
Disallow: /js/ 
Disallow: /if/ 
Disallow: /arbo/
Disallow: /log/
Disallow: /search.htm

User-agent: Xenu's Link Sleuth 1.1c 
Disallow: / 

User-agent: Xenu's 
Disallow: / 

User-agent: Xenu Link Sleuth 1.2e
Disallow: /