User-agent: *
Disallow: /ad/
Disallow: /articles/lib
Disallow: /articles/handlers
Disallow: /data
Disallow: /host_specific/
Disallow: /include/
Disallow: /lib/