User-agent: * Disallow: /pub/ Disallow: /rpmdiag/ Disallow: /LDP/ Disallow: /ldp/ Disallow: /TLDP/ Disallow: /tldp/