User-Agent: * Allow: / Disallow: /cgi-bin/ Disallow: /tmp/ Disallow: /controller/ Disallow: /rd Disallow: /rd?url= Disallow: /rd?code= Disallow: /d/ Disallow: /download/