User-agent: * Disallow: /articles/ Disallow: /articles.html Disallow: /documents/