User-agent: * Disallow: */static/*.html Disallow: *.pdf$ Disallow: *.doc Disallow: *.xls Disallow: *.docx Disallow: *.xlsx Disallow: /?