# Google Image Crawler Setup User-agent: Googlebot-Image Disallow: User-agent: GoogleBot-Mobile Allow: / # Crawlers Setup User-agent: * # Directories Disallow: /404/ Disallow: /wp-login Disallow: /app/ Disallow: /cgi-bin/ Disallow: /downloader/ Disallow: /errors/ Disallow: /includes/ #Disallow: /js/ #Disallow: /lib/ Disallow: /scripts/ Disallow: /shell/