User-agent: * Allow: / User-agent: Googlebot Allow: / User-agent: Mediapartners-Google Allow: / User-agent: Googlebot-Image Allow: /images/ Allow: / User-agent: Googlebot-Mobile Allow: /i/ Allow: /s/ Allow: /e/ Allow: / User-agent: User-agent: LD_mobile_bot Allow: / User-agent: DoCoMo/2.0 i-robot(c10;TC) Allow: /i/ User-agent: DoCoMo/1.0/i-robot/c5/TC Allow: /i/ User-agent: msnbot Allow: / User-agent: msnbot/0.3 Allow: / User-agent: msnbot/1.0 Allow: / User-agent: Faxobot/1.0 Allow: / User-agent: Gigabot/2.0 Allow: / User-agent: MJ12bot Allow: / User-agent: Mozilla/2.0 Allow: / User-agent: Y!J-SRD/1.0 Allow: / User-agent: Y!J-MBS/1.0 Allow: / User-agent: DoCoMo/2.0 P900i(c100;TB;W24H11)(compatible; ichiro/mobile goo; +http://help.goo.ne.jp/door/crawler.html) Allow: / User-agent: KDDI-CA31 UP.Browser/6.2.0 (GUI) (compatible; ichiro/mobile goo; +http://help.goo.ne.jp/door/crawler.html) Allow: / User-agent: Vodafone/1.0/V802SH/SHJ002 Browser/UP.Browser/7.0.2.1 (compatible; ichiro/mobile goo;+http://help.goo.ne.jp/door/crawler.html) Allow: /