Re: funkcni google spam?

From: Adam Haken <konfer (zavinac)>
Date: 22. 08. 2006, 12:11 CEST
Myslim ze dohodu nemaji

odmazal sem komentare

wget http://www.webmasterworld.com/robots.txt
--
User-agent: *
Disallow: /

atd. atd
--

wget --user-agent='Mozilla/5.0 (compatible; Googlebot/2.1' 
http://www.webmasterworld.com/robots.txt
--
User-agent: *
Crawl-delay: 17

User-agent: *
Disallow: /gfx/
Disallow: /cgi-bin/
Disallow: /QuickSand/
Disallow: /pda/
Disallow: /zForumFFFFFF/
--

Adam Haken


Jakub Roztočil wrote:
> Myslím, že mají nějakou dohodu.
>
> BTW: http://www.webmasterworld.com/robots.txt
>
>   
Received on Tue, 22 Aug 2006 12:11:08 +0200

This archive was generated by hypermail 2.1.8 : 22. 08. 2006, 12:11 CEST