Fwd: [IMC-Tech] People to put in your block list...

Tue Dec 18 12:05:05 CST 2001

Thoughts on this?

 From IMC Global Tech:

>Delivered-To: mediageek-org-listgeek at mediageek.org
>Delivered-To: imc-tech at indymedia.org
>From: Paul Houle <paul at honeylocust.com>
>User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:0.9.6) Gecko/20011120
>X-Accept-Language: en-us
>Cc: imc-tech at indymedia.org, webcoders at cat.org.au
>Subject: [IMC-Tech] People to put in your block list...
>Date: Tue, 18 Dec 2001 13:45:00 -0500
>
>    Hi guys,  I just noticed that there's a company with a very aggressive 
> spider that seems to be scanning activist web sites.  It scans out my 
> entire site every day,  generating a few thousand hits every day,  and 
> specifically ignoring robots.txt,  and doing a lot of dumb things like 
> trying to log in and post a comment to every story.
>
>    The spider is at 209.73.228.163 and gives "Webclipping.com" as it's 
> User Agent.  "Webclipping.com" advertises a service to help corporations 
> find and correct 'false information' on the web.  Punching 
> "209.73.228.163" into google reveals server logs that reveal these guys 
> are scanning everything in sight.
>
>
>
>
>_______________________________________________
>imc-tech mailing list
>imc-tech at lists.indymedia.org
>http://lists.indymedia.org/mailman/listinfo/imc-tech