Compdigitec Labs

« | Home | »

Very Suspicious Internet Robots

By admin | July 23, 2008

So far we have come across some very strange and suspicious robots hitting our site; we have identified them for you here. Feel free to use this information to block these suspicious robots from hitting/scraping your website.

This bot tried to access only the home page. It’s IP is and tried to access our home page on 2008-07-21 06:00:57.

This bot, written in perl, tried to do an exploit of some sort by trying to GET /index.php?layout= IPs include:,,, and Block the user-agents in robots.txt.

This “russian” bot appears to follow links throughout the site between intervals of 2 minutes. Blocked permanently because of an unresolvable URL. Some Google searches reveal that it follows up behind the scrapers.

This bot suspiciously scrapes all important pages at the rate of several pages per seconds. According to this post, it looks like that this bot does dirty work for the RIAA and the MPAA. Block user agent at this IP: 38.100.41.*

Good luck defeating the spambots and badbots out there!

If you found this article helpful or interesting, please help Compdigitec spread the word. Don’t forget to subscribe to Compdigitec Labs for more useful and interesting articles!

Topics: Internet | 2 Comments »

2 Responses to “Very Suspicious Internet Robots”

  1. steenslagfolie Says:
    July 2nd, 2024 at 18:25

    … [Trackback]

    […] Read More here on that Topic: […]

  2. เสริมหน้าอก Says:
    July 13th, 2024 at 21:26

    … [Trackback]

    […] Find More Info here to that Topic: […]