Compdigitec Labs

« | Home | »

Very Suspicious Internet Robots

By admin | July 23, 2008

So far we have come across some very strange and suspicious robots hitting our site; we have identified them for you here. Feel free to use this information to block these suspicious robots from hitting/scraping your website.

This bot tried to access only the home page. It’s IP is and tried to access our home page on 2008-07-21 06:00:57.

This bot, written in perl, tried to do an exploit of some sort by trying to GET /index.php?layout= IPs include:,,, and Block the user-agents in robots.txt.

This “russian” bot appears to follow links throughout the site between intervals of 2 minutes. Blocked permanently because of an unresolvable URL. Some Google searches reveal that it follows up behind the scrapers.

This bot suspiciously scrapes all important pages at the rate of several pages per seconds. According to this post, it looks like that this bot does dirty work for the RIAA and the MPAA. Block user agent at this IP: 38.100.41.*

Good luck defeating the spambots and badbots out there!

If you found this article helpful or interesting, please help Compdigitec spread the word. Don’t forget to subscribe to Compdigitec Labs for more useful and interesting articles!

Topics: HTTP (Internet) | 5 Comments »

5 Responses to “Very Suspicious Internet Robots”

  1. DevOps consultants Says:
    October 6th, 2021 at 15:46

    … [Trackback]

    […] Read More on that Topic: […]

  2. origin mushrooms - golden teacher mushroom Says:
    October 7th, 2021 at 17:17

    … [Trackback]

    […] Info to that Topic: […]

  3. relx Says:
    October 26th, 2021 at 20:51

    … [Trackback]

    […] Find More on that Topic: […]

  4. บาคาร่า1688 Says:
    November 14th, 2021 at 20:19

    … [Trackback]

    […] Read More Information here to that Topic: […]

  5. en iyi casino siteleri Says:
    December 10th, 2021 at 14:02

    … [Trackback]

    […] Here you can find 55387 additional Info on that Topic: […]