Compdigitec Labs

« | Home | »

Very Suspicious Internet Robots

By admin | July 23, 2008

So far we have come across some very strange and suspicious robots hitting our site; we have identified them for you here. Feel free to use this information to block these suspicious robots from hitting/scraping your website.

This bot tried to access only the home page. It’s IP is and tried to access our home page on 2008-07-21 06:00:57.

This bot, written in perl, tried to do an exploit of some sort by trying to GET /index.php?layout= IPs include:,,, and Block the user-agents in robots.txt.

This “russian” bot appears to follow links throughout the site between intervals of 2 minutes. Blocked permanently because of an unresolvable URL. Some Google searches reveal that it follows up behind the scrapers.

This bot suspiciously scrapes all important pages at the rate of several pages per seconds. According to this post, it looks like that this bot does dirty work for the RIAA and the MPAA. Block user agent at this IP: 38.100.41.*

Good luck defeating the spambots and badbots out there!

If you found this article helpful or interesting, please help Compdigitec spread the word. Don’t forget to subscribe to Compdigitec Labs for more useful and interesting articles!

Topics: Internet | 1 Comment »

One Response to “Very Suspicious Internet Robots”

  1. รับเขียนโปรแกรม Says:
    March 27th, 2024 at 22:36

    … [Trackback]

    […] Read More on to that Topic: […]