Googlebot 404 nonsense urls?

Discussion in 'Site & Server Administration' started by EKF, Jul 8, 2005.

0
  1. #1
    Googlebot just visited my site, ready my robots.txt file as usual, but all 11 of the URLs it asked for are nonsense words, like this:

    /mjyfkxswvlhkrup.html
    Http Code: 404
    Date: Jul 08 16:11:15
    Http Version: HTTP/1.1 Size in Bytes: 1958
    Referer: -
    Agent: Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)

    Any idea why?
     
    EKF, Jul 8, 2005 IP
  2. digitalpoint

    digitalpoint Overlord of no one Staff

    Messages:
    38,334
    Likes Received:
    2,613
    Best Answers:
    462
    Trophy Points:
    710
    Digital Goods:
    29
    #2
    You would have to have a link to it from somewhere.
     
    digitalpoint, Jul 8, 2005 IP
  3. someonewhois

    someonewhois Peon

    Messages:
    177
    Likes Received:
    14
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Do you have the IP? Could be a spoof.
     
    someonewhois, Jul 8, 2005 IP
  4. mystikmedia

    mystikmedia Jedi Master

    Messages:
    5,564
    Likes Received:
    498
    Best Answers:
    0
    Trophy Points:
    270
    #4
    I get strange things in logs too from Google. Like it trying to get a file named /convert_wmv_to_avi.htp (instead of .htm).
     
    mystikmedia, Jul 8, 2005 IP
  5. Starbug

    Starbug Guest

    Messages:
    89
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Yes, I noticed this too..

    I think it might be spoofed referals (i.e the user agent copying the same tag as googlebot)

    I don't have any links at all to the nonsense pages.. so it can only be some sort of log spammer...

    I can't think of any other thing it could be :confused:
     
    Starbug, Jul 8, 2005 IP
  6. EKF

    EKF Member

    Messages:
    2
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    36
    #6
    I don't have any URLs like that. They're all real words, or multiple words with hypens. The IP shown for googlebot is 66.249.65.225.
    www.melissadata.com/Lookups/iplocation.asp?ipaddress=66.249.65.225&submit=submit
    but
    download.urchin.com/whois.cgi?addr=66.249.65.225
     
    EKF, Jul 8, 2005 IP