1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

googlebot has stopped visiting 7 of my sites

Discussion in 'Websites' started by gford, Jul 24, 2005.

  1. #1
    OK, this one really confuses (And worries) me.

    For my 7 websites. googlebot has not visited ANY of them since July 17th!!
     
    gford, Jul 24, 2005 IP
  2. minstrel

    minstrel Illustrious Member

    Messages:
    15,082
    Likes Received:
    1,243
    Best Answers:
    0
    Trophy Points:
    480
    #2
    URLs? How old are these sites? How frequently and how deeply were they spidered in the past? Are they cached in Google?

    robots.txt
    noindex or nofollow meta tag
    bad last-modified headers
    no new content
     
    minstrel, Jul 24, 2005 IP
  3. sji2671

    sji2671 Self Made Mind

    Messages:
    1,991
    Likes Received:
    144
    Best Answers:
    0
    Trophy Points:
    170
    #3
    Have you tried adding some fresh links into the site, whats the url?
     
    sji2671, Jul 24, 2005 IP
  4. gford

    gford Peon

    Messages:
    1,188
    Likes Received:
    33
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Yes, they all have fresh content almost daily.

    www.mostpopularsites.net
    www.mps-golf.com
    www.mps-shopping.com
    www.mps-health.com
    www.mps-travel.com
    www.pandapub.com

    Edit:
    They used to be indexed tons (other thread here is talking how my mostpopularsites.net is being deindexed as we speak from 60k pages down to 12.2k now)
    daily googlebot on at least one of the sites and every 2-3 days on all the sites.

    Cached pages seem to be there, but for mostpopularsites.net losing them RAPIDLY

    all the robots.txt files are untouched and fine.

     
    gford, Jul 24, 2005 IP
  5. minstrel

    minstrel Illustrious Member

    Messages:
    15,082
    Likes Received:
    1,243
    Best Answers:
    0
    Trophy Points:
    480
    #5
    Googlebot has NOT stopped visiting the first site on that list, anyway -- see my reply to your other thread -- home page last cached July 22, 2005.

    same for mps-golf.com:

    I don't know if it's just me or a temporary situation but your mps-golf.com site was extremely slow to load -- server problems?

    I also receive a warning from NPF that these pages contain an active-X control which was blocked... what's that for?
     
    minstrel, Jul 24, 2005 IP
  6. minstrel

    minstrel Illustrious Member

    Messages:
    15,082
    Likes Received:
    1,243
    Best Answers:
    0
    Trophy Points:
    480
    #6
    More info:

    It looks like you are doing something on these pages to modify the Google search box in my toolbar... why?

    A whois on your first site yields a "206 Partial Content" response code... not sure what that's about either.
     
    minstrel, Jul 24, 2005 IP
  7. gford

    gford Peon

    Messages:
    1,188
    Likes Received:
    33
    Best Answers:
    0
    Trophy Points:
    0
    #7
    OK this is very bizarre. My access_log files show no visit by GoogleBot since the 17th yet, yes, it's cached. Did the bot change names??

    load time on mps-golf - hrm, was fast for me, just tried it..

    What is NPF? - I should have no active-x there at all. Can you give me more details??

     
    gford, Jul 24, 2005 IP
  8. gford

    gford Peon

    Messages:
    1,188
    Likes Received:
    33
    Best Answers:
    0
    Trophy Points:
    0
    #8
    Sigh. I goofed on reading my access_logs. It had just renamed my logfile prior to my checking so I was effectively looking at an empty log.

    I am sorry to have wasted your time on this thread. :eek: :eek: :(

    Now if I could figure out why my other site is being de-indexed!!
     
    gford, Jul 24, 2005 IP
  9. minstrel

    minstrel Illustrious Member

    Messages:
    15,082
    Likes Received:
    1,243
    Best Answers:
    0
    Trophy Points:
    480
    #9
    Nope. A problem with your log files, perhaps? That and a couple of other things make me wonder about a server problem...

    Sorry -- NPF = Norton Personal Firewall. And after the Active-X warning (Active-X control was blocked), the phrase "Search the net..." or something similar appeared in my Google search box on the Google Toolbar. That's never happened before and it only occurred on your pages. Whatever you're doing there is a bad idea...
     
    minstrel, Jul 24, 2005 IP
  10. gford

    gford Peon

    Messages:
    1,188
    Likes Received:
    33
    Best Answers:
    0
    Trophy Points:
    0
    #10
    I have a searchbox on the home page (google's code) for searching google (Search the web...)

    That's their code not mine, so not sure what the heck is going on there...?
     
    gford, Jul 24, 2005 IP
  11. gford

    gford Peon

    Messages:
    1,188
    Likes Received:
    33
    Best Answers:
    0
    Trophy Points:
    0
    #11
    All I do it put text into the search box that says "search the web..." which also goes away when you click (clears the box) the search box.

    It's standard javascript code and not related (intentionally) to any toolbar.
    See below:

    <input type="text" name="q" size="31" maxlength="255" value="search the web..." onClick="cleartext()"></input>

    <script language="javascript">
    function cleartext()
    {
    document.form1.q.value = ""
    }
    </script>
     
    gford, Jul 24, 2005 IP
  12. minstrel

    minstrel Illustrious Member

    Messages:
    15,082
    Likes Received:
    1,243
    Best Answers:
    0
    Trophy Points:
    480
    #12
    Many sites have Google search boxes but they don't do that...
     
    minstrel, Jul 24, 2005 IP
  13. minstrel

    minstrel Illustrious Member

    Messages:
    15,082
    Likes Received:
    1,243
    Best Answers:
    0
    Trophy Points:
    480
    #13
    Why even do that? I think by now mosty people can look at an empty Google search box and know what to do with it... wasted and annoying code, IMO.
     
    minstrel, Jul 24, 2005 IP
  14. gford

    gford Peon

    Messages:
    1,188
    Likes Received:
    33
    Best Answers:
    0
    Trophy Points:
    0
    #14
    Because I have two search boxes there. One for the directory/site and one for the entire web. It's to make them more distinct.
     
    gford, Jul 24, 2005 IP
  15. Blue

    Blue Peon

    Messages:
    65
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #15
    Not fast at all.

    Checked www.mps-golf.com here: http://www.websiteoptimization.com/services/analyze/

    Warning! The total size of this page is 302628 bytes, which will load in 60.51 seconds on a 56Kbps modem. Consider reducing total page size to less than 30K to achieve sub eight second response times on 56K connections. Pages over 100K exceed most attention thresholds at 56Kbps, even with feedback.

    Connection Rate Download Time

    14.4K 234.75 seconds
    28.8K 117.48 seconds
    33.6K 100.72 seconds
    56K 60.51 seconds
    ISDN 128K 18.67 seconds
    T1 1.44Mbps 1.80 seconds
     
    Blue, Jul 24, 2005 IP
    minstrel likes this.
  16. minstrel

    minstrel Illustrious Member

    Messages:
    15,082
    Likes Received:
    1,243
    Best Answers:
    0
    Trophy Points:
    480
    #16
    Yep. The thing timed out for me on my first attempt. The second one succeeded I presume because part of it was already in cache.
     
    minstrel, Jul 24, 2005 IP
  17. alexo

    alexo Well-Known Member

    Messages:
    371
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    108
    #17
    alexo, Jul 24, 2005 IP
  18. gford

    gford Peon

    Messages:
    1,188
    Likes Received:
    33
    Best Answers:
    0
    Trophy Points:
    0
    #18
    Very nice site. however it's not cached pages, its indexed pages.
     
    gford, Jul 24, 2005 IP
  19. alexo

    alexo Well-Known Member

    Messages:
    371
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    108
    #19
    upps .. sorry .
    yes, of course u are right :)
     
    alexo, Jul 24, 2005 IP