Google is not crawling

Discussion in 'Websites' started by indianherbcare, Jun 16, 2005.

  1. #1
    Our site has been around for over a year. We are getting MSN and Yahoo crawlar coming to our site a lot but google is not coming that much, only 2-3%, which is very unusual. what can I do about this?
     
    indianherbcare, Jun 16, 2005 IP
  2. hans

    hans Well-Known Member

    Messages:
    2,923
    Likes Received:
    126
    Best Answers:
    1
    Trophy Points:
    173
    #2
    when i look at the
    indianherbcare
    site
    i see a totally screwed up source code ...

    hence go back to the basics and have your code - each page - VALIDATED by validator.w3.org to assure google too sees a clean code and clean meta tags instead of your present

    charset=<!--?php echo CHARSET; ?>">
    or
    <title><!--?php echo TITLE ?></title>
    and similar fatal errors in code where SEO parts are expected to reside

    take some tiem to learn aobut your site and adjust/correct all details until fully valid and correct to the very best of all knowledge at any given time - this assures you get the bots welcomed again
     
    hans, Jun 16, 2005 IP
  3. bigdoug

    bigdoug Peon

    Messages:
    845
    Likes Received:
    54
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Wow! code is jacked up. I bet robots will not pass the <Head>...lol
     
    bigdoug, Jun 17, 2005 IP
  4. benjones82

    benjones82 Guest

    Messages:
    59
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    is there a program you can use to see how many robots are coming to your site
     
    benjones82, Jun 18, 2005 IP
  5. bigdoug

    bigdoug Peon

    Messages:
    845
    Likes Received:
    54
    Best Answers:
    0
    Trophy Points:
    0
    #5
    AWSTATS is a basic program

    D
     
    bigdoug, Jun 18, 2005 IP
  6. Colleen

    Colleen Illustrious Member

    Messages:
    6,777
    Likes Received:
    725
    Best Answers:
    1
    Trophy Points:
    430
    #6
    I've read that there's such a thing as too many keywords, here's their keywords, is this too many and I also read you shouldn't repeat keywords over and over, so is this keyword set up all wrong?

     
    Colleen, Jun 18, 2005 IP
  7. minstrel

    minstrel Illustrious Member

    Messages:
    15,082
    Likes Received:
    1,243
    Best Answers:
    0
    Trophy Points:
    480
    #7
    That IS pretty spammy looking, C, but it isn't likely to prevent Googlebot from crawling the site.

    I'd say Hans may be correct when he identifies possible coding anomalies or errors -- I'm not sure what Googlebot will make of all this:

    <head>
    <!--meta http-equiv="Content-Type" content="text/html; charset=<!--?php echo CHARSET; ?>"> 
    <!--?php
    // BOF: WebMakers.com Changed: Header Tag Controller v1.0
    // Replaced by header_tags.php
    //if ( file_exists(DIR_WS_INCLUDES . 'header_tags.php') ) {
      //require(DIR_WS_INCLUDES . 'header_tags.php');
    } else {
    ?> 
      <title><!--?php echo TITLE ?></title>
    <!--?php
    // here is just the old css echo THEMA_STYLE
    }
    // EOF: WebMakers.com Changed: Header Tag Controller v1.0
    ?-->
    <META NAME="Reply-to" Content="Indian Herbal Medicine Products - Buy natural herbs, nutritional products and vitamin supplements, beauty care. Includes health articles and guarantee. Buy natural herbs, nutritional products and vitamin supplements, beauty care. Includes health articles and guarantee.">
    			<META NAME="Description" Content="Indian Herbal Medicine Products -  Buy natural herbs, nutritional products and vitamin supplements, beauty care. Includes health articles and guarantee. Buy natural herbs, nutritional products and vitamin supplements, beauty care. Includes health articles and guarantee.">
    <META NAME="Keywords" Content="Indian Herbal Medicine Products - herbal medicine, 
    
    <snip>
    
    			 <title>Indian Herbal Medicine Products ,Indian Natural  herbal remedy Products, Himalaya  herbal products, Ayurveda Medicine and Ayurveda Products</title><base href="http://www.indianherbcare.com/">
    <link rel="stylesheet" type="text/css" href="stylesheet.css" >
    </head>
    Code (markup):
    There are some other errors, too -- see http://gritechnologies.com/tools/spider.go?q=www.indianherbcare.com and note the 404 not found errors in internal links from the home page.

    Also http://gritechnologies.com/tools/diagnostic.go?www.indianherbcare.com and http://gritechnologies.com/tools/spider.go?q=www.indianherbcare.com
     
    minstrel, Jun 18, 2005 IP
  8. hans

    hans Well-Known Member

    Messages:
    2,923
    Likes Received:
    126
    Best Answers:
    1
    Trophy Points:
    173
    #8
    minstrel

    since meta titles for example are missing he probably drops a few hudnred ranks in SERPS
    but i have seen specially googlebot being very sensitive/better UNable in handling error and often simply fails to crawl a page with certaiin code-syntax-errors
    one typcial error googelbot (at least a few months ago ) totally fails to handle is a LINEBRAKE within a meta tag content ....
    often google bot works fine UP TO the first fatal error - then skips the rest of the page or a large part of it ...
     
    hans, Jun 18, 2005 IP
  9. hans

    hans Well-Known Member

    Messages:
    2,923
    Likes Received:
    126
    Best Answers:
    1
    Trophy Points:
    173
    #9
    benjones82

    webalizer is another program to anylize traffic and see the bots

    in fact many hosts have already a traffic tool installed - a few days ago i wanted to see the traffic of a hotel site and discuss a few points with its owner/chef ... he had none - but his host had without him knowing

    so i just checked
    hisdomain.com/webalizer
    hisdomain.com/statistics
    hisdomain.com/stats
    the latter surprisingly gave the desired onlien stats form webalizer his host had installed

    see what your host may have already installed on your site by default !

    but benjones82 - for now you have little to fear from google or any other search eingine bot - your page lacks any metatags at all and hence there is litle to crawl and since you are in a market with many sites of similar content even daily crawliing helps little to get into top SERPS - here again its aboitu the very basic steps of SEO to support the bots and SE
     
    hans, Jun 18, 2005 IP