Google not crawling my site..

Discussion in 'Search Engine Optimization' started by Rahulsharma, Oct 10, 2009.

  1. #1
    Only my homepage is listed in google search...other pages are not crawled by google...other pages are not listed in google search..It is hosted on a subdomain..Please i need ur answers...
     
    Rahulsharma, Oct 10, 2009 IP
  2. SamKB

    SamKB Peon

    Messages:
    151
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Is your site new? Because it takes a bit of time for Google to crawled all your pages.

    Apart from that, did you submit a sitemap?
     
    SamKB, Oct 10, 2009 IP
  3. LeslieMarie

    LeslieMarie Peon

    Messages:
    15
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    First create a sitemap and submit to Google Webmaster. Another thing you could do is update the content of your inner pages regularly and do linkbuilding to each inner pages of your site such as bookmarking and deeplink submission.

    goodluck!
     
    LeslieMarie, Oct 10, 2009 IP
  4. extomas

    extomas Member

    Messages:
    237
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    33
    #4
    If you have Google webmasters tools account where your website is added then check it for any error or penalty.
     
    extomas, Oct 10, 2009 IP
  5. indrow

    indrow Peon

    Messages:
    31
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Submit a sitemap to webmaster tools
     
    indrow, Oct 10, 2009 IP
  6. Rahulsharma

    Rahulsharma Peon

    Messages:
    28
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Thanks for replies..
    Sitemap is there...
    Google is crawling only homepage..
    Not internal pages..
    This is my problem..Suggest some thing..
    website is here
     
    Rahulsharma, Oct 10, 2009 IP
  7. Peter Clarke

    Peter Clarke Peon

    Messages:
    22
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #7
    1. Submit a site map

    2. Make sure you have new content added to your site each day until Google starts to index inside the site.

    3. Cultivate backlinks to the key pages in your site, not just the home page.
     
    Peter Clarke, Oct 10, 2009 IP
  8. achucky

    achucky Peon

    Messages:
    12
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #8
    Good quality backlinks = faster indexing.
     
    achucky, Oct 10, 2009 IP
  9. tunermaneuvermag

    tunermaneuvermag Guest

    Messages:
    47
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #9
    according to Google: "We do not add all submitted URLs to our index, and we cannot make any predictions or guarantees about when or if they will appear."

    Its all about links! The search engines believe that they can maintain the quality of their indexes byfocusing on webpages that have links pointing to them. If no body points to your site, the reasoning goes, why would they index it? If no body else thinks your site is important, why should the search engines? They would rather find your pages themselves than have you submit pages.
     
    tunermaneuvermag, Oct 10, 2009 IP
  10. heartlandenergycolorado

    heartlandenergycolorado Peon

    Messages:
    17
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #10
    I think it is a big mistake to submit your sitemap right away. We used to do this and sit and wait for months until Google got to us. I said that I think it is a big mistake because we were able to get on the 1st page much easier by getting indexed organically. I could be superstitious here (which it would not surprise me to hear someone say that I am being just exactly that), but we have had much better luck getting indexed without submitting our sitemap first. As a matter of fact, we usually submit our sitemap well after Google has indexed our site three or four times. I think there is a much better way of getting indexed and getting indexed within 24 hours.

    You need to be careful in using this approach because if you utilize it too much your account will be banned from the source. So here goes, we get indexed on our blogs and sites within 24 hours by utilizing the Social Bookmarking sites. What I am talking about here is Delicious, Digg, Reddit, Stumbleupon. It is like the Googlebots hang around these social bookmarking sites ready to pounce and the latest and freshes bookmarks. When I said you need to be careful, what I meant is that you should not open several accounts and digg your articles or URLs many times as Digg will easily pick up on this and ban you. So, just simply open one account with 5 or 6 social bookmarking sites and bookmark the pages to your website. I would not recommend doing them all at once. I would do them inermittently, meaning I would do one page this week, then perhaps another page under a different user at a different social bookmarking site in a day or so. Then come back in a week or so and complete a different page. Odds are pretty good that the 1st bookmark will bring the Googlebots and your entire site will get indexed right then as long as you have your site optimized correctly. What I mean is that you havfe your site well linked with "do follow" links and that the Googlebots are instructed to "index all,follow all".

    After you have been indexed, then submit your sitemap and it seems to me that you will get indexed more often and much faster. I hope you let us know your results if you do this, because I am certain there are many who would disagree with this post.
     
    heartlandenergycolorado, Oct 10, 2009 IP
  11. Dion de Ville

    Dion de Ville Member

    Messages:
    7
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    36
    #11
    Is your site custom built? A collection of html/xhtml pages? Or is it an installed package like Wordpress, Joomla! or SMF etc..?

    Some installable packages are not easily indexed (SMF being one that comes to mind).

    Check you have a robots.txt file in your domain's/subdomain's top folder; even if it's blank (empty). If there isn't one and your web package doesn't have its own way of dealing with robots (crawlers) then create a blank one.

    Ping the search engines. Use an online ping service.

    Add your site to a few directories (for the short term, forget DMOZ, you'll be waiting months or years to be entered into it).

    If possible, link from your indexed pages to your unindexed pages.

    I can't offer much more advice without knowing the type of site you have (Wordpress, Joomla! etc...) but remember that Google doesn't return all indexed pages so, as others have said, join Google analytics and register with Google's Webmaster Tools (verify you own your site) and check whether Google is having problems crawling you site.

    Have you tried Yahoo Site Explorer?

    Have you checked your server logs to confirm the subdomain has been properly set-up: sometimes access stats are entered into the main domain's logs and not the subdomain's logs.
     
    Dion de Ville, Oct 10, 2009 IP
  12. Chrissy17

    Chrissy17 Peon

    Messages:
    561
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #12
    Use your blog to link to internal pages of your website.
     
    Chrissy17, Oct 10, 2009 IP
  13. farangkwaiyai

    farangkwaiyai Guest

    Messages:
    317
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #13
    If i was google, I wouldn't index your site either, why should they take you seriously for using a free domain service, why not pay 9 dollars for a real domain?

    Add h1 tag
    add 250 words in main body
    add alt tag to image
     
    farangkwaiyai, Oct 11, 2009 IP
  14. swapanjkda

    swapanjkda Peon

    Messages:
    221
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #14
    Ok, you it's not to hard to approach Google to index just get authority back link for those inner page which can be get by Social Bookmarking and Article submission booth accept innerpage url
     
    swapanjkda, Oct 11, 2009 IP
  15. Rahulsharma

    Rahulsharma Peon

    Messages:
    28
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #15
    Thanks guys for ur replies...
     
    Rahulsharma, Oct 11, 2009 IP
  16. Rahulsharma

    Rahulsharma Peon

    Messages:
    28
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #16
    But is it really difficult to get index on internal pages by google, if a site is hosted on sub domain..
     
    Rahulsharma, Oct 11, 2009 IP
  17. rena

    rena Peon

    Messages:
    1,987
    Likes Received:
    13
    Best Answers:
    0
    Trophy Points:
    0
    #17
    No, its the matter of time. Some time Google taking long time to index all the pages. if can build some back links and also keep updating the site and also resubmit sitemap after update the content
     
    rena, Oct 11, 2009 IP
  18. noam6767

    noam6767 Peon

    Messages:
    77
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #18
    What do GWT tells you about your inner links and site structure?
     
    noam6767, Oct 11, 2009 IP