1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

how to increase crawling and indexing rate of a site?

Discussion in 'Search Engine Optimization' started by Jacob Taylor, Feb 1, 2010.

  1. #1
    Hi
    I need suggestions to increase the crawling and indexing rate of my site , I have submitted sitemap on Google Webmaster tools and also doing article postings to get backlinks.
    I m waiting for postive suggestions, thanks :)
     
    Jacob Taylor, Feb 1, 2010 IP
  2. renanorola

    renanorola Well-Known Member

    Messages:
    594
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    103
    #2
    yes i am also want to index my blog faster.. My blog is now 2 weeks old but not yet index
     
    renanorola, Feb 1, 2010 IP
  3. Quatrain

    Quatrain Peon

    Messages:
    30
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Increase the frequency with which you

    #1) Add content to a particular page
    #2) Add pages to your site

    When you add pages they have to be "findable". Either linked to from the main page or through a sitemap.
     
    Quatrain, Feb 1, 2010 IP
  4. renanorola

    renanorola Well-Known Member

    Messages:
    594
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    103
    #4
    thanks for the tips ill try to follow your tips.
     
    renanorola, Feb 1, 2010 IP
  5. seofirmcanada

    seofirmcanada Peon

    Messages:
    99
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #5
    10 Ways to Increase Your Site Crawl Rate

    Regular and frequent visits by the crawler is the first sign that your site appeals to Google. Thus the most efficient way to get frequent and deep crawls is to develop a website that search engines see as important and valuable.

    Note that you can’t force Googlebot to visit you more often – what you can do is to invite it to come. Possible measures to take to increase the crawl rate may include:

    1. Update your content often and regularly (and ping Google once you do) – well, an obvious one, so not much to describe here; in a word, try to add new unique content as often as you can afford and do it regularly (3 times a week can be the best solution if you can’t update your site daily and are looking for the optimal update rate).
    2. Make sure your server works correctly: mind the uptime and Google Webmaster tools reports of the unreached pages. Two tools I can recommend here are Pingdom and Mon.itor.us.
    3. Mind your page load time: note that the crawl works on a budget – if it spends too much time crawling your huge images or PDFs, there will be no time left to visit your other pages.
    4. Check the site internal link structure: make sure there is no duplicate content returned via different URLs: again, the more time the crawler spends figuring your duplicate content, the fewer useful and unique pages it will manage to visit.
    5. Get more back links from regularly crawled sites.
    6. Adjust the crawl speed via Google Webmaster tools.
    7. Add a sitemap (though it’s up for a debate whether the sitemap can help with crawling and indexing issues, many webmasters report they have seen increased crawl rate after adding it).
    8. Make sure your server returns the correct header response. Does it handle your error pages properly? Don’t make the bot figure out what has happened: explain it clearly.
    9. Make sure you have unique title and meta tags for each of your pages.
    10. Monitor Google crawl rate for your site and see what works and what not:
     
    seofirmcanada, Feb 1, 2010 IP
  6. gulpari123

    gulpari123 Peon

    Messages:
    14
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #6
    I ask somthing how to work in Pingdom and Mon.itor.us.
     
    gulpari123, Feb 1, 2010 IP
  7. seo555

    seo555 Peon

    Messages:
    1,035
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #7
    seo555, Feb 1, 2010 IP
  8. skoopo

    skoopo Peon

    Messages:
    19
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #8
    Google and yahoo even Bing have there special section for webmaster where you can set the crawling speed and you can also view other important data collect b crawler from your website . Register Google web master account and try it out .

    Further its depend on your content and web server download and upload speed , software running on web server,load balancing and size of website . Dedicated ip is best where only your website is hosted as compare to shared hosting .
     
    skoopo, Feb 1, 2010 IP
  9. yoes_san

    yoes_san Peon

    Messages:
    443
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    0
    #9
    Just get back link from high PR site and submit a site map.
     
    yoes_san, Feb 1, 2010 IP
  10. Ledlauzis

    Ledlauzis Member

    Messages:
    411
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    35
    #10
    Make a good interlinking structure. From page to page. Like for 3-5 links in one post.

    Make few quality backlinks with blog commenting (PR2+) and your site will be indexed within a hours.
     
    Ledlauzis, Feb 2, 2010 IP
  11. pankajdeoria

    pankajdeoria Banned

    Messages:
    314
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    125
    #11
    @ point 6,

    How to set crawl speed from webmaster tools..

     
    pankajdeoria, Feb 2, 2010 IP
  12. jani01

    jani01 Active Member

    Messages:
    490
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    60
    #12
    I have same question. I never seen crawl speed from google webmaster or even from any other webmasters tools. Will you kindly explain ?
     
    jani01, Feb 2, 2010 IP
  13. joesmith

    joesmith Peon

    Messages:
    518
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #13
    Nice list. And whether we can adjust the crawl speed via webmaster tools.
     
    joesmith, Feb 2, 2010 IP
  14. Hersheys

    Hersheys Peon

    Messages:
    2,591
    Likes Received:
    23
    Best Answers:
    0
    Trophy Points:
    0
    #14
    Try to submit on stumbleupon also. and other social bookmarking site.
     
    Hersheys, Feb 2, 2010 IP
  15. Jacob Taylor

    Jacob Taylor Peon

    Messages:
    36
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #15
    thanks for all suggestions, i m doing article postings and social networking for my site.. Thanks to all of you :)
     
    Jacob Taylor, Feb 2, 2010 IP
  16. abrilward

    abrilward Peon

    Messages:
    321
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #16
    Ping also helps!
     
    abrilward, Feb 2, 2010 IP
  17. online07

    online07 Member

    Messages:
    375
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    26
    #17
    for increase crawling and indexing you can also submit your sitemap.xml file to search engine.
    thanks
     
    online07, Feb 2, 2010 IP
  18. cassine

    cassine Peon

    Messages:
    33
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #18
    Use Blog posting,article submission,press relese,Q & A etc.
     
    cassine, Feb 3, 2010 IP
  19. B.Williams

    B.Williams Active Member

    Messages:
    555
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    58
    #19
    My blog is also 2 weeks old. But only homepage is getting indexed by Google and Yahoo. Can anybody tell me how much time does Yahoo and Google takes to indexed my new Blog? I have done Social Bookmarking and backlink building. Thanks
     
    B.Williams, Feb 3, 2010 IP
  20. seoconsult1

    seoconsult1 Peon

    Messages:
    2
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #20
    here are some tips and tricks to increase the Google crawling rate of your word press blog...

    1 - If you are going to write on your blog then apart from your targeted keywords try to use those which are the title of your previous posts.
    2 - Link your previous posts to the new posts and increase interlinking this way.
    3 - Add your blog to Google webmaster tool and increase the Google crawl rate for your website or blog.
    4 - Pingback and Trackbacks play a very important role to attract a Google crawler to the new posts on your website.
    5 - Always on the pingback and trackback option in your every post.
     
    seoconsult1, Feb 3, 2010 IP