How to get crawled every few days

Discussion in 'Search Engine Optimization' started by burtie, Jan 19, 2009.

  1. #1
    Hi all,

    How can I get a page on my site to be crawled every day or every few days?

    The following page will be updated with new products each day and I would like to have the best opportunity to get as much of them indexed as possible.

    http://www.successdept.com/most-recent.html

    I guess that if i get this paged crawled often enough that I will stand more chance of getting most of my pages index.

    Also, how do I know if my page is getting crawled?

    Hope you can help?
     
    burtie, Jan 19, 2009 IP
  2. elias_sorensen

    elias_sorensen Well-Known Member

    Messages:
    852
    Likes Received:
    20
    Best Answers:
    0
    Trophy Points:
    110
    #2
    Get some backlinks.

    Sign up for Google webmaster tools and add your sitemap (tell google that the page updates every day).

    You can also see when your page gets crawled in there.
     
    elias_sorensen, Jan 19, 2009 IP
  3. mokmok69

    mokmok69 Peon

    Messages:
    569
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Use social media site to indexed your site fast or ping it.
     
    mokmok69, Jan 19, 2009 IP
  4. kijakarn

    kijakarn Peon

    Messages:
    404
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    0
    #4
    1. good and unique articles , every day
    2. place that link of the article in high traffic social bookmark sites eg. digg, stumble ,technoratti or even in webboards.
     
    kijakarn, Jan 19, 2009 IP
  5. ebizpro112

    ebizpro112 Banned

    Messages:
    19
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Hello friend,

    As New and advance concept of Search Engine algoridham

    If you want to crawl your website, distance of few days, then you have you must upgrade your website with full of high quality contents and also you can check your website crawl date from google toolbar.

    Content is very importent thing to get fast index and to get fast rank

    Thanks
    ebizpro112
     
    ebizpro112, Jan 19, 2009 IP
  6. FHM

    FHM Peon

    Messages:
    173
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #6
    If you want more frequent visits from Googlebot, you need two things:
    a) Lots of backlinks on quality sites that are crawled often.
    b) Frequent updates.
     
    FHM, Jan 19, 2009 IP
  7. burtie

    burtie Banned

    Messages:
    444
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #7
    All joined up and submitted - thank you so much :)


    Which ones are best for this in your opinion?
     
    burtie, Jan 19, 2009 IP
  8. burtie

    burtie Banned

    Messages:
    444
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #8
    OK, I have (b) and am working on (a). Is there a list anywhere of suggested sites to get links from?
     
    burtie, Jan 19, 2009 IP
  9. vikyshine

    vikyshine Peon

    Messages:
    117
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #9
    you can find them anywhere my friends, and these sites are nothing just the directories, blogs and article submission site. Make a little search, and you will get a thousand there......
     
    vikyshine, Jan 19, 2009 IP
  10. Roger_Silvester

    Roger_Silvester Peon

    Messages:
    277
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #10
    Possible measures to take to increase the crawl rate may include:
    1. Update your content often and regularly (and ping Google once you do) - well, an obvious one, so not much to describe here; in a word, try to add new unique content as often as you can afford and do it regularly.
    2. Make sure your server works correctly: mind the uptime and Google Webmaster tools reports of the unreached pages. Two tools I can recommend here are Pingdom and Mon.itor.us.
    3. Mind your page load time: note that the crawl works on a budget - if it spends too much time crawling your huge images or PDFs, there will be no time left to visit your other pages.
    4. Check the site internal link structure: make sure there is no duplicate content returned via different URLs: again, the more time the crawler spends figuring your duplicate content, the fewer useful and unique pages it will manage to visit.
    5. Get more back links from regularly crawled sites.
    6. Adjust the crawl speed via Google Webmaster tools.
    7. Add a sitemap (though it’s up for a debate whether the sitemap can help with crawling and indexing issues, many webmasters report they have seen increased crawl rate after adding it).
    8. Make sure your server returns the correct header response. Does it handle your error pages properly? Don’t make the bot figure out what has happened: explain it clearly.
    9. Make sure you have unique title and meta tags for each of your pages.
    10. Monitor Google crawl rate for your site and see what works and what not

    I hope that this information will be of good use to you.

    Regards
     
    Roger_Silvester, Jan 19, 2009 IP
  11. kuzmanin

    kuzmanin Peon

    Messages:
    242
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #11
    fresh content everyday
     
    kuzmanin, Jan 19, 2009 IP
  12. mcars12

    mcars12 Peon

    Messages:
    134
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #12
    1. fresh content
    2. Ping it
    3. Bookmark it via digg, etc..
     
    mcars12, Jan 19, 2009 IP
  13. elias_sorensen

    elias_sorensen Well-Known Member

    Messages:
    852
    Likes Received:
    20
    Best Answers:
    0
    Trophy Points:
    110
    #13
    Digg, Del.icio.us and more. Do a search here on DP. There was a thread earlier today with a pretty neat list of social bookmarking sites with high PR.
     
    elias_sorensen, Jan 19, 2009 IP
  14. burtie

    burtie Banned

    Messages:
    444
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #14
    So many great ideas for me to work on.

    One question.

    How do I find sites that are crawled regular to get links from?
     
    burtie, Jan 19, 2009 IP
  15. seodetectors07

    seodetectors07 Notable Member

    Messages:
    941
    Likes Received:
    45
    Best Answers:
    0
    Trophy Points:
    205
    #15
    you can sign up for google webmaster tool and submit your sitemap and there is an option which let you choose the crawler visits to your website......:):):)
     
    seodetectors07, Jan 26, 2009 IP