How to Get Google To Crawl Your Site Faster - Detailed Report With Pictures

Discussion in 'Search Engine Optimization' started by longhornfreak, Jul 13, 2007.

  1. #1
    First of all for those of you that don't know.

    What is page crawling?



    Source: http://en.wikipedia.org/wiki/Web_crawler

    How does this benefit me?


    Crawling updates your pages on google. Therefore getting them index and bringing more traffic to your site. Overall it helps you increase the quality and value of your site and brings more visitors to your site.

    How do I get google to crawl my pages faster?

    Google provides you with many tools you can use to attract crawlers to your site.

    This is the first tool here

    Once you sign up and verify that you are the owner of the site, I will show you some of the features.

    Go to the diagnostics tab and go to web crawl.
    [​IMG]
    Navigate through the different options.
    [​IMG]
    Here you find information that relates to your pages and how they are being crawled.

    Next this is what you are probably interested in knowing.
    How to increase your crawl rate, many have asked, this is the solution.

    Go to the diagnostics tab and navigate to the crawl rate.
    [​IMG]

    Now here you should see something like this.
    [​IMG]

    This is where you change the speed to faster, if it allows you too. If you cannont, keep link building and sooner or later you will be able to. Also notice there are side effects to speeding up your crawl rate, it will slow down your sites load times. But it is up to you to decide whats more important. And some of you will have no problem with this, but others may have alot.
     
    longhornfreak, Jul 13, 2007 IP
    ebisa likes this.
  2. longhornfreak

    longhornfreak Well-Known Member

    Messages:
    2,067
    Likes Received:
    95
    Best Answers:
    0
    Trophy Points:
    140
    #2
    Adding Sitemaps

    Using this tool you can also generate a site map.

    What is a site map

    source: http://en.wikipedia.org/wiki/Site_map


    Many have noticed that adding a site map increases the speed and chances of having your paged indexed. This is how you create one.

    Google has set up a page that has all the details you need for creating a site map. You can find it here. This may look complicated to some of you, and you can hire people here on the DP forum to make one for you for really cheap.

    Now when you have created your site map

    Go to the "Sitemaps" tab.
    [​IMG]

    Within the contents of this page you should see something like this.
    [​IMG]

    Click on either of the "Add a Sitemap" Links on the page. And follow the steps to successfully add the map. This will help google out and help you out too.



    I am tired no so I think I am done for now. If you find this useful, or appreciate the effort I put into this, please rep me.
     
    longhornfreak, Jul 13, 2007 IP
  3. ebisa

    ebisa Banned

    Messages:
    190
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #3
    thanks very helpful article!!!
     
    ebisa, Jul 13, 2007 IP
  4. imnotadoctor

    imnotadoctor Well-Known Member

    Messages:
    415
    Likes Received:
    10
    Best Answers:
    0
    Trophy Points:
    140
    #4
    I heard that adding Adsense to your site will help you get crawled faster.
     
    imnotadoctor, Jul 13, 2007 IP
  5. noxious

    noxious Peon

    Messages:
    362
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #5
    awesome @ the crawl rate, my friend told me about that but i had no idea what he was talking about. just set my site to faster :)
     
    noxious, Jul 13, 2007 IP
  6. GeorgR.

    GeorgR. Peon

    Messages:
    2,831
    Likes Received:
    78
    Best Answers:
    0
    Trophy Points:
    0
    #6
    doesnt 99% of people here on DP know that already ? ;)

    But...this setting (IMHO) does not force to start google crawling..its merely a speed-setting.

    If you have a new site and want google to crawl it in a day.....just post an ad on craigslist. There are some other ways....craigslist or kijiji/gumtree etc. always works. i can get sites crawled and listed in a day.

    Then you can adjust the speed in the webmaster panel at google.
     
    GeorgR., Jul 13, 2007 IP