Can anyone explain how does spiders/crawlers functions ?

Discussion in 'Search Engine Optimization' started by 28081981, Dec 9, 2008.

  1. #1
    I made a new blog, a few days old. It has just one backlink from a forum signature, and it is indexed (in google) I made a couple of post, and after a few days, when I checked Awstats, it showed googlebot has visted my blog a couple of times.

    I am curious to know how does these spiders/crawlers functions. does blogs gets auto pinged as we post a new comment? I would like to undersatnd the basic functioning of a crawler, any relevent links would be appreciated. Thanks
     
    28081981, Dec 9, 2008 IP