Google crawlers

Discussion in 'SEO' started by cheburashka, Jan 21, 2010.

  1. #1
    What is the easiest way to tell when a website got crawled last?
     
    cheburashka, Jan 21, 2010 IP
  2. Thomasan

    Thomasan Active Member

    Messages:
    310
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    53
    #2
    find the site index page.. and get the cached file .. there is date and time mention. by the google.
     
    Thomasan, Jan 22, 2010 IP
  3. Web Dev

    Web Dev Peon

    Messages:
    214
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #3
    The easiest way is to go to Google, type your site URL, then click on "Cached".

    It will tell you with plain details the date, and time your site was lasted crawl.

    Also, you'll see a snapshot of the page as it appeared to the bots...
     
    Web Dev, Jan 22, 2010 IP
  4. neverfaithless

    neverfaithless Peon

    Messages:
    25
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #4
    That's a great tip! Thanks!
     
    neverfaithless, Jan 22, 2010 IP
  5. cheburashka

    cheburashka Peon

    Messages:
    671
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Sweet. Thanks for tips guys. It is easier then I thought. Like everything in Google, I guess.
     
    cheburashka, Jan 22, 2010 IP
  6. cheburashka

    cheburashka Peon

    Messages:
    671
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Just tried that and I get a message that says "we are sorry...but your computer or network may be sending automated queries. To protect our users, we can't process you request right now." Do you guys know what causes it and is there a way around it?
     
    cheburashka, Jan 22, 2010 IP
  7. anjelina27

    anjelina27 Member

    Messages:
    730
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    28
    #7
    It happens when you are networks connected to lots of computers and they are all sending queries to the google search engine.So to avoid this try to use proxy.
     
    anjelina27, Jan 23, 2010 IP
  8. kristoffer

    kristoffer Member

    Messages:
    81
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    41
    #8
    Simple but an important question asked by you.
     
    kristoffer, Jan 23, 2010 IP
  9. leepee

    leepee Active Member

    Messages:
    144
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    51
    #9
    cache:domain in google search will give you the information.
     
    leepee, Jan 23, 2010 IP
  10. cheburashka

    cheburashka Peon

    Messages:
    671
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #10
    Even better...
     
    cheburashka, Jan 29, 2010 IP
  11. cheburashka

    cheburashka Peon

    Messages:
    671
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #11
    Any ideas on how to improve PR of internal pages? I got PR3 on the home page, and some of the internal ones have a 2, but some don't have any page rank. What gives?
     
    cheburashka, Jan 29, 2010 IP
  12. monishka

    monishka Peon

    Messages:
    531
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #12
    Hello Friend,

    There is a two option to first you can check through the Google tool bar, and second you can check through the commend cache . If you will put the commend of cache then you can check that when your page has cached.
     
    monishka, Jan 30, 2010 IP
  13. cheburashka

    cheburashka Peon

    Messages:
    671
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #13
    You misunderstood. I didn't ask how to check it; rather how to improve.
     
    cheburashka, Jan 30, 2010 IP
  14. tarunmarketing

    tarunmarketing Peon

    Messages:
    121
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #14
    You have to go through the index page of websites, you will see the date and catch time of google crawler visited in your websites last time.
     
    tarunmarketing, Feb 2, 2010 IP