1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

how to determine crawled pages?

Discussion in 'Google Sitemaps' started by bentong, Oct 5, 2005.

  1. #1
    I've just started using sitemap using this tool and submitted it to google sitemap 2 days ago.

    I've only seen crawl errors, how can we know what pages has been crawled by googlebot? :confused:
    SEMrush
     
    bentong, Oct 5, 2005 IP
    SEMrush
  2. johnt

    johnt Peon

    Messages:
    178
    Likes Received:
    21
    Best Answers:
    0
    Trophy Points:
    0
    #2
    A lot of log analysers will tell you which pages have been requested by the various spiders, and how many times they were retrieved
     
    johnt, Oct 5, 2005 IP
  3. bentong

    bentong Banned

    Messages:
    3,543
    Likes Received:
    257
    Best Answers:
    0
    Trophy Points:
    0
    #3
    I mean on the google sitemap page..
     
    bentong, Oct 5, 2005 IP
  4. aeiouy

    aeiouy Peon

    Messages:
    2,877
    Likes Received:
    275
    Best Answers:
    0
    Trophy Points:
    0
    #4
    The google sitemap page does not provide that information.
     
    aeiouy, Oct 5, 2005 IP
  5. webmistress

    webmistress Guest

    Messages:
    485
    Likes Received:
    36
    Best Answers:
    0
    Trophy Points:
    0
    #5
    webmistress, Oct 9, 2005 IP
  6. frankm

    frankm Active Member

    Messages:
    915
    Likes Received:
    63
    Best Answers:
    0
    Trophy Points:
    83
    #6

    Check with your hosting provider to see if you can get the raw access-log for your website. Everything from ip addresses 66.249.*.* is google.
     
    frankm, Oct 9, 2005 IP
  7. gary99

    gary99 Guest

    Messages:
    225
    Likes Received:
    13
    Best Answers:
    0
    Trophy Points:
    0
    #7
    I was looking at my logs recently, and got all excited that a google IP had been requesting pages from my site. I think maybe it just had to do with adsense, since it tends to happen when I'm browsing my own site. Do the adsense scripts trigger a page hit from google?
     
    gary99, Oct 10, 2005 IP
  8. gary99

    gary99 Guest

    Messages:
    225
    Likes Received:
    13
    Best Answers:
    0
    Trophy Points:
    0
    #8
    While on this topic, is there any way to get google to crawl a site again? I understand that if I had any sort of rank out there I'd be crawled again more frequently. But alas, I have no rank at all yet, and the pages google currently has indexed don't even exist anymore. Not that it matters since I don't show up on any searches. :)
     
    gary99, Oct 10, 2005 IP
  9. durango

    durango Guest

    Messages:
    83
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    0
    #9
    Yes, google will go to the same pages as your human visitors to see which ads are relevant to that page. Usually you can tell this by looking at the UserAgent in your log files. Adsense will usually show up as MediaPartners-Google/2.1 or something like that.
     
    durango, Oct 11, 2005 IP