1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

How do you know when your site has been deep crawled?

Discussion in 'Traffic Analysis' started by dawggone, Mar 8, 2006.

  1. #1
    It is easy to tell when spiders and bots visit but how (as in where in my stats etc.) should I look to find out more about how deep they crawled?

    About how often do the major bots do so?

    Thanks!
     
    dawggone, Mar 8, 2006 IP
  2. anjalirai

    anjalirai Member

    Messages:
    161
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    38
    #2
    I have no idea, plz say something about me also.
     
    anjalirai, Jul 28, 2010 IP
  3. atxsurf

    atxsurf Peon

    Messages:
    2,394
    Likes Received:
    21
    Best Answers:
    1
    Trophy Points:
    0
    #3
    you will have to check your server logs. Or you can try to derive this info from "number of pages crawled per day" in your webmaster tools.
     
    atxsurf, Jul 28, 2010 IP
  4. hospitaleracha

    hospitaleracha Active Member

    Messages:
    553
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    55
    #4
    Just add your site to Google Webmaster Tools and get your crawl stats from there ;-) SY
     
    hospitaleracha, Jul 28, 2010 IP
  5. anjalirai

    anjalirai Member

    Messages:
    161
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    38
    #5
    Thank u so much for information
     
    anjalirai, Jul 28, 2010 IP
  6. garbin

    garbin Peon

    Messages:
    128
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #6
    i use the google website, know the average of crawled, the high and the low!
     
    garbin, Jul 29, 2010 IP
  7. sarikabtech

    sarikabtech Well-Known Member

    Messages:
    186
    Likes Received:
    3
    Best Answers:
    1
    Trophy Points:
    108
    #7
    sarikabtech, Aug 15, 2010 IP
  8. NuiLoa

    NuiLoa Peon

    Messages:
    27
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #8
    You could also just do a "site:" search over your domain in each of the search engines to see how many pages you have indexed.
     
    NuiLoa, Aug 16, 2010 IP
  9. Alisha goal

    Alisha goal Peon

    Messages:
    108
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #9
    I think from the Google web master tools you can get the details from your crawled page.Just try it.
     
    Alisha goal, Aug 17, 2010 IP