1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Preview Future Spidering

Discussion in 'Products & Tools' started by arestia, Aug 14, 2004.

0
  1. #1
    is there any seo resource which will fully spider your website to list the number of internal pages a search engine will pick up by following all of the links.

    it has to be extensive becuase i would like to preview the spidering of a 1000+ page site.

    Thanks
    Dan
     
    arestia, Aug 14, 2004 IP
  2. skanxalot

    skanxalot Peon

    Messages:
    111
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Yes, there are several. In fact, I'm currently in the middle of writing a new one, but until then I'll recommend Black Widow from Softbyte Labs. I believe it does an effective job of spidering a domain.

    --------------------------------------
    Tyson Kirksey
     
    skanxalot, Aug 14, 2004 IP
  3. Will.Spencer

    Will.Spencer NetBuilder

    Messages:
    14,789
    Likes Received:
    1,040
    Best Answers:
    0
    Trophy Points:
    375
    #3
    Hmmm... nothing is exactly a search engine robot.

    You might play with Xenu Link Sleuth?
     
    Will.Spencer, Aug 14, 2004 IP