Complete crawl and linik extraction

Discussion in 'Search Engine Optimization' started by eslsociety, Feb 2, 2008.

  1. #1
    Does anyone know a good online script (free) that will completely crawl a domain and extract all of the links and spit them out as text?

    Would appreciate any recommedations.

    THanks
     
    eslsociety, Feb 2, 2008 IP
  2. alienated

    alienated Active Member

    Messages:
    144
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    73
    #2
    Not all links, but you can try "site:www.domain.com" in Google or any search engines.
     
    alienated, Feb 2, 2008 IP
  3. astup1didiot

    astup1didiot Notable Member

    Messages:
    5,926
    Likes Received:
    270
    Best Answers:
    0
    Trophy Points:
    280
    #3
    You can use a XML Sitemap generate to build all internal links and use a convert program to do XML to Text.
     
    astup1didiot, Feb 2, 2008 IP
  4. sunnyverma1984

    sunnyverma1984 Well-Known Member

    Messages:
    342
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    120
    #4
    sunnyverma1984, Feb 3, 2008 IP