[HELP} Finding all of the links to my website...

Discussion in 'Content Management' started by kcgclove5, Oct 24, 2009.

  1. #1
    Hi,

    I don't know how to really explain what I need but here I will go...

    I need to find all of the URLs that make up my website...

    For example...

    all the URLs that are in yahoo...

    http://www.yahoo.com/
    http://www.yahoo.com/games
    http://mail.yahoo.com
    http://www.yahoo.com/radio
    etc...etc...etc...

    Is there a program that can do this for me? I have a HUGE website, probably with about 15k pages... That I need all the URLs for

    Oh yeah, and I need something that will be in the format above, not a sitemap that has all that extra crap in it...

    just...

    url
    url
    url
    url
    etc...
     
    kcgclove5, Oct 24, 2009 IP
  2. theapartmentguru

    theapartmentguru Peon

    Messages:
    10
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Google webmaster tools may be able to help you do this.
     
    theapartmentguru, Oct 26, 2009 IP
  3. travelmoth

    travelmoth Active Member

    Messages:
    153
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    53
    #3
    If I do this job......I will find the urls from web server log files.................
     
    travelmoth, Oct 26, 2009 IP
  4. duanecilliers

    duanecilliers Guest

    Messages:
    18
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Yahoo Site Explorer will show you all your indexed URLs
     
    duanecilliers, Nov 14, 2009 IP
  5. gbjuno

    gbjuno Greenhorn

    Messages:
    77
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    18
    #5
    create a sitemap for your site with a sitemap building tool and you will get the list of all your urls
     
    gbjuno, Nov 15, 2009 IP
  6. Wrams

    Wrams Peon

    Messages:
    43
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Google Webmaster Tools is the best place for checking all website related stats for your own website
     
    Wrams, Nov 17, 2009 IP