Getting all links of a site

Discussion in 'Google' started by anjanesh, Sep 1, 2005.

  1. #1
    Hi

    I want to get all links (http:// links) of an entire site.
    Spidering it will be one long code.
    Instead would entering site:domain.com http:// in google give the correct result ?

    Thanks
     
    anjanesh, Sep 1, 2005 IP
  2. honey

    honey Prominent Member

    Messages:
    15,555
    Likes Received:
    712
    Best Answers:
    0
    Trophy Points:
    325
    #2
    Do you mean you want to create a sitemap or something ? If yes, use www.xtreeme.com, it's good.
     
    honey, Sep 1, 2005 IP
  3. anjanesh

    anjanesh Well-Known Member

    Messages:
    344
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    165
    #3
    1. I dont exactly know what a sitemap is.
    2. Lets say I wanted to search for a particular phrase in a particular site, then in google I would do site:somesite.com particular phrase.
    Instead if I do site:somesite.com http://, would I get all the http links listed in that site ?
     
    anjanesh, Sep 1, 2005 IP
  4. SaN-DeeP

    SaN-DeeP Well-Known Member

    Messages:
    590
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    140
    #4
    hello anjanesh,
    This cannot be answered properly, if the site has lot of pages (more then 10000) then google might have not indexed them all.

    The query which you are putting up here:

    Site:mydomain.com Search phrase on google

    this will only return the "Search Phrase" for mydomain.com (If it has been indexed by google)

    I hope you got what i mean to say ?
     
    SaN-DeeP, Sep 2, 2005 IP
  5. anjanesh

    anjanesh Well-Known Member

    Messages:
    344
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    165
    #5
    So site:somesite.com http:// wont return all outgoing links ?
     
    anjanesh, Sep 2, 2005 IP
  6. Perrow

    Perrow Well-Known Member

    Messages:
    1,306
    Likes Received:
    78
    Best Answers:
    0
    Trophy Points:
    140
    #6
    Quick answer: No
    Long answer: No way :p
    Really long answer: No, it would give you all indexed pages with the text "http://" somewhere on the page. Each page would only appear once and no links would be specified. You need some tool that spiders your site and gives you a report on what links there are. Try Xenu's link sleuth for example (have not used it enough to be certain it does what you want but I think it does).
     
    Perrow, Sep 2, 2005 IP
  7. simplexity

    simplexity Peon

    Messages:
    198
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #7
    If you want to create a startmap why not try google's new sitemap creator?

    https://www.google.com/webmasters/sitemaps/login

    Its a might seem a bit complicated for someone who isn't sure about sitemaps but it definately is v.useful.

    To read more wikipedia is a good place to start:

    http://en.wikipedia.org/wiki/Sitemap

    I hope this helps
     
    simplexity, Sep 2, 2005 IP
  8. The Webmaster

    The Webmaster IdeasOfOne

    Messages:
    9,516
    Likes Received:
    718
    Best Answers:
    0
    Trophy Points:
    360
    #8
    Actrually I assume you want to check All Outbound links to your site.
    To verify broken link?? or just to check?
    in this case one software can help that is XENU
    this URL- http://home.snafu.de/tilman/xenulink_guide.html

    Hope it wud help you.
     
    The Webmaster, Sep 5, 2005 IP
  9. anjanesh

    anjanesh Well-Known Member

    Messages:
    344
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    165
    #9
    Well..the requierments are a bit different. I dont want to check for broken links or create a sitemap. I just want to get all outgoing links of 10-15 different sites - that I dont own.
     
    anjanesh, Sep 5, 2005 IP
  10. Roman

    Roman Buffalo Tamerâ„¢

    Messages:
    6,217
    Likes Received:
    592
    Best Answers:
    0
    Trophy Points:
    310
    #10
    Roman, Sep 5, 2005 IP
  11. anjanesh

    anjanesh Well-Known Member

    Messages:
    344
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    165
    #11
    Cool - Where can I find the algorithm for this ?
     
    anjanesh, Sep 5, 2005 IP