How rapidshare/megaupload search engines work ?

Discussion in 'Programming' started by bub0, Apr 16, 2010.

0
  1. #1
    Hello,

    I wonder how do rapidshare/megaupload search engines work ? How do they index links ?

    Thank you
     
    bub0, Apr 16, 2010 IP
  2. ccoonen

    ccoonen Well-Known Member

    Messages:
    1,606
    Likes Received:
    71
    Best Answers:
    0
    Trophy Points:
    160
    #2
    the sites have a listing of their content as a sitemap for search engines to crawl, I would advise crawling just the same :)
     
    ccoonen, Apr 16, 2010 IP
  3. bub0

    bub0 Guest

    Messages:
    3
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    So it's all about crawling and indexing like a google robot ? I guess I have now to figure out how to crawl :)
     
    bub0, Apr 17, 2010 IP