Website Crawler (How to Copy any Website)

Discussion in 'Products & Tools' started by @SHFAQ, Sep 1, 2008.

  1. #1
    Plz tell me is there any software or script to download any website complete folder with original files.

    For example this is a site addrese:
    www.mysite.com/script/
    Now i wanna get all files in script folder, plz tell me how to do this ?

    As i think its possible bcoz i have seen many famous script clones like youtube, how web hackers crawls all file with database.
    Here i wanna tell you that i dont want to get database and all other info of any site, just tell me how to get all files in any folder of site ? no matter they are .html file or .php
     
    @SHFAQ, Sep 1, 2008 IP
  2. MakeThatDollar

    MakeThatDollar Notable Member

    Messages:
    4,451
    Likes Received:
    158
    Best Answers:
    0
    Trophy Points:
    225
    #2
    You can't.
     
    MakeThatDollar, Sep 1, 2008 IP
  3. oregonthunder2

    oregonthunder2 Active Member

    Messages:
    360
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    78
    #3
    First of all, if your any kind of programmer you should be able to do this manually. I am afraid there is no program for it.
     
    oregonthunder2, Sep 1, 2008 IP
  4. @SHFAQ

    @SHFAQ Well-Known Member

    Messages:
    257
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    103
    #4
    Oh,
    i am not programmer but i am designer.
    I was thinking that there will be a software for this purpose but u r answer that nothing is available for this purpose, i dont know why millions of programmer think about this idea ?

    Waiting for some more comments...
     
    @SHFAQ, Sep 1, 2008 IP
  5. MrEsper

    MrEsper Banned

    Messages:
    206
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Thats because they make the script themeself.

    Think about it mate. If there was a program that could do that then thousands of people would have google's search engine technology coz they would have used a 'crawler' to get it.
     
    MrEsper, Sep 2, 2008 IP
  6. oregonthunder2

    oregonthunder2 Active Member

    Messages:
    360
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    78
    #6
    I meant no offense. It really depends on how the website is setup and how much security if any the website has. The other answer was right on. The scripts that you are referring to are usually a custom job, to make it a look-alike. Sometimes the scripts even behave the same.
     
    oregonthunder2, Sep 2, 2008 IP
  7. @SHFAQ

    @SHFAQ Well-Known Member

    Messages:
    257
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    103
    #7
    Well thanks all guys for comments.
    Now i can only hope that any programmer think about this idea and make a software for it.
     
    @SHFAQ, Sep 2, 2008 IP
  8. eric_basher

    eric_basher Peon

    Messages:
    185
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #8
    no one can't do that,if really happend then google,mircosoft..etc got hacked :D
     
    eric_basher, Sep 4, 2008 IP