script to get urls

Discussion in 'Scripts' started by JEET, Jan 30, 2006.

  1. #1
    Hi,
    I am looking for a PHP or cgi script which does the following :

    Finds all individual URL's from a specified domain name .
    Puts them in a textbox on a html or PHP page .

    Anybody knows any such script or can write one please if not difficult?
    Thanks
    Regards
    Jeet
     
    JEET, Jan 30, 2006 IP
  2. JEET

    JEET Notable Member

    Messages:
    3,832
    Likes Received:
    502
    Best Answers:
    19
    Trophy Points:
    265
    #2
    Hey come on all PHP guru's suggest something !
    Regards
    Jeet
     
    JEET, Jan 31, 2006 IP
  3. Windows-Update-Advisor

    Windows-Update-Advisor Well-Known Member

    Messages:
    171
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    158
    #3
    Are you looking for a sitemap generator? Seems to me that all good sitemap generator program can do the task that you require...
     
    Windows-Update-Advisor, Jan 31, 2006 IP
  4. JEET

    JEET Notable Member

    Messages:
    3,832
    Likes Received:
    502
    Best Answers:
    19
    Trophy Points:
    265
    #4
    No I am not looking for a sitemap generater .
    But you are right , all sitemap PHP scripts can do this .
    Do you know of any scripts I can use to get URL's ?
    All I want this script to do is :
    find all URL's from a given domain and list them in a text box on a html or php page . That's all . No further programming needed.
    Can you suggest any or help ?
    Thanks
    Regards
    Jeet
     
    JEET, Jan 31, 2006 IP
  5. amitpatel_3001

    amitpatel_3001 Results Follow Patience

    Messages:
    14,074
    Likes Received:
    1,178
    Best Answers:
    0
    Trophy Points:
    430
    #5
    w ww.webextractor.com -
    o Extract targeted company contact data (email, phone, fax) from web for responsible b2b communication.
    o Extract url, meta tag (title, desc, keyword) for website promotion, search directory creation, web research.

    w ww.focalmedia.net/urlextract.html -
    Url Extractor has been created to extract URL addresses from web pages. It can fetch all valid URL's any HTML file and generate an output file with formatted Url's without duplicates. You are also able to filter Url's to prevent addresses

    Hope this is what you wanted :)
     
    amitpatel_3001, Feb 1, 2006 IP
  6. JEET

    JEET Notable Member

    Messages:
    3,832
    Likes Received:
    502
    Best Answers:
    19
    Trophy Points:
    265
    #6
    Hi ,
    Thanks but I am looking for a PHP script .
    The url extracter you gave a link to needs a hard disk copy of the website's pages to extract URL's from it . If the file is on hard disk , I can myself write a program to do almost anything with it .
    What I am looking for is a PHP script where when a domain is entered , it finds all other pages under that domain . Then makes a list of these URL's and shows this on a website's page in a textbox or simply makes a text file and shows the link to this text file whichever would be server / browser friendly .
    I don't know anything about PHP and even if I found some crawling scripts , I would be unable to make changes as per my requirements.
    I am trying to find this script for the last 10 days and would really appreciate any help in this matter .
    Best regards
    Jeet
     
    JEET, Feb 1, 2006 IP
  7. Illum

    Illum Well-Known Member

    Messages:
    763
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    195
    #7
    Illum, Nov 5, 2010 IP
  8. adi12

    adi12 Active Member

    Messages:
    123
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    56
    #8
    you can also try to install linkgopher add on for mozilla. it will help you a lot.
     
    adi12, Nov 5, 2010 IP