1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

bash script

Discussion in 'Programming' started by ssimon171078, Jul 31, 2014.

0
  1. #1
    i need some help :i want to grep all links from website with wget:
    get --spider --force-html -r -l1 somewebsite i need to save only urls without js,img.. to text file
     
    ssimon171078, Jul 31, 2014 IP
  2. Marcel Preda

    Marcel Preda Member

    Messages:
    21
    Likes Received:
    1
    Best Answers:
    1
    Trophy Points:
    43
    #2
    Hi there,

    I think that something like next line will work
    wget -r -l 1 --spider --force-html yoursite 2>&1 | grep saved | awk '{print $6}' | grep -iv 'if\.js' | grep -iv '\.jpg' | grep -iv '\.gif'

    Best Regards,
    Marcel Preda
     
    Marcel Preda, Aug 1, 2014 IP