Does curl show the remote users IP address?

Discussion in 'PHP' started by Xexi, Nov 30, 2007.

  1. #1
    I know it obviously shows the host's IP, but does it show any information about the remote user?
     
    Xexi, Nov 30, 2007 IP
  2. hogan_h

    hogan_h Peon

    Messages:
    199
    Likes Received:
    30
    Best Answers:
    0
    Trophy Points:
    0
    #2
    As far as i know, it shouldn't show any information about the user calling the actual script.
     
    hogan_h, Nov 30, 2007 IP
  3. tonybogs

    tonybogs Peon

    Messages:
    462
    Likes Received:
    13
    Best Answers:
    0
    Trophy Points:
    0
    #3
    If you are making a http request it will show information in the request logs of your webserver. This will contain the IP.
     
    tonybogs, Nov 30, 2007 IP
  4. Xexi

    Xexi Well-Known Member

    Messages:
    91
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    100
    #4
    Thanks, as long as the site I'm scraping doesn't know my IP I'm in the clear :cool:
     
    Xexi, Dec 1, 2007 IP
  5. Kwaku

    Kwaku Well-Known Member

    Messages:
    1,217
    Likes Received:
    45
    Best Answers:
    0
    Trophy Points:
    140
    #5
    But it does know your IP; it'll appear in their logs.
     
    Kwaku, Dec 1, 2007 IP
  6. baris22

    baris22 Active Member

    Messages:
    543
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    60
    #6
    If they know my ip, can they stop me using my script?
     
    baris22, Dec 1, 2007 IP
  7. TwistMyArm

    TwistMyArm Peon

    Messages:
    931
    Likes Received:
    44
    Best Answers:
    0
    Trophy Points:
    0
    #7
    Of course, they just have to block your IP address (either at the server level or their own script level).
     
    TwistMyArm, Dec 1, 2007 IP
  8. baris22

    baris22 Active Member

    Messages:
    543
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    60
    #8
    But they can not stop me if i am using my local, can they?

    My ip changes everytime i connect to internet.
     
    baris22, Dec 1, 2007 IP
  9. Kwaku

    Kwaku Well-Known Member

    Messages:
    1,217
    Likes Received:
    45
    Best Answers:
    0
    Trophy Points:
    140
    #9
    If you have a dynamic IP that helps, but they might just block the range. However, most companies don't care too much about scraping as long as you don't do it too often.

    The best way IMHO is to have a dynamic IP and then make your script (PHP? Perl?) mask as a IE 6 or 7 browser on Windows XP so you look like a normal user. That is easy to do. And then just don't scrape too often; few times a day is fine.
     
    Kwaku, Dec 1, 2007 IP
  10. Xexi

    Xexi Well-Known Member

    Messages:
    91
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    100
    #10
    To wich server are you referring will know my IP?

    The target server I'm leeching information from or the remote website I uploaded the script to, wich I'm paying a monthly fee for?
     
    Xexi, Dec 1, 2007 IP
  11. Kwaku

    Kwaku Well-Known Member

    Messages:
    1,217
    Likes Received:
    45
    Best Answers:
    0
    Trophy Points:
    140
    #11
    The target server you are leeching from.
     
    Kwaku, Dec 1, 2007 IP
  12. tonybogs

    tonybogs Peon

    Messages:
    462
    Likes Received:
    13
    Best Answers:
    0
    Trophy Points:
    0
    #12
    The site you are pulling the informaion from will know the IP but itll only be in the logs. If its a high traffic site they probably wont even notice unless you are doing it continuously.
     
    tonybogs, Dec 2, 2007 IP
  13. hogan_h

    hogan_h Peon

    Messages:
    199
    Likes Received:
    30
    Best Answers:
    0
    Trophy Points:
    0
    #13
    To Kwaku and tonybogs:
    How would that be possible? As i see it, the only IP appearing in the logs of target server would be remote server IP which is accessing it and not IP from person calling the script on remote server. You could even setup cron job or call the script through proxy, i just don't see how and why another IP address beside remote server IP would appear in the logs of the target server. The whole proxy/anonymizer websites are built on this principle, accessing target servers on behalf of the client, so it's IP address doesn't show up.
     
    hogan_h, Dec 2, 2007 IP
  14. TwistMyArm

    TwistMyArm Peon

    Messages:
    931
    Likes Received:
    44
    Best Answers:
    0
    Trophy Points:
    0
    #14
    That's correct. If you are accessing your remote site to access the other site, they won't know YOUR IP address.

    Unfortunately I think you never really stated the full process that you were intending to do and things like "But they can not stop me if i am using my local, can they?" imply that you were just wanting to run the script locally, accessing directly the site you wanted to leech from.
     
    TwistMyArm, Dec 2, 2007 IP
  15. hogan_h

    hogan_h Peon

    Messages:
    199
    Likes Received:
    30
    Best Answers:
    0
    Trophy Points:
    0
    #15
    Lol, i intendend to do nothing :)

    The TS clearly stated he rented remote server to be able to leach from target server, without compromising and leaving his own IP address in the target server logs.

    In that case, his own IP shouldn't appear in the target server logs, that's what i stated and you are confirming it now.

    Sure, if you are running web-server locally, your IP = server IP, in that case that IP will appear in target server log.

     
    hogan_h, Dec 2, 2007 IP
  16. Kwaku

    Kwaku Well-Known Member

    Messages:
    1,217
    Likes Received:
    45
    Best Answers:
    0
    Trophy Points:
    140
    #16
    ah; yep then I misunderstood, a nice 'picture' would have been great;

    local -> remote -> leeched site

    or something :)

    Though still wondering how that would help though; you rented a server ; if you want to leech without 'getting caught' I guess renting a server might not help you either.

    You can also (as I did) ; pick some of the best proxies (pick from proxy.org etc) and write some Curl code against them to leech from the site. Very easy and you can switch proxy very easily and they usually have millions of hits so you won't get caught easily.

    Sorry for the misunderstanding though; you were right in the first place.
     
    Kwaku, Dec 2, 2007 IP
  17. baris22

    baris22 Active Member

    Messages:
    543
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    60
    #17
    ok. Can someone explain to me what is happening?

    Which way is better?

    I am leaching a site. I was using my server to leach till now. At the moment I changed it to my local.

    When i leach using my server will they know my server ip?
    When i leach using my local will they know my ip?

    The script i am using has got folders. it is like this at the moment http://local/script/a.php
    What will they see in their log file? will it be 06.202.714.38/script/a.php

    If i use server will they see as http:www/a/com/script/a.php

    Thanks
     
    baris22, Dec 2, 2007 IP