How to bypass blocked server IP

Discussion in 'Site & Server Administration' started by nokia3310, May 2, 2011.

0
  1. #1
    What can one do if the IP of a VPS server is blocked from scraping from a website. The website blocked the VPS server from scraping.

    How can one have anonymous IP for the server to bypass this block.
    Anything that can be used to just bypass the block so that scraping can be done from same server is all that is needed.

    Thanks for helping.

    P.S. Trying to help a friend.
     
    nokia3310, May 2, 2011 IP
  2. Intermg

    Intermg Active Member

    Messages:
    1,282
    Likes Received:
    11
    Best Answers:
    1
    Trophy Points:
    65
    #2
    Perhaps order an additional IP address from hosting company. Or use a proxy. :)
     
    Intermg, May 3, 2011 IP
  3. nokia3310

    nokia3310 Peon

    Messages:
    191
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    How do i set up proxy "to solve this problem" (notice the quote in bold)
     
    Last edited: May 3, 2011
    nokia3310, May 3, 2011 IP
  4. Intermg

    Intermg Active Member

    Messages:
    1,282
    Likes Received:
    11
    Best Answers:
    1
    Trophy Points:
    65
    #4
    1) Look for a free proxy server.
    2) Set up your scrapper application to access that particular website through a proxy server.
    3) The scrapper will now access the site from a different IP address that isn't blocked.
    4) I guess this will solve the problem. ;)
     
    Intermg, May 3, 2011 IP
  5. nokia3310

    nokia3310 Peon

    Messages:
    191
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    then the IP of that proxy server gets blocked also?
    is there a permanent solution to this?
     
    nokia3310, May 3, 2011 IP
  6. Intermg

    Intermg Active Member

    Messages:
    1,282
    Likes Received:
    11
    Best Answers:
    1
    Trophy Points:
    65
    #6
    I don't think so, though you could try rotating proxy servers.
     
    Intermg, May 3, 2011 IP
  7. nokia3310

    nokia3310 Peon

    Messages:
    191
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #7
    How do i use a proxy server with the server?
    I have a proxy server account, can i use that proxy service to do this?
    By the way this proxy server has like 5000 IP addresses and can change to different IP addresses.

    Any link or detailed way to do this will be appreciated.
     
    nokia3310, May 3, 2011 IP
  8. Intermg

    Intermg Active Member

    Messages:
    1,282
    Likes Received:
    11
    Best Answers:
    1
    Trophy Points:
    65
    #8
    It depends on the software you are using.
     
    Intermg, May 3, 2011 IP
  9. nokia3310

    nokia3310 Peon

    Messages:
    191
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #9
    i use hidemyass.com
     
    nokia3310, May 3, 2011 IP
  10. Intermg

    Intermg Active Member

    Messages:
    1,282
    Likes Received:
    11
    Best Answers:
    1
    Trophy Points:
    65
    #10
    No, I mean which scraping software are you using? I've never used scrapers, but I guess they should definitely have proxy support, for obvious reasons. :p
     
    Intermg, May 3, 2011 IP
  11. nokia3310

    nokia3310 Peon

    Messages:
    191
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #11
    looks like you dnt know these thing ursef
    well u dnt have to use a software to scrap...u can scrap with a script
     
    nokia3310, May 3, 2011 IP
  12. Intermg

    Intermg Active Member

    Messages:
    1,282
    Likes Received:
    11
    Best Answers:
    1
    Trophy Points:
    65
    #12
    Lol ;) Script is a program, isn't it? And a program is a software, alright? :)

    Anyway, if you're using the "right" script for gathering (ok, "scraping") the data, it should have the support for proxies. Otherwise, you could just modify the script (or ask someone) to make it work with proxy servers.

    I guess this is the only viable solution to your problem. If you ever find a better one, please let me know. :)
     
    Intermg, May 3, 2011 IP
  13. GORF

    GORF Well-Known Member

    Messages:
    224
    Likes Received:
    21
    Best Answers:
    3
    Trophy Points:
    165
    #13
    Sure. Stop stealing other peoples content. Simple :)
     
    GORF, May 4, 2011 IP
  14. nokia3310

    nokia3310 Peon

    Messages:
    191
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #14
    thats actually not the case...so your assumption is wrong.
     
    nokia3310, May 4, 2011 IP