WTB: Script That Crawls A Website...

Discussion in 'Programming' started by mmelen, Nov 5, 2008.

  1. #1
    Hello,

    I need a script that crawls through a website and extracts certain information. For example, scan through DigitalPoint and find all usernames that have an "x" in them. That's obviously not the task, but something like it. If you think you can do it, please PM me and I will give you the actual specifications that I am looking for. Thank you!
     
    mmelen, Nov 5, 2008 IP
  2. NetworkTown.Net

    NetworkTown.Net Well-Known Member

    Messages:
    2,022
    Likes Received:
    28
    Best Answers:
    0
    Trophy Points:
    165
    As Seller:
    100% - 0
    As Buyer:
    100% - 0
    #2
    PM me more detail on what you want done and we'll discuss it from there. 3 Years php/mysql coding experience with good itrader you can trust me to take care of your project. ;)
     
    NetworkTown.Net, Nov 5, 2008 IP
  3. mmelen

    mmelen Well-Known Member

    Messages:
    1,526
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    105
    As Seller:
    100% - 0
    As Buyer:
    100% - 0
    #3
    NetworkTown, I'm not sure if this would be done in PHP or not.
     
    mmelen, Nov 5, 2008 IP
  4. firmaterra

    firmaterra Peon

    Messages:
    756
    Likes Received:
    16
    Best Answers:
    0
    Trophy Points:
    0
    As Seller:
    100% - 0
    As Buyer:
    100% - 0
    #4
    I can do this in JAVA. Sent you PM.
     
    firmaterra, Nov 5, 2008 IP
  5. mmelen

    mmelen Well-Known Member

    Messages:
    1,526
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    105
    As Seller:
    100% - 0
    As Buyer:
    100% - 0
    #5
    This would probably work best in JAVA, or maybe even some Macro script could work. I PM'ed you.
     
    mmelen, Nov 6, 2008 IP
  6. seokochin

    seokochin Banned

    Messages:
    298
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    As Seller:
    100% - 0
    As Buyer:
    100% - 0
    #6
    This can be done with PHP using curl and RegExp.
     
    seokochin, Nov 6, 2008 IP
  7. mmelen

    mmelen Well-Known Member

    Messages:
    1,526
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    105
    As Seller:
    100% - 0
    As Buyer:
    100% - 0
    #7
    seokochin, maybe... but i'm really looking for this to be done one time and it doesn't have to be web-based, which should make it easier.
     
    mmelen, Nov 6, 2008 IP