Hi, for one of my new sites I need to scrape some content from Myspace profiles my users submit. All of this is working fine theoretically, there's just one flaw... Since my server is based in Germany MySpace auto redirects me to the German version of myspace and scrapes the content in German, which is of course totally useless for my English visitors! Does anyone know how I could tell Myspace to use their English site? Maybe by simulating a myspace cookie or something? I really have no idea.... Thanks for any help!
http://profile.myspace.com/modules/internationallink/pages/internaltionallink.aspx The cookie value it sets is MSCulture with value PreferredCulture=en-US as one of the variables.
Thank you. Could you maybe show me a little code how I would implement this into my script? Would I just set my own cookie with the variables you mentioned or just declare the vars? I'm sorry, but I'm not that experienced with php... Thanks!
It depends how you're using PHP to scrape the content. I recommend you read up on curl (php.net/curl) which has CURLOPT_COOKIE. In any case you need to send the cookie in an HTTP header not just set the variable in PHP.