How to Index Meta Redirection URLs Leading to Affiliate Links?!

Discussion in 'Search Engine Optimization' started by andy.flintoff5, Sep 7, 2011.

  1. #1
    Hello everyone,

    I have a site that has many pages redirecting to my affiliate links, using meta tag redirection... the pages' urls are in this form:

    http://www.mysite.com/productname.html


    1- First Observation:

    In my Google Webmasters Tool, I found out that these pages are not indexed, but instead labelled as: "URL restricted by robots.txt".... although I haven't instructed robots.txt file to restrict them.

    This is my first question: why is it stated that they were restricted by the robots.txt file when I didn't ask the robots.txt to restrict them?


    I've searched around and here is what Google said:

    If a URL redirects to a URL that is blocked by a robots.txt file, the first URL will be reported as being blocked by robots.txt (even if the URL is listed as Allowed in the robots.txt analysis tool).

    That means, they take a look at the final destination url and if it is an affiliate url, which is seo unfriendly, they don't index the first redirection page that took to it.


    1- Second Observation:

    However, I've seen some webmasters get their redirection pages that lead to affiliate links, indexed. The only weird thing I found is that their affiliate links are not the normal ones the networks provide..... they don't have IDs or numbers.... and they endup in .html ...... it is as if they've made a deal with the networks for special custom made affiliate links for them, rather than the default ones. Or maybe simply created the new urls in their .htaccess file and made them redirect to the actual affiliate links.

    Does that have to do with why they are getting indexed?

    Anyone else was able to get their meta redirection pages, that lead to affiliate links, indexed by search engines? Without going through the hassle of creating new seo friendly urls for the aff links.... so then it will be double redirection? I got hundreds of aff links and it would be a lil of a headache to do so.

    P.S. Would adding them to the robots.txt file and instructing search engines to index them, solve the problem without having to create secondary redirections?

    Any inputs appreciated!

    Thanks!

    .
     
    andy.flintoff5, Sep 7, 2011 IP