How to avoid showing Affiliate External links via Robots.txt

Discussion in 'Commission Junction' started by renderedpixel, Jan 31, 2008.

  1. #1
    HI,

    I want to avoid the external links that show up in mah site

    http://www.ibuyonlinestore.com

    i have in robots.txt file as under:

    User-agent: *
    Disallow: /astore.amazon.com/onlinestor02d-20
    Disallow: /www.jdoqocy.com/click-2711020

    Will this work? As i had done recently and i have heard that google won't follow the Robots.txt rules but m not confirmed.

    Is there any other method in Robots.txt ??:(

    Help needed
    Suggestions welcome

    renderpixel
     
    renderedpixel, Jan 31, 2008 IP
  2. bigmeep

    bigmeep Peon

    Messages:
    61
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Just cloak your links.
     
    bigmeep, Jan 31, 2008 IP
  3. hanji

    hanji Peon

    Messages:
    612
    Likes Received:
    16
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Yep..cloak is the best way.

    hanji
     
    hanji, Jan 31, 2008 IP
  4. triplex

    triplex Peon

    Messages:
    380
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #4
    what does cloak mean?
     
    triplex, Jan 31, 2008 IP
  5. hanji

    hanji Peon

    Messages:
    612
    Likes Received:
    16
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Basically it means to show target link destination to a page that is internal, but using PHP or mod_rewrite or other techniques, you redirect that request to the final destination (affiliate page). This way all links on your page to be 'inbound' vs. 'outbound'.

    I wrote a post about this a while ago..
    URL Masking (cloaking)

    Hope this helps
    hanji
     
    hanji, Jan 31, 2008 IP
  6. triplex

    triplex Peon

    Messages:
    380
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #6
    niceee!!!i like this

    thanks for the tip
     
    triplex, Jan 31, 2008 IP
  7. bass

    bass Active Member

    Messages:
    738
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    53
    #7
    How to use with Blogger?

    Thanks...
     
    bass, Jan 31, 2008 IP
  8. triplex

    triplex Peon

    Messages:
    380
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #8
    i read your artilce and i like the php version, but dont really know how to figure it out, can you pls explain to me step by step?

    Thanks
     
    triplex, Jan 31, 2008 IP
  9. hanji

    hanji Peon

    Messages:
    612
    Likes Received:
    16
    Best Answers:
    0
    Trophy Points:
    0
    #9
    If you have a link going http://www.jdoqocy.com/click-2711020 (using first post example).. and let's say that is to Dell you would create a new page in your web root somewhere called dell.php.

    In that page, you'd have this:
    <?php
    header("Location:http://www.jdoqocy.com/click-2711020");
    exit();
    ?>
    PHP:
    Now on your blog/store/whatever, instead of showing this link (http://www.jdoqocy.com/click-2711020), you would use the following:

    <a href="dell.php" rel="nofollow" target="_blank">My Dell Offer</a>
    Code (markup):
    This way bots, etc. looking at the source code think that dell.php is part of your site, but actually redirects to CJ's dell offer.

    Make sense?

    hanji
     
    hanji, Jan 31, 2008 IP
  10. hanji

    hanji Peon

    Messages:
    612
    Likes Received:
    16
    Best Answers:
    0
    Trophy Points:
    0
    #10
    Not sure how you would do this with Blogger. I'm assuming you can't upload PHP scripts there. You might be able to do redirects from another domain you have control over? This could be a TOS problem depending on the merchant though, since you'd be redirecting to a domain you have control of.. then redirecting to CJ. I've never done it that way.

    hanji
     
    hanji, Jan 31, 2008 IP
  11. triplex

    triplex Peon

    Messages:
    380
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #11
    i tried your php example, but i think its not what im looking for, i have something like 400 pages with ebay products every page displays 200 items and all have the rover link!Isnt there some code to insert in the php file that when i user goes on the item it will display www.mydomain.com at the bottom instead of rover..... i would like this becuase search engines woulndt see the rover links.

    hope you understand what i mean

    thanks
     
    triplex, Jan 31, 2008 IP
  12. hanji

    hanji Peon

    Messages:
    612
    Likes Received:
    16
    Best Answers:
    0
    Trophy Points:
    0
    #12
    You'll want to research mod_rewrite and/or redirect directive in .htaccess file. You'll need to pass information (info about the rover) to a receiving page or tell the webserver to handle this (mod_rewrite/redirect if it's Apache).

    http://httpd.apache.org/docs/2.0/mod/mod_rewrite.html
    http://httpd.apache.org/docs/2.0/mod/mod_alias.html#redirect

    hanji
     
    hanji, Jan 31, 2008 IP
  13. triplex

    triplex Peon

    Messages:
    380
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #13
    thanks hanjii!! ill look into this
     
    triplex, Jan 31, 2008 IP
  14. Virtual Banker

    Virtual Banker Peon

    Messages:
    240
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #14
    or if you are using PHPbayPro you can use the built in mod-write on the urls and then just disallow auctions.php in the robots
     
    Virtual Banker, Feb 1, 2008 IP