1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

robots.txt helps to improve your page rank

Discussion in 'robots.txt' started by mikelorentz, Jul 16, 2008.

  1. #1
    Hi, Guys
    i m currently working on an e-commerce website. This website having a complete dedicated directory of "WEBSITES DIRECTORY". That is having large number of outbound links from every page. Through these outbound links the link value of my pages might have been leaked. With the help of robots.txt restricting these pages from crawlling, will my site get better page rank?

    Pls get me some more ideas on it............. Thanks
     
    mikelorentz, Jul 16, 2008 IP
  2. ceweqsakti

    ceweqsakti Banned

    Messages:
    1,192
    Likes Received:
    22
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Is it really robot.txt help improve pr?i didn!t know about it.
    Many outbound link,from what site?
     
    ceweqsakti, Jul 16, 2008 IP
  3. MeetHere

    MeetHere Prominent Member

    Messages:
    15,399
    Likes Received:
    994
    Best Answers:
    0
    Trophy Points:
    330
    #3
    there is no relation with PR and robots.txt ;)
     
    MeetHere, Jul 16, 2008 IP
  4. mikelorentz

    mikelorentz Member

    Messages:
    73
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    43
    #4
    yeah u might be right. but have u ever thought how google come to know about any page or backlink. i m not sure but i relate it with google's crawling. Google may explore new links or page by crawling. if any link which is not been crawled by google that mean google is not aware of that link. and if google is not aware of any link then how google will consider it. Is it possible that link value passes without come into consideration of google.

    My theory may be wrong and even u may laugh on this.. but really i need some help to understand it better....
     
    mikelorentz, Jul 16, 2008 IP
  5. MeetHere

    MeetHere Prominent Member

    Messages:
    15,399
    Likes Received:
    994
    Best Answers:
    0
    Trophy Points:
    330
    #5
    Then who will submit sites in your directory..
    If you restrict this pages, you will probably be saved from being penalized by google for putting links and thus increase PR ;)
     
    MeetHere, Jul 16, 2008 IP
  6. mikelorentz

    mikelorentz Member

    Messages:
    73
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    43
    #6
    That is the different case... lets forget this point
    but tell me, what do u think by restricting crap pages of ur sites will inturn help u to enhance ur page rank? is it valid or not?
     
    mikelorentz, Jul 16, 2008 IP
  7. MeetHere

    MeetHere Prominent Member

    Messages:
    15,399
    Likes Received:
    994
    Best Answers:
    0
    Trophy Points:
    330
    #7
    it will not enhance your pagerank,, it will save from penalizing..

    Pagerank only depends on backlinks - backlinks from PR pages/sites.
     
    MeetHere, Jul 16, 2008 IP
  8. mikelorentz

    mikelorentz Member

    Messages:
    73
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    43
    #8
    yeah its true.. but it may prevent link juice leakage.. dont u think...
     
    mikelorentz, Jul 16, 2008 IP
  9. arowana

    arowana Peon

    Messages:
    30
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #9
    Nope,the robots.txt doesnt help improve,it only tells the spider where not to go/go,lol
     
    arowana, Jul 26, 2008 IP
  10. Joshdube

    Joshdube Well-Known Member

    Messages:
    468
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    110
    #10
    I get what your saying mikelorentz. If google dont crawl pages with lots of out bound links, then they wont, know about them.

    If they dont know about them then they cant act against you. So you can give reciprocals to sites, they will think they have a reciprocal, which they will, but google won know about it.

    So therefore it wont cancel out your inbound, hence increasing your page rank?

    It makes sense to me, I am not sure if it works though.

    Josh
     
    Joshdube, Jul 28, 2008 IP
  11. itisme1760

    itisme1760 Greenhorn

    Messages:
    74
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    23
    #11
    Linking other sites and having other sites link to you will boost your pagerank.
     
    itisme1760, Jul 28, 2008 IP
  12. Mitchelle Johnson

    Mitchelle Johnson Banned

    Messages:
    153
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #12
    It is quite rubbish that robot.txt helps in improving PR of any web page or website... There is no relation between PR and robot.txt. so don't waste time on it..
     
    Mitchelle Johnson, Jul 31, 2008 IP
  13. Mitchelle Johnson

    Mitchelle Johnson Banned

    Messages:
    153
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #13
    Robot.txt only tells search engine crawlers whether any webpage has to be crawled or not. If we restrict SE crawlers to crawl any web page, there is no meaning of increase in pr of that website. when that page is not being indexed, how increase in PR can be expected.....
     
    Mitchelle Johnson, Jul 31, 2008 IP
  14. TheVccMatey

    TheVccMatey Peon

    Messages:
    5,346
    Likes Received:
    208
    Best Answers:
    0
    Trophy Points:
    0
    #14
    robots.txt cuts the search engines from visiting crap on your site.
     
    TheVccMatey, Jul 31, 2008 IP
  15. Chios

    Chios Well-Known Member

    Messages:
    1,740
    Likes Received:
    82
    Best Answers:
    0
    Trophy Points:
    195
    #15
    channel your PR in specific pages by making rest of the links "nofollow"
    that is the technique I would use
     
    Chios, Aug 1, 2008 IP
  16. Yesterday4

    Yesterday4 Banned

    Messages:
    207
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #16
    roobos.txt wont hep u improve page rank. Page rank is something backlink based i gueess
     
    Yesterday4, Aug 5, 2008 IP
  17. udayns

    udayns Peon

    Messages:
    237
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #17
    I thing robots.txt is not helpful in PR the main purpose of this file is only to show crowler to crow. This file content some permission related to site page cowling.
     
    udayns, Aug 11, 2008 IP
  18. seoorganizers

    seoorganizers Peon

    Messages:
    111
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #18
    put the links property as no follow, then u r PR does not links.... and if possible use script for the links....it also saves your PR sharingggggggg
     
    seoorganizers, Aug 13, 2008 IP
  19. catanich

    catanich Peon

    Messages:
    1,921
    Likes Received:
    40
    Best Answers:
    0
    Trophy Points:
    0
    #19
    If you use the robots.txt file to block the indexing to retain the Page Rank, you will also block the pages from being indexed (No SERPS).

    It would be better if you add the NoFollow attribute to the outbound links. This will save the pages and block the PR bleed.
     
    catanich, Aug 21, 2008 IP