Confused about robots.txt

Discussion in 'robots.txt' started by shailendra, Mar 24, 2009.

  1. #1
    Hello friends,

    i am bit confused about robots.txt. if i make an entry in robots file to disallow a paticular web page, i am sure it will not be indexed. but, will it achieve any PR or will it never get a PR?

    Please clear my confusion
     
    shailendra, Mar 24, 2009 IP
  2. MeetHere

    MeetHere Prominent Member

    Messages:
    15,399
    Likes Received:
    994
    Best Answers:
    0
    Trophy Points:
    330
    #2
    yes, it will not get PR
     
    MeetHere, Mar 24, 2009 IP
  3. krishmk

    krishmk Well-Known Member

    Messages:
    1,376
    Likes Received:
    40
    Best Answers:
    0
    Trophy Points:
    185
    #3
    Non-indexed pages will not be considered for ranking in SERPs or for PR assignment.
     
    krishmk, Mar 24, 2009 IP
  4. africlic

    africlic Peon

    Messages:
    11
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    I agree with krishmk, Non-indexed pages will not be considered for ranking in SERPs
     
    africlic, Mar 24, 2009 IP
  5. linkdealer

    linkdealer Active Member

    Messages:
    138
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    90
    #5
    It will never get a pr
     
    linkdealer, Jun 9, 2009 IP
  6. can2i

    can2i Peon

    Messages:
    51
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Are there any online articles on this subject matter
     
    can2i, Jun 9, 2009 IP
  7. angler2009

    angler2009 Peon

    Messages:
    20
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #7
    Hi

    It will pass no link juce or link value and remeber the first sight on the eyes of any bot will be robot.txt
     
    angler2009, Jul 10, 2009 IP
  8. soul_of_god

    soul_of_god Well-Known Member

    Messages:
    1,298
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    130
    #8
    btw why you don't want to index your site via google, every body want that but you don't want :p
     
    soul_of_god, Jul 15, 2009 IP
  9. iglweb

    iglweb Peon

    Messages:
    103
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #9
    Not allowed + no spider = NO PR :(
     
    iglweb, Jul 19, 2009 IP
  10. Jectillplum

    Jectillplum Peon

    Messages:
    587
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #10
    if it's can't indexed then it's not gets PR it's simple logic.
     
    Jectillplum, Jul 20, 2009 IP
  11. link2add

    link2add Peon

    Messages:
    86
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #11
    when a page is not read and index by crawler then how get it PR
     
    link2add, Jul 21, 2009 IP
  12. vertexroll

    vertexroll Peon

    Messages:
    72
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #12
    i have blogger blog qwertyweb.blogspot.com
    i have loads of links indexed but i have some robots.txt problem ,all my links are on google page but ,ie all archieve ,but tags ,ie ,for eg ,DOWNLOADS ,FIREFOX ,such many types r not indexed ,the links for robots.txt ,other all links r :)
     
    vertexroll, Jul 29, 2009 IP
  13. vertexroll

    vertexroll Peon

    Messages:
    72
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #13
    best one is blogger ,u get all pages indexed quickly as blogger is owned by google , ;)
     
    vertexroll, Jul 29, 2009 IP
  14. webgroup

    webgroup Peon

    Messages:
    10
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #14
    no page rank for non indexed files
     
    webgroup, Aug 15, 2009 IP
  15. fabuluousman

    fabuluousman Peon

    Messages:
    45
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #15
    it ok i think to put robot text at your website.Something like about me that you don't want to be indexed.
    So it can control what you want to be index.
    Correct me if i'm wrong.
     
    fabuluousman, Aug 28, 2009 IP
  16. Kevin-Stomping

    Kevin-Stomping Member

    Messages:
    46
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    43
    #16
    Not all spiders follow the robots file though.
     
    Kevin-Stomping, Aug 30, 2009 IP
  17. Aaron111

    Aaron111 Well-Known Member

    Messages:
    4,301
    Likes Received:
    29
    Best Answers:
    0
    Trophy Points:
    185
    #17
    thaNKs everyone I tried it also never got pr .........:(
     
    Aaron111, Sep 2, 2009 IP