robot.txt, sublinks and PR in Google Searches

Discussion in 'Link Development' started by dragondf, Apr 24, 2010.

  1. #1
    Hello Everybody.

    Aftere I read a post talking about SEO Tips I went to my server and see that my website and webstore do not have a content inside robot.txt file.

    SO, NOW I HAVE ONE PROBLEM: start to create one good robot.txt file.

    ---

    I am not understanding why my website is each day with a better Alexa rank, but my Google PR is the same: 0

    People say that PR in Google has more about links inside other websites (where your link is) than about how many people are going to see your website (what Alexa does).

    --

    Sublinks:

    When you go to Google and digit "AMAZON" (for example) you see something like this:


    Amazon.com: Online Shopping for Electronics, Apparel, Computers ...

    Online shopping from the earth's biggest selection of books, magazines, music, DVDs, videos, electronics, computers, software, apparel & accessories, shoes, ...

    Books
    Music
    Movies & TV
    Shop All Departments


    ----

    So, you can see a PRINCIPAL LINK and SUBLINKS (Books, Music, Movies & TV...).

    My doubt is:

    The "robot.txt" file is where Google goes to create a sublink in the seach about Amazon or another website?


    How can I improve sublinks in Google?

    I can see a lot of litle webstores with this same sublinks (and they are not Amazon).



    Thanks!
     
    dragondf, Apr 24, 2010 IP
  2. uktopwebsites

    uktopwebsites Guest

    Messages:
    86
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #2
    quite interesting question , anyone can answer ?
     
    uktopwebsites, Apr 24, 2010 IP
  3. bangalore84

    bangalore84 Peon

    Messages:
    29
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    They are called sitelinks and have nothing to do with robots.txt. Google generates them automatically. I suppose that there is no way to influence this.
    You can read more about sitelinks on here: google.com/support/webmasters/bin/answer.py?hl=en&answer=47334
     
    bangalore84, Apr 24, 2010 IP
  4. snowbird

    snowbird Notable Member

    Messages:
    3,036
    Likes Received:
    395
    Best Answers:
    0
    Trophy Points:
    290
    #4
    I wrote a little bit about my observations of Google Sitelinks some time ago. The site structure info in the article still applies. You can read the info I wrote at the link below.

    http://www.vmoptions.com/articles/article-3.html

    It appears that pages which are frequently linked to by others have the best chance of appearing as Sitelinks.
     
    snowbird, Apr 24, 2010 IP
  5. zeekstern

    zeekstern Active Member

    Messages:
    872
    Likes Received:
    20
    Best Answers:
    0
    Trophy Points:
    60
    #5
    Technically, you do not have to have a robots.txt file. The robots.txt file tells the bots what pages to look at and which ones you don't want the bots to look at. By default, the bots will look at all of your pages on your site. If you have pages that you don't want the bots to see, then you should consider using the robots.txt file.
     
    zeekstern, Apr 24, 2010 IP
  6. dragondf

    dragondf Peon

    Messages:
    171
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #6

    Hello SnowBird,

    I am reading your article at this moment.



    Hello zeekstern,

    What do you think about SITEMAP.XML file in this process?
     
    dragondf, Apr 24, 2010 IP
  7. zeekstern

    zeekstern Active Member

    Messages:
    872
    Likes Received:
    20
    Best Answers:
    0
    Trophy Points:
    60
    #7
    Without a doubt, build a sitemap.
     
    zeekstern, Apr 24, 2010 IP
  8. dragondf

    dragondf Peon

    Messages:
    171
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #8
    I did it.

    Now I want Google see it...eheheheheh.

    But, sure.. it can be better in a near future.

    :)

    Tks, again!
     
    dragondf, Apr 24, 2010 IP
  9. blogconnector

    blogconnector Peon

    Messages:
    54
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #9
    That's right, generate a sitemap and make sure google read it by using the Google's Webmaster Tools.
     
    blogconnector, Apr 24, 2010 IP
  10. sadeeqbao

    sadeeqbao Peon

    Messages:
    102
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #10
    Thanks, good informative link.
     
    sadeeqbao, Apr 25, 2010 IP