Hello Everybody. Aftere I read a post talking about SEO Tips I went to my server and see that my website and webstore do not have a content inside robot.txt file. SO, NOW I HAVE ONE PROBLEM: start to create one good robot.txt file. --- I am not understanding why my website is each day with a better Alexa rank, but my Google PR is the same: 0 People say that PR in Google has more about links inside other websites (where your link is) than about how many people are going to see your website (what Alexa does). -- Sublinks: When you go to Google and digit "AMAZON" (for example) you see something like this: Amazon.com: Online Shopping for Electronics, Apparel, Computers ... Online shopping from the earth's biggest selection of books, magazines, music, DVDs, videos, electronics, computers, software, apparel & accessories, shoes, ... Books Music Movies & TV Shop All Departments ---- So, you can see a PRINCIPAL LINK and SUBLINKS (Books, Music, Movies & TV...). My doubt is: The "robot.txt" file is where Google goes to create a sublink in the seach about Amazon or another website? How can I improve sublinks in Google? I can see a lot of litle webstores with this same sublinks (and they are not Amazon). Thanks!
They are called sitelinks and have nothing to do with robots.txt. Google generates them automatically. I suppose that there is no way to influence this. You can read more about sitelinks on here: google.com/support/webmasters/bin/answer.py?hl=en&answer=47334
I wrote a little bit about my observations of Google Sitelinks some time ago. The site structure info in the article still applies. You can read the info I wrote at the link below. http://www.vmoptions.com/articles/article-3.html It appears that pages which are frequently linked to by others have the best chance of appearing as Sitelinks.
Technically, you do not have to have a robots.txt file. The robots.txt file tells the bots what pages to look at and which ones you don't want the bots to look at. By default, the bots will look at all of your pages on your site. If you have pages that you don't want the bots to see, then you should consider using the robots.txt file.
Hello SnowBird, I am reading your article at this moment. Hello zeekstern, What do you think about SITEMAP.XML file in this process?
I did it. Now I want Google see it...eheheheheh. But, sure.. it can be better in a near future. Tks, again!