Is google robot indexing all content inside site.com/ ?

Discussion in 'Google' started by pokercoach2007, Nov 24, 2009.

  1. #1
    Let's say I have a website site.com and on the front page there are links to the directory Links.

    But also on the same site.com I placed other folders demosite2 demosite3 demosite4 and developing a design for other web projects.

    If there are no links on the front page to those folders demosite2 demosite3 demosite4 will google robot index them? Or do i need to put nofollow tag on each of those demo pages?

    Thank you
     
    pokercoach2007, Nov 24, 2009 IP
  2. rockey.r48

    rockey.r48 Peon

    Messages:
    83
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    If there's no links to those pages anywhere then Google won't index them.
    But if any site that is (or will be) in Google's index is linking to those sites then they will be indexed.
    You should set up a robots.txt file and define that those directories shall not be indexed.
     
    rockey.r48, Nov 24, 2009 IP
  3. bogs

    bogs Active Member

    Messages:
    2,142
    Likes Received:
    16
    Best Answers:
    0
    Trophy Points:
    80
    #3
    if those demo sites can't help your main site then i don't think its necessary to crawl and index it..
     
    bogs, Nov 24, 2009 IP