New hardly built site got indexed on Google and MSN without trying, how? Is this bad?

Discussion in 'Google' started by sam8787, Dec 22, 2010.

  1. #1
    Hey guys, I'm aware that it's a smarter option not to get your site indexed until it has at least a few pages with all the links working fine. Well I've been working on a new site and I have made sure not to put my website address anywhere online so that search engine spiders would not find them. The site's pretty unusable at the moment, it has no working links and its still got a long way to go.

    My only guess is that the search engines found it through a site with a history of domain names bought?

    But my main worry is if my site is going to suffer long-term from being indexed and no proper links for the next month?
     
    sam8787, Dec 22, 2010 IP
  2. DoDo Me

    DoDo Me Peon

    Messages:
    2,257
    Likes Received:
    27
    Best Answers:
    0
    Trophy Points:
    0
    #2
    use robots.txt block the whole site even no page there yet. I always do this, and start build links with robots.exe disallow:/ long before site is ready.

    Once site ready, remove the disallow:/ and google index all pages almost instantly
     
    DoDo Me, Dec 22, 2010 IP
  3. Excel 8

    Excel 8 Guest

    Messages:
    1,231
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #3
    I think not, its a good luck making thing easy for you.
     
    Excel 8, Dec 22, 2010 IP
  4. sam8787

    sam8787 Peon

    Messages:
    28
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Thanks I've put in a robots.txt file now
     
    sam8787, Dec 22, 2010 IP
  5. longcall911

    longcall911 Peon

    Messages:
    1,672
    Likes Received:
    87
    Best Answers:
    0
    Trophy Points:
    0
    #5
    I agree with DoDo Me. Use robots.txt disallow all during construction.

    I do not think it will hurt you if you correct the issue now.

    If you plan to build mulitple sites, it is good to have a domain just for development purposes. That domain never gets indexed.
     
    longcall911, Dec 22, 2010 IP
  6. Sxperm

    Sxperm Notable Member

    Messages:
    4,386
    Likes Received:
    142
    Best Answers:
    0
    Trophy Points:
    225
    #6
    Your website can be found via many domain alert websites. They have names appeared upon domain registration. You can prevent search engine bots from crawl and index by using robots.txt as DoDo Me suggested.
     
    Sxperm, Dec 22, 2010 IP
  7. WishBone

    WishBone Peon

    Messages:
    2,566
    Likes Received:
    15
    Best Answers:
    0
    Trophy Points:
    0
    #7
    Another option is to put <meta name="ROBOTS" content="NOINDEX,NOFOLLOW"> on the header part of any page you don't want to get indexed at the moment. Just edit it into "index,follow" if they are ready..
     
    WishBone, Dec 22, 2010 IP
  8. kinah

    kinah Guest

    Messages:
    64
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #8
    You can prevent search engine bots from crawl and index by using robots.txt as DoDo Me suggested.
     
    kinah, Dec 22, 2010 IP
  9. getbestproduct

    getbestproduct Peon

    Messages:
    140
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #9
    Its a good way, thanks.
     
    getbestproduct, Dec 22, 2010 IP
  10. StoneWilson

    StoneWilson Peon

    Messages:
    820
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #10
    robots.txt is a good way, but if you are a newbie, prepare the basic contents well, that will be much better.
     
    StoneWilson, Dec 23, 2010 IP
  11. angilina

    angilina Notable Member

    Messages:
    7,824
    Likes Received:
    186
    Best Answers:
    0
    Trophy Points:
    260
    #11
    I think the robots.txt file is the better option :)

    The noindex meta tag is used to not Indexing, where robots.txt will stop the crawling of search bots: for unfinished sites, the best option is to stop crawling of all SE bots:

    Also, one needs to put this meta tag in all pages of a site in order to not the indexing:
     
    angilina, Dec 23, 2010 IP
  12. paidforumposters

    paidforumposters Peon

    Messages:
    146
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #12
    Its no use preventing google from indexing ur site. The longer the site is indexed the better it is for you and once your site is ready google is surely going to update ur site again so no issues at all.

    Nevertheless robots.txt is a better option as stated above.
     
    paidforumposters, Dec 23, 2010 IP