1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

How to allow google to index folder and block all files in it?

Discussion in 'Google' started by downloadsonline.org, Nov 9, 2010.

  1. #1
    hello,
    I want google to index mysite.com/folder/
    But i dont want any files/folders in it to be indexed.

    For example, I dont want google to index any of the following.
    mysite.com/folder/1.htm
    mysite.com/folder/2.php
    mysite.com/folder/2.html
    mysite.com/folder/somefolder1/
    mysite.com/folder/somefolder2/
    mysite.com/folder/somefolder3/

    how to make google to index only mysite.com/folder/ ?

    =============
    If I use mysite.com/folder/index.php instead of mysite.com/folder/
    and use
    User-agent: *
    Allow:/folder/index.php

    and
    User-agent: *
    Disallow: /folder/*

    This can solve the problem.
    But i dont want to use mysite.com/folder/index.php

    So, is there any other solution ?
    SEMrush
    Thanks.
     
    downloadsonline.org, Nov 9, 2010 IP
    SEMrush
  2. dragonfabregas

    dragonfabregas Member

    Messages:
    22
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    36
    #2
    robots.txt is not so powerful than before.. sometimes, you cant control it... And, the page link juice will disappear... So, you can use a meta tag <META NAME="ROBOTS" CONTENT="NOINDEX, FOLLOW"> for those pages which you don't want goole index..
    Best & Ideal robots.txt:
    User-agent: *
    Disallow:

    Sitemap: http://www.yoursite.com/sitemap.xml

    sorry for my bad english!
     
    dragonfabregas, Nov 9, 2010 IP
  3. bogs

    bogs Active Member

    Messages:
    2,142
    Likes Received:
    16
    Best Answers:
    0
    Trophy Points:
    80
    #3
    that's the best thing that i can also think of.. since you can apply it on just one page..
     
    bogs, Nov 9, 2010 IP
  4. ronenw12

    ronenw12 Peon

    Messages:
    58
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    as written here, you can use the meta tag, you can also use the webmaster tools and you can use the robots,

    anyway, your solution doesn't look good to me, you better put all files in other folder.
     
    ronenw12, Nov 10, 2010 IP