How to hide a page from google?

Discussion in 'Search Engine Optimization' started by Linking-Service, Apr 18, 2007.

0
Page 2 of 2
  1. Link.ezer.com

    Link.ezer.com Peon

    Messages:
    647
    Likes Received:
    28
    Best Answers:
    0
    Trophy Points:
    0
    #21
    example bot name = GOOGLEBOT

    meta
    <META NAME="GOOGLEBOT" CONTENT="NOINDEX, NOFOLLOW">

    robots.txt
    User-Agent: Googlebot
    Disallow: /dir
     
    Link.ezer.com, Apr 18, 2007 IP
  2. a7a7

    a7a7 Well-Known Member

    Messages:
    359
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    108
    #22
    if meta tag works fine... then its better using it although robots.txt is an standard procedure.

    this is because... anyone can open robots.txt in your root and see which directories you are hiding from google. and most probably, they will know something which you do not want even google to know :)


    btw, here's google's own robots.txt

    http://google.com/robots.txt :D
    (lol, google tells to google not to google some pages on google) :p
     
    a7a7, Apr 18, 2007 IP
  3. Swapw

    Swapw Well-Known Member

    Messages:
    586
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    133
    #23
    Can anyone verify whether the txt file or the meta tag file works? Will the extent of your web content exposure effect G bot at all?

    Or is it completely safe to say that you're good to go once you got it embedded? What are your experiences with it?

    -Swapw
     
    Swapw, Apr 18, 2007 IP
  4. rayn_84

    rayn_84 Banned

    Messages:
    342
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #24
    both of them helps your site get indexed and crawled faster.
     
    rayn_84, Apr 18, 2007 IP
  5. InternetWebsiteDesign

    InternetWebsiteDesign Banned

    Messages:
    204
    Likes Received:
    11
    Best Answers:
    0
    Trophy Points:
    0
    #25
    Just block it in a sitemap :)
     
    InternetWebsiteDesign, Apr 19, 2007 IP
  6. gr8liverpoolfan

    gr8liverpoolfan Notable Member

    Messages:
    6,719
    Likes Received:
    538
    Best Answers:
    0
    Trophy Points:
    285
    #26
    Google might take some time to dload your txt and follow the instructions- but they start following it in a day or two
     
    gr8liverpoolfan, Apr 19, 2007 IP
  7. coolguy27

    coolguy27 Banned

    Messages:
    485
    Likes Received:
    11
    Best Answers:
    0
    Trophy Points:
    0
    #27
    coolguy27, Apr 19, 2007 IP
  8. Swapw

    Swapw Well-Known Member

    Messages:
    586
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    133
    #28
    This is real interesting thread, the next question follows...what would be the reason behind leaving the G out of the search? Doesn't that disrupt your traffic? I really don't see why anyone would want to do that unless they're thinking of doing something shady or?

    -Swapw
     
    Swapw, Apr 27, 2007 IP
  9. Fabian.JH

    Fabian.JH Active Member

    Messages:
    283
    Likes Received:
    21
    Best Answers:
    0
    Trophy Points:
    58
    #29
    Sometimes sellers have download pages for example that they don't want Google to index...
     
    Fabian.JH, Apr 27, 2007 IP
  10. everypcneed

    everypcneed Peon

    Messages:
    238
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #30
    Easy explanation here to ensure spiders do not index the page you are referring to.

    1) Create a text file called robots.txt.
    2) Inside that file place the following lines:
    User-agent: *
    Disallow: /advertise.php
    3) Save the file and upload it to the main directory and test to ensure it is displayed at http://www.directory.linking-service.com/robots.txt
     
    everypcneed, Apr 28, 2007 IP
  11. Directory4

    Directory4 Well-Known Member

    Messages:
    167
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    103
    #31
    Use this

    <meta name="Googlebot" content="noindex,nofollow,nocache,noarchive">
     
    Directory4, Apr 28, 2007 IP
  12. kh7

    kh7 Peon

    Messages:
    2,715
    Likes Received:
    109
    Best Answers:
    0
    Trophy Points:
    0
    #32
    I agree. PR is not dependent on whether or not you anounce selling links.
     
    kh7, Apr 28, 2007 IP
  13. theauctionreporter

    theauctionreporter Peon

    Messages:
    5
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #33
    Can you use these txt files and metatags to protect download pages?

    Helen
     
    theauctionreporter, Apr 28, 2007 IP
Page 2 of 2