1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

How to avoid search engines?

Discussion in 'All Other Search Engines' started by margus555, Jun 14, 2011.

0
  1. #1
    Hello,
    i want to test website in internet and show it to my client, before he pays for it (and gets files), but i dont want that it appear in any search engines before it is in correct aadress. Maybe it hurts future search engine results if website is moved between two addreses....

    What to do?
     
    margus555, Jun 14, 2011 IP
    Mia likes this.
  2. Markwebuk

    Markwebuk Well-Known Member

    Messages:
    1,595
    Likes Received:
    17
    Best Answers:
    2
    Trophy Points:
    113
    #2
    There are many ways for preventing crawling of your website like >>
    You can block search engine bots crawling your website through .htaccess file. You can take help of your webhosting provider in this regards.
    If you need to keep website data confidential then you can also save it in a password-protected directory. Googlebot and other spiders won't be able to access the content.
    You can also use robots.txt which control the access of bots to files and directories on your server.
     
    Markwebuk, Jun 14, 2011 IP
    Mia likes this.
  3. om3

    om3 Member

    Messages:
    180
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    30
    #3
    Very easy, using Google Webmaster tool you can easy prevent crawling for certain pages or website itself.
     
    om3, Jun 14, 2011 IP
  4. mim24

    mim24 Well-Known Member

    Messages:
    327
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    103
    #4
    ban the search engine for a limited time using robots.txt
     
    mim24, Jun 14, 2011 IP
  5. margus555

    margus555 Member

    Messages:
    5
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    38
    #5
    Thank you all for replies.
    But if i block SE for a short time, doesnt it somehow block that website when it is finally in correct aadress? This short time blocking is not somehow against google rules?
    I just in case ask. :eek:
     
    margus555, Jun 14, 2011 IP
  6. publiser

    publiser Member

    Messages:
    106
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    28
    #6
    use your robots.txt and if you using wordpress. You can blocked in privacy option
     
    publiser, Jun 15, 2011 IP
  7. KoolDesign2

    KoolDesign2 Peon

    Messages:
    64
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #7
    You can block these pages or website through robots.txt or noindex/nofollow tags
     
    KoolDesign2, Jun 15, 2011 IP
  8. Dhamodharan

    Dhamodharan Peon

    Messages:
    44
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #8
    hi,Why you want to avoid search engines? May i know the valid reason for that? I'll help you in this issues
     
    Dhamodharan, Jun 19, 2011 IP
  9. Ilona Andrews

    Ilona Andrews Peon

    Messages:
    295
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #9
    Best way to block search engine crawler use robot.txt
     
    Ilona Andrews, Jun 22, 2011 IP
  10. nicbos

    nicbos Well-Known Member

    Messages:
    160
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    130
    #10
    Quote. Use robots.txt to prevent spidering.
     
    nicbos, Jun 22, 2011 IP
  11. Mia

    Mia R.I.P. STEVE JOBS

    Messages:
    23,694
    Likes Received:
    1,167
    Best Answers:
    0
    Trophy Points:
    440
    #11
    Why not just password protect it. Then no one can crawl it.
     
    Mia, Jun 22, 2011 IP
  12. TechnoBombs

    TechnoBombs Member

    Messages:
    219
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    26
    #12
    How to use .htaccess to dissallow particular bot ? because I think bad bots like Email-crawllers doesn't follow robots.txt file.
     
    TechnoBombs, Jun 22, 2011 IP
  13. nicbos

    nicbos Well-Known Member

    Messages:
    160
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    130
    #13
    I still suggest that robots.txt is the best method and it is easy to apply too.
    Drop a visit here if you get the chance: www.robotstxt.org
     
    nicbos, Jun 22, 2011 IP
  14. varshyl

    varshyl Peon

    Messages:
    220
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #14
    Hahahah, very good issue. No one can leave without search engine for even a single day.
     
    varshyl, Jun 23, 2011 IP
  15. nicbos

    nicbos Well-Known Member

    Messages:
    160
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    130
    #15
    Ah ah sadly true :p
     
    nicbos, Jun 23, 2011 IP
  16. unknownpray

    unknownpray Active Member

    Messages:
    3,831
    Likes Received:
    14
    Best Answers:
    0
    Trophy Points:
    70
    #16
    You can block search engine bots crawling your website through .htaccess file. You can take help of your webhosting provider or using Google Webmaster tool you can easy prevent crawling for certain pages or website.
     
    unknownpray, Jul 4, 2011 IP
  17. MIRENGE

    MIRENGE Peon

    Messages:
    107
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #17
    It is really interesting to hear that you can block the search engine from crawling your site.
     
    MIRENGE, Jul 5, 2011 IP