1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

How to disallow Google crawl link.???

Discussion in 'robots.txt' started by techfreakd, May 18, 2012.

0
Page 1 of 2
  1. #1
    techfreakd, May 18, 2012 IP
  2. sbsbookmark

    sbsbookmark Peon

    Messages:
    33
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    you need to create robots.txt file in your root folder. create the file and post below code into it.


    User-agent: *
    Allow: /
    Disallow: here you need to add your disallow url
     
    sbsbookmark, May 18, 2012 IP
  3. netaddict41

    netaddict41 Well-Known Member

    Messages:
    416
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    155
    Digital Goods:
    1
    #3
    He's right. You should create a robots.txt file. However, you should put

    User-Agent: Googlebot
    Disallow: /folder2/

    for disallowing a folder

    OR

    User-Agent: Googlebot
    Disallow: /private_file.html

    to block a page or

    User-Agent: Googlebot
    Disallow: /

    to block the entire site.

    Save it as robots.txt and put it on your root directory in your cpanel. Hope that helps.
     
    netaddict41, May 18, 2012 IP
  4. ggseo

    ggseo Greenhorn

    Messages:
    76
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    23
    #4
    yeap, block it in robotx.txt,
     
    ggseo, May 18, 2012 IP
  5. DavidTiger

    DavidTiger Greenhorn

    Messages:
    77
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    18
    #5

    Thanks for post really i am searching for this how can i disallow Google to search
     
    DavidTiger, May 19, 2012 IP
  6. valen123

    valen123 Greenhorn

    Messages:
    334
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    23
    #6
    Webmaster tool -> Site configuration -> Crawler access -> Generate robot.txt
     
    valen123, May 20, 2012 IP
  7. Adamcooper

    Adamcooper Peon

    Messages:
    18
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #7
    Hi guys robot.txt is the option for you to stop crawling by Google what you want.
     
    Adamcooper, May 20, 2012 IP
  8. DavidTiger

    DavidTiger Greenhorn

    Messages:
    77
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    18
    #8
    thanks dude for sharing about webmaster tool information. Really i am searching for something like that...
     
    DavidTiger, May 20, 2012 IP
  9. jhardy2008

    jhardy2008 Peon

    Messages:
    1,175
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #9
    robots.txt will help you to do this.
     
    jhardy2008, May 21, 2012 IP
  10. Wesley T

    Wesley T Peon

    Messages:
    48
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #10
    Use your cpanel.

    You should have the option no crawling in it.
     
    Wesley T, May 22, 2012 IP
  11. jamesjalvi

    jamesjalvi Peon

    Messages:
    57
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #11
    Use "Create robot.txt" in Google webmaster account :)
    It have all options for u :)
    Or you can use .htaccess :)
     
    jamesjalvi, May 22, 2012 IP
  12. promowebeveron

    promowebeveron Member

    Messages:
    439
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    48
    #12
    Create robot.txt file and add it your root directory to disallow Google from crawling that particular web page.
     
    promowebeveron, May 22, 2012 IP
  13. netaddict41

    netaddict41 Well-Known Member

    Messages:
    416
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    155
    Digital Goods:
    1
    #13
    Haha did it work?
     
    netaddict41, May 22, 2012 IP
  14. valen123

    valen123 Greenhorn

    Messages:
    334
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    23
    #14
    User-Agent: Googlebot
    Disallow: /folder2/
    for disallowing a folder
     
    valen123, May 22, 2012 IP
  15. MarvinE

    MarvinE Member

    Messages:
    149
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    28
    #15
    Use robot.txt

    Search for no crawling command.
     
    MarvinE, May 22, 2012 IP
  16. rising_sun

    rising_sun Peon

    Messages:
    908
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #16
    rising_sun, May 22, 2012 IP
  17. dudeseo

    dudeseo Well-Known Member

    Messages:
    366
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    118
    #17
    use rorbot.txt from your webmaster tool to solve it.
     
    dudeseo, May 22, 2012 IP
  18. ailinpaul99

    ailinpaul99 Peon

    Messages:
    31
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #18
    hello,
    thank you guys i need help of same topic so thank you very much for this discussion.
     
    ailinpaul99, May 23, 2012 IP
  19. clive2

    clive2 Peon

    Messages:
    343
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #19
    Create robots.txt and include

    User-agent: google Bot
    Disallow: page url or folder

    and then upload this file at root level.
     
    clive2, May 24, 2012 IP
  20. DavidTiger

    DavidTiger Greenhorn

    Messages:
    77
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    18
    #20
    Why you are asking for that their is something wrong in it?
     
    DavidTiger, May 25, 2012 IP
Page 1 of 2