1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Stop Bing from indexing my website

Discussion in 'robots.txt' started by Tony Brar, Apr 22, 2013.

  1. #1
    Hello DP,

    Here is my robots.txt file as of right now:
    User-Agent: *
    Disallow: /
    Code (markup):
    I also include the following on each page of my website as an added precaution.
    Some sites recommend the following snippet, others recommend robots.txt, so I figured I can't fail with both.
    <meta name="robots" content="noindex, nofollow"/>
    HTML:
    Google does not index my page, as I wanted.
    But when I search for my site on Bing (http://www.bing.com/search?q=fortninja.com), the home page comes up as a result.
    How do I stop Bing from indexing my site if I've already put the robots nofollow and noindex in my pages and blocked all pages from indexing in robots.txt?

    Thanks,
    -Tony
     
    Tony Brar, Apr 22, 2013 IP
  2. humtuma

    humtuma Notable Member

    Messages:
    1,225
    Likes Received:
    24
    Best Answers:
    3
    Trophy Points:
    250
    #2
    Bing takes time. You have to wait. Neither bing index the website fast as compare to google and same to remove case also.
     
    humtuma, Apr 22, 2013 IP
  3. Tony Brar

    Tony Brar Active Member

    Messages:
    220
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    75
    #3
    Google took 1-2 weeks to index my site and 1-2 weeks to take it off when I blocked it from indexing.
    It has been more than three months, I blocked my site in 2012.
    Is it possible that Bing is actually taking this long?
    If it is taking this long or is ignoring my block, is there a Bing Webmaster Tools or something that will let me manually remove the site from searches? Google has it.


    Thanks,
    -Tony
     
    Tony Brar, Apr 23, 2013 IP
  4. humtuma

    humtuma Notable Member

    Messages:
    1,225
    Likes Received:
    24
    Best Answers:
    3
    Trophy Points:
    250
    #4
    I am not sure, just block bing and yahoo bot both. May be this will help.
     
    humtuma, Apr 23, 2013 IP
  5. Tony Brar

    Tony Brar Active Member

    Messages:
    220
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    75
    #5
    So block bingbot as a separate User-Agent?
    User-Agent: *
    Disallow: /
    User-Agent: bingbot
    Disallow: /
    Code (markup):
    By the way bingbot is now Yahoo's bot as well: http://en.wikipedia.org/wiki/Yahoo!_Slurp

    -Tony
     
    Tony Brar, Apr 23, 2013 IP
  6. ryan_uk

    ryan_uk Illustrious Member

    Messages:
    3,983
    Likes Received:
    1,022
    Best Answers:
    33
    Trophy Points:
    465
    #6
    Try this, mate:
    http://www.bing.com/toolbox/webmaster/
     
    ryan_uk, May 3, 2013 IP
  7. Tony Brar

    Tony Brar Active Member

    Messages:
    220
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    75
    #7

    Used my microsoft account, it gave me the option to remove a URL or directory from bing searches.
    Unfortunately, it only works for 90 days, then expires. :(
    I'll just renew it then, I guess.
    I'm also changing robots.txt to this:
    User-Agent: *
    Disallow: /
     
    User-Agent: bingbot
    Disallow: /
    Code (markup):
    Hopefully that will help.

    Thanks!
    -Tony
     
    Tony Brar, May 3, 2013 IP
  8. ryan_uk

    ryan_uk Illustrious Member

    Messages:
    3,983
    Likes Received:
    1,022
    Best Answers:
    33
    Trophy Points:
    465
    #8
    Who knows, when it comes to re-index time, Bing might finally realise it shouldn't be indexing your site? Might. You could always try tweeting Duane Forrester about it.
     
    ryan_uk, May 3, 2013 IP
  9. Tony Brar

    Tony Brar Active Member

    Messages:
    220
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    75
    #9
    I'm not very optimistic that Bing will ever stop indexing my site...
    Renewing every 90 days isn't too bad, new task on my checklist.

    -Tony
     
    Tony Brar, May 4, 2013 IP
    ryan_uk likes this.
  10. Tony Brar

    Tony Brar Active Member

    Messages:
    220
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    75
    #10
    Okay, the manual index blocking finally worked and my pages no longer show up in Bing searches!

    Thanks for your help!
    -Tony
     
    Tony Brar, May 5, 2013 IP
  11. Revelations-Decoder

    Revelations-Decoder Well-Known Member

    Messages:
    3,028
    Likes Received:
    152
    Best Answers:
    4
    Trophy Points:
    190
    #11
    Handy to know if you don't want to get found on Bing and have not bought an exact match domain so you can get found on page 1 then... :)
     
    Revelations-Decoder, May 5, 2013 IP