1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Robot.txt block my major part

Discussion in 'robots.txt' started by russel_shuvo2, Jun 11, 2012.

0
  1. #1
    Please give me the solution how can i solved this problem. I have no robot text file in the main directory. But if i click the browser and click my site urls http://cricketalways.com/robots.txt then the result comes is


    User-agent: * Disallow: /wp-admin/ Disallow: /wp-includes/ Sitemap: http://cricketalways.com/sitemap.xml.gz

    its my wordpress site. but my forum blocked by robots.txt see this image my webmaster tools sitemap
    sitemp.jpg
    Please give me the solution. will i create robots.txt file and upload it public html?

    If i have to create what format should be. Please expertise comments need.
     
    russel_shuvo2, Jun 11, 2012 IP
  2. mamtak

    mamtak Member

    Messages:
    229
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    28
    #2
    Hi there, it was showing in my google webmaster tool as well. do one thing in google webmaster tool ,their is way of adding the new page(in health folder i think so). why do not add their you pages and they will get index. so do not worry. it will really work..
     
    mamtak, Jun 22, 2012 IP
  3. atxsurf

    atxsurf Peon

    Messages:
    2,394
    Likes Received:
    21
    Best Answers:
    1
    Trophy Points:
    0
    #3
    use "fetch as google bot" feature in webmaster tools for your forum URL. If it is blocked, it will tell you by what rule and what version of your robots.txt googlebot is using while asuming it is not allowed to access it
     
    atxsurf, Jul 3, 2012 IP