My blog was banned yesterday due to robot.txt file

Discussion in 'Guidelines / Compliance' started by ali_ravians, Aug 12, 2007.

  1. RedJeepClub

    RedJeepClub Peon

    Messages:
    8
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #21
    If robots.txt is blocking the google bot, then you need to be able to edit it and change settings in it. If blogger won't allow this you need to contact them or move your blogs.

    The reason you add a robots.txt file to your site, is so you as the site owner can control what the bots visit on your site access. It is use to allow public folder( html files etc.) to be scanned and to block folders you don't want scanned. For example you have a folder full of code and server statics about your site. You would use the google bot to block the folder with the code and stats, but allow it to read the public folder.

    The file format is pretty easy to understand it is basically a directoy and Allow or deny. A quick search will reveal the details.
    Hope this Helps,
    Ian
     
    RedJeepClub, Aug 14, 2007 IP
  2. Adpubster

    Adpubster Peon

    Messages:
    4,017
    Likes Received:
    153
    Best Answers:
    0
    Trophy Points:
    0
    #22
    How do you go about 'using' the google bot?
     
    Adpubster, Aug 14, 2007 IP
  3. ali_ravians

    ali_ravians Active Member

    Messages:
    133
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    75
    #23
    its my robots.txt file
    is it blocking the googlebot
    and what can i do now
     
    ali_ravians, Aug 15, 2007 IP
  4. ali_ravians

    ali_ravians Active Member

    Messages:
    133
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    75
    #24
    this is the error explaination by google
     
    ali_ravians, Aug 15, 2007 IP
  5. godmode

    godmode Well-Known Member

    Messages:
    4,453
    Likes Received:
    156
    Best Answers:
    0
    Trophy Points:
    190
    #25
    First of all, Let me explain everyone how blogger works with robot.txt

    1) blogspot.com domain only has 1 robot.txt, since blogs domains are sub-domains.

    this robot.txt is applied recently, changed by blogger team to reduce tag spam in SE.

    Disallow: /search ----means only search directory is not scanned which contains tags for your posts. Hope that clears this issue.

    this setting is applied across all blogspot blogs including mine.

    The error you are getting in adsense is however strange and you might need to ask them about it. I have a blogspot blog and i just checked there are no such error even thoough i have same robot.txt

    Reps appreciated!
     
    godmode, Aug 15, 2007 IP
  6. ali_ravians

    ali_ravians Active Member

    Messages:
    133
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    75
    #26
    1.how can i ask the adsense team
    whats there email?
    2. do u think that it is not a serious issue because i dont want to get ban by adsense team because i have 3 other urls blocked on adsense
     
    ali_ravians, Aug 15, 2007 IP
  7. Jalpari

    Jalpari Notable Member

    Messages:
    5,640
    Likes Received:
    137
    Best Answers:
    0
    Trophy Points:
    260
    #27
    E-MAIL ADDRESS is:
    or goto http://www.google.com/adsense/contact

    banned for adsense is a hard feeling but if they will not accept u then go for other programs like : text-link-ads.com
     
    Jalpari, Aug 15, 2007 IP
  8. RedJeepClub

    RedJeepClub Peon

    Messages:
    8
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #28
    You are not really using the google bot. It's more like you are telling the (all) bots what to look and what to leave alone.

    For example if you have a party at your house. You tell(allow) guests to enter using the front door, stay in the kitchen, and family room and your back yard. You disallow access to your bedroom, and your messy office.
     
    RedJeepClub, Aug 17, 2007 IP