google crawlers

Discussion in 'Google' started by ferreira, Mar 28, 2011.

0
  1. #1
    i just made a new blog and whenever i go on my adsense account it says my site has blocked google crawlers. I added a robots.txt file to my ftp files but its still being blocked. any suggestions?
     
    ferreira, Mar 28, 2011 IP
  2. metaseo

    metaseo Peon

    Messages:
    159
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Did you check your meta robots tags ? Maybe you aren't letting search engines index your website and follow links which is why it could tell you that you blocked Google Crawlers from entering your website.
     
    metaseo, Mar 28, 2011 IP
  3. travisjoking

    travisjoking Peon

    Messages:
    27
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    check your url rewrite setting and apache setting
     
    travisjoking, Mar 28, 2011 IP
  4. ferreira

    ferreira Peon

    Messages:
    223
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #4
    I added a meta robots plugin for wordpress so hopefully that will fix it.
     
    ferreira, Mar 28, 2011 IP
  5. massjo

    massjo Active Member

    Messages:
    1,567
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    78
    #5
    my blog got cache by google on jan 8 , is there any way to get cache again.
     
    massjo, Mar 28, 2011 IP
  6. Ujersy

    Ujersy Peon

    Messages:
    10
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #6
    you can test the robots in google webmaster tool, maybe it can help you solve your problems
     
    Ujersy, Mar 28, 2011 IP
  7. C.Rebecca

    C.Rebecca Active Member

    Messages:
    1,401
    Likes Received:
    11
    Best Answers:
    1
    Trophy Points:
    65
    #7
    C.Rebecca, Apr 4, 2011 IP
  8. unknownpray

    unknownpray Active Member

    Messages:
    3,831
    Likes Received:
    14
    Best Answers:
    0
    Trophy Points:
    70
    #8
    I guess there is something wrong with your robots.txt file.
     
    unknownpray, Apr 5, 2011 IP