1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.
  2. Better Analytics for WordPress Get It Free

Webmaster Tools- Crawl errors Restricted by robots.txt ‎(14)‎

Discussion in 'robots.txt' started by pla gilbert, Jan 14, 2012.

  1. #1
    Hi everyone, I am having these problem from crawl errors and I don't know how to fix them. Anyone please help me out. Thank you.

    http://www.theworkersllc.com/index.php?option=com_aicontactsafe&sTask=message&task=deleteUploadedFile&filename=
    http://www.theworkersllc.com/images/brochures/sl_Uni-5_flyer_lores.pdf
    http://www.theworkersllc.com/images/brochures/sl_Ishida_WM-Nano.pdf
    http://www.theworkersllc.com/images/brochures/Hi-Yield 16-5000 Saw.pdf
    http://www.theworkersllc.com/images/brochures/BC_4000Series_hires.pdf
    http://www.theworkersllc.com/index.php?option=com_aicontactsafe&sTask=captcha&task=newCaptcha&pf=
    http://www.theworkersllc.com/images/brochures/sl_Ishida_WM_Nano.pdf
    http://www.theworkersllc.com/images/brochures/TR 1200.pdf
    http://www.theworkersllc.com/plugins/system/plugin_googlemap2/plugin_googlemap2_proxy.php
    http://www.theworkersllc.com/images/brochures/3000 Mixer_Grinder.pdf
    http://www.theworkersllc.com/images/brochures/115922 SuperPattyMachine.pdf
    http://www.theworkersllc.com/images/brochures/sl_Uni5_flyer_lores.pdf
    http://www.theworkersllc.com/images/brochures/sl_Uni7_Series_hi_res.pdf
    http://www.theworkersllc.com/index.php/component/mailto/?tmpl=component&template=beez5&link=1d187aa5f2cd8a4c03cebcdd3abf2dd718ba66c8

    This is my robots.txt

    User-agent: *
    Disallow: /administrator/
    Disallow: /cache/
    Disallow: /components/
    Disallow: /images/
    Disallow: /includes/
    Disallow: /installation/
    Disallow: /language/
    Disallow: /libraries/
    Disallow: /logs/
    Disallow: /media/
    Disallow: /modules/
    Disallow: /plugins/
    Disallow: /templates/
    Disallow: /tmp/
    Disallow: /index.php?option=com_aicontactsafe&sTask=captcha&task=newCaptcha&pf=
    Disallow: /index.php?option=com_aicontactsafe&sTask=message&task=deleteUploadedFile&filename=
    Disallow: /index.php/component/mailto/?tmpl=component&template=beez5&link=1d187aa5f2cd8a4c03cebcdd3abf2dd718ba66c8
    Disallow: /index.php/component/mailto/?tmpl=component&template=beez5&link=d9455af10e479c4260d40161b95fb5913836b38c

    Thank you for every suggestion.
     
    pla gilbert, Jan 14, 2012 IP
  2. umerplz

    umerplz Peon

    Messages:
    42
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    your robots.txt is perfect I think your errors may be remove from after few days from webmaster tool.you can check your robots.txt from robots checker tool
     
    umerplz, Jan 25, 2012 IP
  3. Cristina001

    Cristina001 Peon

    Messages:
    56
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    I think you should remove all the errors manually because it is impossible that with all these errors you get proper business from web traffic as well.
     
    Cristina001, Jan 26, 2012 IP