i'm need best robots.txt for wordpress photographers

Discussion in 'robots.txt' started by gedarnet, Nov 18, 2012.

  1. #1
    Hi guys
    I have a blog and WordPress for photographs, and I want the best possible archiving the blog, especially since Google Images indexes are no pictures and this is a file Robots used by


    
    User-agent: *
    
    Disallow: /cgi-bin/ 
    Disallow: /archives/
    Disallow: /wp-admin/
    Disallow: /wp-content/
    Disallow: /wp-includes/
    Disallow: /comment-page
    Disallow: /trackback/
    Disallow: /index.php
    Disallow: /search/
    Disallow: /page/
    Disallow: /feed/
    Disallow: /feed
    Disallow: /tag/
    
    
    User-agent: Googlebot
    
    Disallow: /*?
    Disallow: /*.gz$
    Disallow: /*.js$
    Disallow: /*.inc$
    Disallow: /*.css$
    Disallow: /*.cgi$
    Disallow: /*.wmv$
    Disallow: /*.png$
    Disallow: /*.gif$
    Disallow: /*.jpg$
    Disallow: /*.cgi$
    Disallow: /*.php$
    Disallow: /*.doc$
    Disallow: /*.flv$
    Disallow: /*.swf$  
    
    
    # Google Image
    User-agent: Googlebot-Image
    Disallow: /wp-includes/
    Allow: /wp-content/images/
    
    # Google AdSense
    User-agent: Mediapartners-Google*
    Disallow:
    
    # digg mirror
    User-agent: duggmirror
    Disallow: /
    
    # Alexa
    User-agent: ia_archiver
    Disallow: /
    PHP:
    Please help as soon as possible
     
    gedarnet, Nov 18, 2012 IP
  2. gedarnet

    gedarnet Well-Known Member

    Messages:
    139
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    105
    #2
    any one here for help me PLZ ?
     
    gedarnet, Nov 18, 2012 IP
  3. danish001

    danish001 Well-Known Member

    Messages:
    635
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    103
    #3
    All the things that you have mention in robots.txt is correct need to look into it.
     
    danish001, Nov 18, 2012 IP
  4. gedarnet

    gedarnet Well-Known Member

    Messages:
    139
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    105
    #4
    so! Why are not archived images in Google?
     
    gedarnet, Nov 18, 2012 IP
  5. danish001

    danish001 Well-Known Member

    Messages:
    635
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    103
    #5
    In which format you are using images in your website? Is it jpeg png ect.
     
    danish001, Nov 18, 2012 IP
  6. gedarnet

    gedarnet Well-Known Member

    Messages:
    139
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    105
    #6
    gedarnet, Nov 18, 2012 IP
  7. danish001

    danish001 Well-Known Member

    Messages:
    635
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    103
    #7
    Your home page has get cache please check webmaster of your site is there any error show into it.
     
    danish001, Nov 18, 2012 IP
  8. gedarnet

    gedarnet Well-Known Member

    Messages:
    139
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    105
    #8
    this is my Plugin in this blog:
    W3 Total Cache
    All in One SEO Pack
    Google Images Redirect
    Google XML Sitemaps
    nrelate Most Popular
    PuSHPress
    ShareThis
    SI CAPTCHA Anti-Spam
    WP No Category Base
    Yet Another Related Posts Plugin


    I am very concerned
     
    gedarnet, Nov 18, 2012 IP
  9. Jekwueme

    Jekwueme Greenhorn

    Messages:
    26
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    21
    #9
    it seemed like it was cached on the 20th of November are you still having a problem?
     
    Jekwueme, Nov 28, 2012 IP
  10. gedarnet

    gedarnet Well-Known Member

    Messages:
    139
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    105
    #10
    gedarnet, Dec 6, 2012 IP
  11. gedarnet

    gedarnet Well-Known Member

    Messages:
    139
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    105
    #11
    this is my new robots.txt
    And still the problem persists


    http://photo.elsoar.com/robots.txt

    
    User-agent: googlebot-mobile
    Disallow:
    
    User-agent: MSNBot
    Disallow: 
    
    User-agent: Slurp
    Disallow: 
    
    User-agent: Teoma
    Disallow: 
    
    User-agent: twiceler
    Disallow: 
    
    User-agent: Gigabot
    Disallow: 
    
    User-agent: Scrubby
    Disallow: 
    
    User-agent: Robozilla
    Disallow: 
    
    User-agent: Nutch
    Disallow: 
    
    User-agent: ia_archiver
    Disallow: 
    
    User-agent: baiduspider
    Disallow: 
    
    User-agent: naverbot
    Disallow: 
    
    User-agent: yeti
    Disallow: 
    
    User-agent: yahoo-mmcrawler
    Disallow: 
    
    User-agent: psbot
    Disallow: 
    
    User-agent: asterias
    Disallow: 
    
    User-agent: yahoo-blogs/v3.9
    Disallow: 
    
    User-agent: *
    Disallow: /wp-content/
    Disallow: /wp-content/plugins/
    Disallow: /wp-admin/
    Disallow: /wp-includes/
    Disallow: /wp-
    Disallow: /feed/
    Disallow: /trackback/
    Disallow: /tag/
    
    
    # BEGIN XML-SITEMAP-PLUGIN
    Sitemap: http://photo.elsoar.com/sitemap.xml
    Sitemap: http://photo.elsoar.com/sitemap.xml.gz
    # END XML-SITEMAP-PLUGIN
    PHP:
     
    Last edited: Dec 6, 2012
    gedarnet, Dec 6, 2012 IP
  12. danish001

    danish001 Well-Known Member

    Messages:
    635
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    103
    #12
    danish001, Dec 7, 2012 IP
  13. gedarnet

    gedarnet Well-Known Member

    Messages:
    139
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    105
    #13
    Already added, i repeat site reconsideration of each period, but no new
     
    gedarnet, Dec 7, 2012 IP