Please review this file

Discussion in 'robots.txt' started by doonn, Feb 2, 2012.

  1. #1
    Hey there..
    one of my client's website is been active for more than 10 years now, but still doing very bad in terms of SEO. Even of you type its name in google it wont appear. But website is not yet blacklisted.

    I think its the robots.txt file. If you guys can review it and tell me if its ok or should I make any changes to make it better.

    
    User-agent: trovitBot
    Disallow: / 
    User-agent: * 
    Disallow: /rgal.php 
    Disallow: /mlsphoto.php 
    Disallow: /blog/feed/ 
    Disallow: /syndicated/ 
    Disallow: /scripts/ 
    Disallow: /styles/ 
    Disallow: /*io_printer=1 
    Disallow: /*io_section=photo_gallery 
    Disallow: /*io_section=preview 
    Disallow: /*io_presentation=1 
    Disallow: /listing_nav_pictures/ 
    Disallow: /_piwik/ 
    
    Sitemap: http://www.domain.ca/__sitemap_index.php
    Code (markup):
    Please help
     
    doonn, Feb 2, 2012 IP
  2. GoldSEO

    GoldSEO Member

    Messages:
    280
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    33
    #2
    No way the site has been active 10 years and isn't indexed. That isn't the robots fault. And even if it is, how could THAT be the enduring factor in the site's failure for 10 years? google on creating a brand new robots, modify your haccess accordingly, add a sitemap, index and send spiders to crawl at the frequency you update content... And tell us the real reason the site isn't up after 10 years, because now I'm interested
     
    GoldSEO, Feb 2, 2012 IP
  3. quickey

    quickey Peon

    Messages:
    84
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    The web may have hit google google index or even exposed to dance, normally 10 years is a very good in seo
     
    quickey, Feb 2, 2012 IP
  4. doonn

    doonn Active Member

    Messages:
    347
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    60
    #4
    I just got this project. After I analyzed the website i realized that Title, keyword, description was irrelevant to the content, secondly there was no text content it was all images. She only had two blog entries other than Real estate listing.
     
    doonn, Feb 2, 2012 IP
  5. tiffanywilliams12i2

    tiffanywilliams12i2 Peon

    Messages:
    164
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    looks alright to me but depends what you want done
     
    tiffanywilliams12i2, Apr 10, 2012 IP
  6. Knocks

    Knocks Well-Known Member

    Messages:
    85
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    100
    #6
    It's hard to know what you're trying to disallow in robots.txt without knowing anything about the site itself!
     
    Knocks, Apr 20, 2012 IP
  7. sailcorp

    sailcorp Greenhorn

    Messages:
    68
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    8
    #7
    its file avoiding 12 paths and one search engine ! its fine !
     
    sailcorp, Apr 25, 2012 IP
  8. -[z]-

    -[z]- Active Member

    Messages:
    51
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    93
    #8
    ------------Robots.txt------------
    User-agent: *
    Disallow: /rgal.php
    Disallow: /mlsphoto.php
    Disallow: /blog/feed/
    Disallow: /syndicated/
    Disallow: /scripts/
    Disallow: /styles/
    Disallow: /*io_printer=1
    Disallow: /*io_section=photo_gallery
    Disallow: /*io_section=preview
    Disallow: /*io_presentation=1
    Disallow: /listing_nav_pictures/
    Disallow: /_piwik/

    Sitemap: http://www.domain.ca/__sitemap_index.php
    ------------Robots.txt------------

    Thats better.
     
    -[z]-, Nov 7, 2012 IP