webmaster tool indexed just few pages

Discussion in 'SEO' started by lew1s666, Dec 1, 2014.

  1. #1
    Hi,

    How can I fix this. In my google webmaster tools its indexing just 9 pages out of 37 pages/posts.

    http://www.mcmnwindows.ie/sitemap/


    The website has 8 sitemaps generated by Yoast the SEO plugin http://www.mcmnwindows.ie/sitemap_index.xml

    This article talks about simplifying the management of your sitemaps

    https://support.google.com/webmasters/answer/75712?hl=en
    The website currently 37 Pages/Posts but webmaster tools say 19 submitted and only 9 indexed.

    In Webmaster Tools there are 30 crawl errors most are unimportant
     
    lew1s666, Dec 1, 2014 IP
  2. vishal vadhera

    vishal vadhera Greenhorn

    Messages:
    27
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    21
    #2
    first of all 30 error should be shown in this post so that any help i can provide,,
    after that indexing takes times..
    like a bot come to your site .. it start indexing if some any unknown source code, script, or any flash items or any other thing comes in robot path it will not skipped it will try to index.. and robot come for particular time frame if in particular time frame your website is clean and robot able to crawl , they will index your website ... otherwise they will come later,,, they will come daily or weekly to index your website properly..
    solution to this problem check any unknown script, or flash items or any error in source code aren't there??
    2nd make a cutomize robots.txt file for you website..
     
    vishal vadhera, Dec 1, 2014 IP
  3. lew1s666

    lew1s666 Member

    Messages:
    101
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    30
    #3
    hi this is my robots.txt:

    User-agent: *
    Allow: /wp-content/uploads/
    Allow: /*/20*/wp-*
    Allow: /*/wp-content/online/*
    Disallow: /wp-admin
    Disallow: /wp-includes
    Disallow: /wp-content/plugins
    Disallow: /wp-content/cache
    Disallow: /wp-content/themes
    Disallow: ?wptheme=
    Disallow: /wp-
    Disallow: /clients/
    Disallow: /xmlrpc.php
    Disallow: /cgi-bin/
    Disallow: /trackback
    Disallow: /comments
    Disallow: /feed/
    Disallow: /blackhole/
    Disallow: /category/*/*
    Disallow: /transfer/
    Disallow: /tweets/
    Disallow: /mint/
    Disallow: /*?*
    Disallow: /*?
    Disallow: /*.php$
    Disallow: /*.js$
    Disallow: /*.inc$
    Disallow: /*.css$
    Disallow: /*.gz$
    Disallow: /*.wmv$
    Disallow: /*.cgi$
    Disallow: /*.xhtml$
    User-agent: ia_archiver
    Disallow: /
    User-agent: ia_archiver/1.6
    Disallow: /

    Allow: /wp-content/gallery/

    Sitemap: http://www.mcmnwindows.ie/sitemap.xml

    User-agent: ia_archiver
    Disallow: /

    # Google Image
    User-agent: Googlebot-Image
    Disallow:
    Allow: /*

    # Google AdSense
    User-agent: Mediapartners-Google*
    Disallow:
    Allow: /

    # digg mirror
    User-agent: duggmirror
    Disallow: /



    Its a wordpress website and its really hard to validate with W3 validator. Do you know some good app which show me error in wordpress files ?
     
    lew1s666, Dec 2, 2014 IP
  4. Truncho

    Truncho Member

    Messages:
    29
    Likes Received:
    4
    Best Answers:
    1
    Trophy Points:
    43
    #4
    Google has saved resources to crawl just 9 pages, and during the time, the next of your content will be indexed too, unless you are not blocking it. I find your robots.txt file as too aggressive, so try to optimize it. There might be blocking content in any of the folders you disallowed
     
    Truncho, Dec 2, 2014 IP
  5. lew1s666

    lew1s666 Member

    Messages:
    101
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    30
    #5
    i changed to default wordpress, is it better ?


    Sitemap: http://www.mcmnwindows.ie/sitemap.xml

    User-agent: *
    Disallow: /wp-admin/
    Disallow: /wp-includes/
     
    lew1s666, Dec 2, 2014 IP
  6. Truncho

    Truncho Member

    Messages:
    29
    Likes Received:
    4
    Best Answers:
    1
    Trophy Points:
    43
    #6
    Your sitemap is incomplete. There are way more pages on your site, than the one appearing in the sitemap.xml

    Use another sitemap generator. Best is to use the one from ScreamingFrog. It will also give you additional answers.
     
    Truncho, Dec 2, 2014 IP
  7. lew1s666

    lew1s666 Member

    Messages:
    101
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    30
    #7
    i am using some simple-sitemap plugin for wordpress. do you want me to use screaming frog ?
     
    lew1s666, Dec 2, 2014 IP
  8. Truncho

    Truncho Member

    Messages:
    29
    Likes Received:
    4
    Best Answers:
    1
    Trophy Points:
    43
    #8
    since your wp plugin is creating insufficient xml, go for it, or use another generator.
     
    Truncho, Dec 2, 2014 IP