Google Index

Discussion in 'Google Analytics' started by Aditya_, Sep 7, 2010.

  1. #1
    I have a site of 150,000 urls and when i submitted in site map using webmaster tools in txt format breaking in 3 of 50,000 each and all got submitted but total indexed was 5000 only .

    What may be reason for this?
    Will It get updated daily?
    Or What is the remedy?
    Let me know guys
     
    Aditya_, Sep 7, 2010 IP
  2. disuza.jonny

    disuza.jonny Peon

    Messages:
    30
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Break your 3 .xml sitemap into large no.suppose if you have 30 type of product and each product type consist of 100 products.Try to make 30 sitemap for each product category .Your original sitemap will contain list of other sitemap.in this way you can list all your web pages more quickly.
     
    disuza.jonny, Sep 8, 2010 IP
  3. smartamit04

    smartamit04 Peon

    Messages:
    97
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Hi Dear,
    just make more .xml sitemap as disuza.jonny have suggested and submit them in GA, also mention all urls in robots.txt as
    Sitemap: http://www.areal.com/sitemap.xml (here you will use your url)
     
    smartamit04, Sep 8, 2010 IP
  4. Wooh

    Wooh Guest

    Messages:
    28
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    I will also go with smartamit suggetion
     
    Wooh, Sep 10, 2010 IP
  5. Aditya_

    Aditya_ Peon

    Messages:
    12
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Hi Disuza will it works for txt site map also let me know as i have broken down site into sitemap01.txt,sitemap02.txt,sitemap03.txt where i have 50,000 urls of each and i got indexed only 3000,1000,1000 urls in webmaster tools .
     
    Aditya_, Sep 13, 2010 IP
  6. imperialDirectory

    imperialDirectory Peon

    Messages:
    395
    Likes Received:
    8
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Google doesn't index all URLs on your sitemap. Usually pages with unique contents or Google consider them as valuable will be indexed.

    Your sitemap should be fine if you can see your sitemapes' names in Google Webmaster Tool and has indexed numbers beside them.
     
    imperialDirectory, Sep 14, 2010 IP
  7. jamespa

    jamespa Peon

    Messages:
    77
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #7
    hey the URL is not working kindly check...
     
    jamespa, Sep 14, 2010 IP
  8. Poonam.sharma

    Poonam.sharma Peon

    Messages:
    90
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #8
    Yeah url is not working. i thought that it will index it slowly, actually i also have submitted site map. but my 350 only url can index.
    there is 50,000 url can submit in 10MB. so you need to break your site map.
     
    Poonam.sharma, Sep 16, 2010 IP
  9. sonibright

    sonibright Greenhorn

    Messages:
    6
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    11
    #9
    Do one thing....

    as suggeted by others, break up your sitemap and name them like sitemap1.xml, sitemap2.xml, sitemap3.xml and so on.

    create a master sitemap, sitemap.xml and place a link to all other sitemaps into that like we place webpages links to a normal XML site map.

    <urlset>
    <url>link to sitemap1.xml</url>
    <url>link to sitemap2.xml</url>
    <url>link to sitemap3.xml</url>
    </urlset>

    in robots.txt mention the following

    Sitemap: URL of Sitemap.XML



     
    sonibright, Sep 17, 2010 IP
  10. smartamit04

    smartamit04 Peon

    Messages:
    97
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #10
    hi dear,
    i have just given example, in actually url is http://www.areal.ca/sitemap.xml
     
    smartamit04, Oct 2, 2010 IP
  11. james.theron

    james.theron Greenhorn

    Messages:
    75
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    16
    #11
    I agree to every one who believe in creating too many sitemap xml files.

    Apart from all the xml discussions, i have got one suggestion that it's not always possible that any search engine index all the pages there in the site. Search engines also look into the internal linking.

    I mean if you have got good internal linking (from good traffic pages if possible) or pages are easily accesible then indexing chances increases as well indexing process also becomes faster.
     
    james.theron, Oct 4, 2010 IP
  12. Linkadoodle

    Linkadoodle Guest

    Messages:
    51
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #12
    Google doesnt like duplicate content so it probably wont index anywhere near that many pages.
     
    Linkadoodle, Oct 14, 2010 IP
  13. Revasmith

    Revasmith Guest

    Messages:
    69
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #13
    create your sitemap again..you can also create a sitemap online.
     
    Revasmith, Oct 14, 2010 IP
  14. devendragangwar

    devendragangwar Peon

    Messages:
    30
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #14
    Hi Amit,
    my site is very old but 2 page not index in the google i've created separate sitemap for 2 urls but they still not cached,now what i'll do for same
     
    devendragangwar, Oct 14, 2010 IP
  15. devendragangwar

    devendragangwar Peon

    Messages:
    30
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #15
    hello friends,
    2 month ago my site is on top in google by a single keywords but now this is not in 100 and that page also not index by the google now, what's problem there..if anybody know then suggest me.

    thanks
     
    devendragangwar, Oct 14, 2010 IP
  16. gotlivechat

    gotlivechat Member

    Messages:
    516
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    35
    #16
    Is Webmaster Tools reporting any errors or problems? There's a link for errors/problems and often it'll say issues with duplicate content, meta tags, etc.
    Either that, or the bots can't access some of the URLs you have listed.
     
    gotlivechat, Oct 15, 2010 IP
  17. devendragangwar

    devendragangwar Peon

    Messages:
    30
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #17
    Hi friends,

    Read this Google Article, Google's John Mueller wrote this article on 23rd October and confirmed that Google currently has indexing problems:



    Google seems to have indexing problems

    In an online discussion, Google's John Mueller has confirmed that Google currently has indexing problems:

    "This issue should be resolved soon, but it will take a several days for everything to catch up and for these changes to be visible. I'll provide another update after the weekend.

    In the meantime, there's no need to make any changes on your side. Content from your sites will continue to be indexed during this time (though perhaps at the moment not as quickly as before in some cases). [...]

    I've been in contact with the indexing and diagnostics teams since your initial reports -- we are taking your reports seriously and doing what is necessary to resolve this problem as soon as possible[...]

    The issues from this thread, which I have reviewed in detail, are not due to changes in our policies or changes in our algorithms; they is due to a technical issue on our side that will be visibly resolved as soon as possible (it may take up to a few days to be visible for all sites though).

    You do not need to change anything on your side and we will continue to crawl and index your content (perhaps not as quickly at the moment, but we hope that will be resolved for all sites soon)."



    Google adds recent updates, shared by links in search results

    "Google is making search results a little more social. The company's main search results are incorporating real-time results, displaying how many times people have shared news articles and highlighting how many social-network mentions a particular topic has received. [...]

    Next to news stories, meanwhile, there is now a 'shared by' link that displays how many times people on social networks have posted about that story. Click on the link and it will also take you to Realtime Search results about that topic."
     
    devendragangwar, Oct 29, 2010 IP
  18. fee_kyu

    fee_kyu Peon

    Messages:
    35
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #18
    i think now google have other methode to indexing. i dont know why because my index sometimes increase and decrease
     
    fee_kyu, Oct 30, 2010 IP
  19. devendragangwar

    devendragangwar Peon

    Messages:
    30
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #19
    can we use site content as an article submission??
     
    devendragangwar, Nov 11, 2010 IP