Very slow indexing

Discussion in 'Search Engine Optimization' started by tomksoft, Dec 3, 2008.

  1. #1
    Hello!
    I have opened a new page few days ago, submitted to places where I usually submit. Google has visited it quite soon, but the problem is that I have millions of pages and with current speed of indexing(about 1 page / 4 minutes), it will take about 90 years to get indexed!
    Any tips how can I speed it up?
     
    tomksoft, Dec 3, 2008 IP
  2. gpixel

    gpixel Peon

    Messages:
    13
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    There are some site's like wikipedia with million pages indexed and I don't think google did this after years of waiting...

    But man, 90 years...LOL...that's a lot of time... I'll check this post over 80 years to ask your grandsons how indexing goes... :)
     
    gpixel, Dec 3, 2008 IP
  3. Raoul20

    Raoul20 Well-Known Member

    Messages:
    960
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    130
    #3
    please keep patience and continue your works.
     
    Raoul20, Dec 3, 2008 IP
  4. HWolfpack6

    HWolfpack6 Banned

    Messages:
    120
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    It's been a week for one of my two sites (the other has been up for 3 days and isn't indexed) w/ about 4 or 5 pages, and it's not on yet :)
     
    HWolfpack6, Dec 3, 2008 IP
  5. vansterdam

    vansterdam Notable Member

    Messages:
    3,145
    Likes Received:
    120
    Best Answers:
    0
    Trophy Points:
    245
    #5
    Indexing speed depends on factors such as how often you add content. If a new site suddenly has millions of pages, it makes sense that these pages don't all get indexed at once. This would make their search results too susceptible to massive amounts of spam. To speed up the process you might want to try adding a bunch of external links to both your homepage and to some internal pages.

    You might just have to be patient and wait it out though. Perhaps as it indexes more of your site and you build some trust, then it might speed up indexing.

    Have you tried submitting a sitemap to Google Webmaster Tools? I believe you can also specify an xml sitemap within the robots.txt file.
     
    vansterdam, Dec 3, 2008 IP
  6. Nosfer

    Nosfer Well-Known Member

    Messages:
    1,799
    Likes Received:
    50
    Best Answers:
    0
    Trophy Points:
    140
    #6
    i don't think you could index over a million pages from a new sites faster than that. you need to be patient, build more backlinks, try to submit it to social bookmarking sites and add fresh content to force the spider to check your website faster.
     
    Nosfer, Dec 3, 2008 IP
  7. HWolfpack6

    HWolfpack6 Banned

    Messages:
    120
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #7
    I haven't added any new content, but I did add an XML sitemap a few days ago. I hope it gets indexed soon.
     
    HWolfpack6, Dec 3, 2008 IP
  8. MoolahRama

    MoolahRama Peon

    Messages:
    25
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #8
    This may be the obvious, but have you submitted a sitemap with an rss feed to the spiders?
     
    MoolahRama, Dec 3, 2008 IP
  9. mini speakers

    mini speakers Banned

    Messages:
    135
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #9
    wait some times for getting indexed.
     
    mini speakers, Dec 3, 2008 IP
  10. HWolfpack6

    HWolfpack6 Banned

    Messages:
    120
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #10
    No, how do I do the rss feed part? I have the sitemap, but it's just a general one.
     
    HWolfpack6, Dec 3, 2008 IP
  11. hanselzen

    hanselzen Well-Known Member

    Messages:
    132
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    133
    #11
    You may try this on http://gsitecrawler.com
     
    hanselzen, Dec 3, 2008 IP
  12. namln

    namln Active Member

    Messages:
    280
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    58
    #12
    millions of pages? To many! My site only 100 posts, and Google do not index entirely!
     
    namln, Dec 3, 2008 IP
  13. saleelm03

    saleelm03 Well-Known Member

    Messages:
    408
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    101
    #13
    Millions of pages, how did you manage to write these much?
     
    saleelm03, Dec 3, 2008 IP
  14. michaelpa

    michaelpa Banned

    Messages:
    76
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    0
    #14
    Millions of page!!!!! amazing.
     
    michaelpa, Dec 3, 2008 IP
  15. YSeo

    YSeo Peon

    Messages:
    533
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #15
    Two tips I was giving here:
    1. submit xml sitemap
    2. build massive backlinks
     
    YSeo, Dec 3, 2008 IP
  16. Bloomtools

    Bloomtools Peon

    Messages:
    1,361
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    0
    #16
    You can submit xml site map to webmaster tool and so bookmarking, bookmarking sites are helps easy to indexing.
     
    Bloomtools, Dec 3, 2008 IP
  17. HWolfpack6

    HWolfpack6 Banned

    Messages:
    120
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #17
    HWolfpack6, Dec 4, 2008 IP
  18. projectfree

    projectfree Peon

    Messages:
    35
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #18
    Hello,

    send me your domain name and sitemap.xml address

    do you also creathe a automatic sitemap.php ???

    I have a site, with over 160 000 pages

    take me two weeks to have on Google arround 21 000 pages

    If you have only 5000 pages it amazing the result you receive from Google

    will need to creathe arround 25 .xml file


    i will try to help you give me 5 days :D
     
    projectfree, Dec 4, 2008 IP
  19. epicso

    epicso Banned

    Messages:
    104
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #19
    If the pages are WORTH indexing it will happen faster, Ive gotten over 1000 pages indexed from 1 visit many times.
     
    epicso, Dec 4, 2008 IP
  20. irnwho

    irnwho Well-Known Member

    Messages:
    171
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    103
    #20
    Well your on a good road a sitemap will do wonders for you and try indexing some pages withing your site not just the main homepage
     
    irnwho, Dec 4, 2008 IP