View Full Version : sitemap and indexing by google
gdtechind
Jul 5th 2005, 12:38 am
how long does it takes google to index the links once we submit a sitemap.
i have seen that google sitemaps has accepted the sitemap, but even then there is no page coming in google results
anyone got some idea as to how much time will it take for a site to be indexed by google when we have submitted a sitemap.
thanks
dhaliwal
ian_ok
Jul 5th 2005, 12:52 am
How long is a piece of string.
I have one site which I've submitted sitemap to g, it visits but I'm still in the sandbox. Site is about 6 months old.
Another site, it raided all my database pages after not touching for 6 months, following sitemap submission.
So depends on.........
...lots of things.
Juls
Jul 5th 2005, 1:42 am
gdtechind as far as i have read submitting your sitemap does not get your site indexed any faster than it would have without it.
;-)
but i may be wrong.
gdtechind
Jul 5th 2005, 2:17 am
gdtechind as far as i have read submitting your sitemap does not get your site indexed any faster than it would have without it.
;-)
but i may be wrong.
it definately will speed up the way a website gets indexed. cause the very cause of starting sitemaps seems to be making the crawling easier.
and if you specify the modified date section, you can make googlebot crawl deep and often.
expat
Jul 5th 2005, 3:11 am
SM does not influence indexing cycle. Our observation is this is probably based on content rating, overall positioning and popularity, visits, etc.
If its good enough you get visited daily.
What it does is it helps to shape the crawlers activity - which results in the crawlers having the time to pick up / refresh less popular pages.
All our sites are php / dynamic thus we do not send last modified headers.
Using SM allowed us to communicate to the G crawlers expected change patterns and our internal priority resulting in more specific daily visits and allowing for less popular pages to be indexed in the time aloted to scan.
On one domain for example this resulted in all 4500 pages being indexed (+50%) and updated regularly but using only half the bandwidth required before.
We use the SM to give very precise indications of priority of pages and their anticipated update pattern which is precisely what it is intended for.
This presently works very well.
Expat
KingSEO
Jul 5th 2005, 3:15 am
The best use of google sitemaps in my opinion is to tell google to NOT index pages. Ofcourse it is an advantage to tell google that we have new pages up, but the real benefit is from making sure that google knows which one are important to index faster than others.
I dont need google coming back and back for my old pages that doesnt change, sitemaps gives me the power to let google know that something is happening.
gdtechind
Jul 5th 2005, 7:37 am
now am confused abt why google started sitemaps ??
even people doing SEO worry that google will get info about all their websites and might dump them all together
gdtechind
Jul 5th 2005, 7:38 am
hmm, expat, you are really old person on this forum.
and in 15 months this forum has grown to 7 k + members.
But i must say, its a nice place to be at.
expat
Jul 5th 2005, 8:05 am
hmm, expat, you are really old person on this forum.
and in 15 months this forum has grown to 7 k + members.
I am old.......................
Sitemaps is simply to allow you the webmaster to inform G about how you see your site and what interesting pages it contains that may or may not already be in the index and how often these maybe changed / updated.
We did this and we see that crawling has been "adjusted" which serves us perfectly. It works very well and we use it exactly for the desired purpose indicating a subjective view of importance and update frequency that is "hopefuly" shared by the visitors because than it will be shared by the SE's.
Yes run of the mill SEO's or anyone who thinks they can outsmart G should worry.
I for one sincerly hope all the content "regurgitation pages" will fall off the face. So if a WM indicated a copied page from Wiki or whatnot is important and changes permanently it should be killed including the domain.
Don't get me wrong it's a different story if a page uses existing content but puts this into a different context and surrounds it with other content to generate an informative page that in this form does not yet exists and will apeal to certain users.
Expat
PS Indicating an important page as updating daily when it's more or less static what do you think G does?
PPS Sorry I'm a bit passionate about the Net
toocoolforschool
Jul 5th 2005, 2:43 pm
How long does it take them? Consider me: submitted sitemap 2 weeks ago, still no index. I guess it takes longer than 2 weeks. :)
expat
Jul 5th 2005, 2:46 pm
be patient took 2 weeks on a site visited daily with 3k pages indexed.
Now 4.6k but far less bandwidth.
Expat
ElectronDon
Jul 5th 2005, 5:45 pm
I have been in the sandbox for months now and am going to try the sitemaps beta with Google.
iskandar
Jul 5th 2005, 7:24 pm
Sitemap is almost useless if you don't have robots.txt in your site. Googlebot seems to crawl your site deeper when you have both files. Even after googlebots came to my site aggressively, i am not impressed with hwo long it takes them to index my files.
It takes time. Seem to me sitemap helps, but pls make sure you've got robots.txt first.
wickedwitch
Jul 5th 2005, 9:49 pm
Google sitemaps has helped me a ton getting my pages indexed in google.
gdtechind
Jul 6th 2005, 1:16 am
Sitemap is almost useless if you don't have robots.txt in your site. Googlebot seems to crawl your site deeper when you have both files. Even after googlebots came to my site aggressively, i am not impressed with hwo long it takes them to index my files.
It takes time. Seem to me sitemap helps, but pls make sure you've got robots.txt first.
what will robots.txt do when you already have given them a complete structure of your site pages in xml sitemap
coolguy
Mar 5th 2006, 9:20 am
Status in SM page shows that google has crawled the pages but still sees old pages in google's cache.
softplus
Mar 14th 2006, 1:45 pm
Google Sitemaps will not speed up your initial indexing. All existing rules still apply.
Google Sitemaps will only help Google find your changed / new pages faster, once your site has enough value to get crawled deeply. Remember, you need value to get a URL indexed, the value must come from outside into the site and can be passed around within the site. However, a URL with no links from the inside or outside (but perhaps listed in the Sitemaps file) will have no value by default, BUT if your site as a whole has "enough" value than Google will even crawl + index orphan pages with ZERO links.
Value through links = crawler speed + depth
Sitemaps just gives Google a bit of a clue to find new or missing pages, IF Google is ready to listen to the site anyway.
Sarangan
Mar 18th 2006, 10:18 am
It is really a big problem to understand google`s sitemap system..
My sitemap links was indexed by google after 2 weeks submitted.. I have heart this problem by many other webmasters too.
tradealoan
Mar 22nd 2006, 1:55 pm
i am having a problem with a website http://tradealoan.com. not indexed in last six months. Now i have made the google sitemap. See if helps
domregchief
Mar 22nd 2006, 6:59 pm
I was successful in using google sitemaps to get out of the sandbox. Its a 3 month old site and this week sitemaps started indexing my site, now I have 90+ pages indexed. Of course this site is all unique content or rewritten [ Completely rewritten.. not just at the top and bottom .. ] and that may have helped as indicated..
songchai
Mar 26th 2006, 5:35 am
This folum giving me mow detail on sitemap
pcdoc
Mar 26th 2006, 5:40 am
For the dozens of sites I administer, it only takes a few days for google to visit a new site, once the sitemap has been submitted.
But, complete indexing is much, much longer.
vBulletin® v3.8.4, Copyright ©2000-2009, Jelsoft Enterprises Ltd.