After 6 days of having my site up google finally dropped by and index my front page, although not in the top results for any keywords. Usually how long after it visits "/" does googlebot come back and crawl the whole site. Everything is top level like domain.com/page1.html and /page2.html etc. I have minimal linkage for now. Just got acceptance into a few directories and backlinks from this forum, but not much else... Any clue how long I might have to wait?
Really depends on the backlinks to the URL. The higher PR the faster the spidering. Maybe one of the few benefits of PR?
Hi hdpt00, Recently I launched a new website and Google indexed its index page and I could see it on the main google.com after 2 days. The site has about 30 inner pages, which are linked direclty from the index page and I noticed those pages were indexed after about a week. I must say this site has just 1 PR5 and 1 PR3 link pointing to it. It is pretty known that sites from PR5+ get spidered and reindexed very often, almost daily. So my suggestion is to get 1-2 PR5+ links pointing to your site and Google will index it much faster and you'll also get it spidered much often.
Your navigation structure is crucial to how quickly your site gets spidered initially. (at least that is my experience) A couple of links is really all you need to get googlebot digging. Make sure you have a link to a site map, and use the words 'site map' as the anchor, daft maybe but again I find it really helps, also if that link is the first link that the bot will find in the code. Little things maybe, but I have found that every little bit helps initially.
I've noticed that my web site was indexed rather quickly initially, but I am having a difficult time getting google to recognize new content that I am adding. I've added a "noarchive" meta tag and that has helped to keep google from caching the page and (hopefully) the new more relevant content will be indexed quicker.