How to get your entire site crawled?

Google likes to hit the homepage but not the whole site, how do I get the whole site crawled?

 

Get more links to both homepage and deeper pages. And try Google Sitemaps.

 

kk I'll try the sitemap thanks

 

Go for the links.

It can take some time but after a while google should index your site.

 

I wouldn't touch a sitemap at this time. There are too many unknowns IMO.

 

I don't see sitemap hurting any.

But you could do random deep links from the home page to other pages. I did that, it helped a lot.

 

I did the sitemap and I'll see what happens

 

Do tell when ya know. It's testing that will determine the success or failure of using them.

But I'm scared.

 

The best way to get a site crawled, COMPLETELY, in Google is to get backlinks to every content page.

This takes care of hallway pages, because the Googlebot usually goes at least one more level, once it hits the website.

 

hm I guess I'll see if I can make a giant sitemap

 

I made a site map - one of the google xml thingies - for my 30K+ site, at present I've had about 1K pages indexed (in a month).
I'm pretty sure there's some magic trigger level for IBL's that say some thing like xx IBL's to a page = 2 level crawl etc etc.
Damned if I can work out what the triggers are though.
Normally, by the time that I've build 60 IBL's into the homepage, G has indexed at least 1 level down from the homepage. When a site is new, that's when a sitemap really comes in handy. If you can persuade G to do a 2 level crawl, then link the sitemap from the homepage and every page would only be 2 levels from the homepage.
Other than that, patience and deep linking IBL's - that's where The co-op and Link-vault really come into their own. Being able to drive many deep links quickly is a god send when it comes to getting a site indexed.

 

Man I wish there was a decent way to do this. It's easy enough to get indexed but full crawls are tough for me.

 

It's easy to get the index crawled but what are some techniques for getting a whole site crawled?

 

try google sitemaps and avoid dynamic links

 

Yeah I've tried the sitemap now and it's been a few days and nothing so far, we'll see.

 

Just found a nice tool for making site maps:

http://johannesmueller.com/gs/

 

Reveal your secrets!!

 

Get some quality links to the domain, then just wait.. The rest will follow.

It can take up to a few weeks to get indexed by search engines, the more links the quicker the index.

And as devbistro mentioned don't go mad with dynamic urls, use a rewrite module to create more seo friendly urls.

 

Yeah mod_rewrite for the win

 

High pr deep linking. Sitemaps that's just bull. If you ask me.