Thinking of doing a sort of spamming technique...

What do you guys think.

I have a website with some deep categories and want the pages to get indexed. There are over 90000 pages and what I was thinking of doing was to setup a page with links to each of these 90000 pages. Point a few links at this pages so the googlebot visits.

What do you guys think?? What will happen?

 

That's called a 'sitemap'.

 

google will explode

 

Instead of putting all the links at the same page I suggest you organize them a bit. That way it might be useful for your visitors too.

I'm not sure if Google will like 90,000 links on one page. I think limiting it to a few hundred on each page is better.

Why not make a good sitemap to make both Google and your visitors happy?

 

Just look at any big company's sitemap - you dont want to link all of the pages divide them up sensibly.
Try Apple's sitemap. I think it was redone fairly recently.

 

And really be sure to optimize your anchor text.

 

A dynamically built site map would be better I think, so if I remove products or update them, I wont get any deadlinks. The only problem is that the database takes too long to retrieve data sometimes when the category is large. So am also thinking of another technique also which use my search page (search.php), and listing popular searches, for example a link pointing to the page

www.youdomain.com/search.php?keywords=whatever+whatever

and have a dozen of these...

 

Zak,

Is there anyway you could use modrewrite?

If the site is the one in your profile those internal links are really long and complicated.

http://www.azmotors.co.uk/carparts.php?cPath=17523&osCsid=b07796315c7bc8cc8e68267b3ed1c3da

Code (markup):

It might help with speeding up the indexing.

-jay

 

Apparently, the spiders are not given a session id! but google still doesnt follow the categories deep enough, I have tried with static links to the pages from my homepage and it does follow these, like the ones in the footer.

 

There's loads of Sitemap contribs for OsCommerce.

 

I've actually found one this morning thats half decent, the only problem with most was trhe number of products, but this seems to work OK!

 

I'd find a static one. One that runs through the database once and outputs a static sitemap. Then just refresh that every 2 weeks instead of leavig it dynamic and refresh on every page load.

 

Do you know of any for oscommerce? I would rather have that too!

 

I've been busy creating/adding to and promoting our first osCommerce store. I've not done a sitemap as yet (although I have the better SEO urls contribution installed and the dynamic metatags one).

A quick search reveals several sitemap mods:
http://www.oscommerce.com/community?contributions=&search=sitemap

I'll check them out. But if they don't map directly to my seo URLs that I already have mapped via apache's mod_rewrite then I'll write one myself. Shouldn't be too hard at all!


Cheers

Chris

 

The sitemap I have used works with the seo urls mod, so i suppose you can use the same one. I dont see the point in using the seo urls mod because you can prevent spider sessions from the admin, and i can see this with the pages indexed by the serps. The problem I have been having is that my categories are quite deep e.g Brakes -> Mintex -> Ford -> Focus -> Front Brake Pads so googlebot walks away after getting to the first sub categories page.

any way i'll let you know after i've chedked the access log maybe tommorow now!

 

and also, i have used the mod for the title tags, but it's abit wierd for car parts when you names for products such as Alfa 145 1.6 94-96, EBC Brakes, Front Disc

 

and

Then there's your reason for using an SEO urls mod. Perhaps your's works differently. Mine translates products php/parameter links to something more friendly, both to humans and search engines... e.g.

Which is best...

/products/product_info.php?cPath=51&products_id=151

or

/products/hopi-candle-p-147.html

Pages are translated into the actual php urls behind the scenes by mod_rewrite. Google won't know he's spiralling down a category tree.


Cheers

Chris

 

IMAGING HAVIN

/Products/Alfa-145-1.6-94-96-EBC Brakes-Front Disc

I dont think thats gonna help!

 

Fair point. I get you now!

But it will still stop the problem of google getting half way down your category tree, getting bored and going home. Simply because it resembles a flat file system rather than one with any sort of depth.


Cheers

Chris

 

I was going to answer another thread question with a very similar answer this morning.

Thanks for the laugh - great geeks thinks alike?