Googlebot seems to be hitting my site like there is no tomorrow but my Main page is the only url to be indexed. Now reading in another post someone suggested to submit each Url of the site with Google and each page will be crawled. 1: Is this not seen as Spamming Google? and 2: Isnt the Sitemap supposed to tell the bot what pages are linked together? I have Google Sitemap setup and the site has been verified but the Stats doesnt show for the site - anyone know anything about this? I appreciate your time!
The site on my sig. minstrel thank you for the information - going to boil the kettle now and have a wee read
Thanks for posting that - it has confirmed a few things for me. I guess I'll have to wait and not waste time stewing over it and for now keep the site fresh and build on good backlinks. Again thanks for the info, most helpful.
Suggestions In your HTML <meta name="robots"content="index,follow" /> put a space between the two attributes. That can confuse agents. Your XHTML is not valid, not well-formed. When did you activate you domain? You domain can be sandboxed for half a year, if it's new.
No, the space isn't needed, but there are certainly things in your <head> section that you don't need or are structured incorrectly: <meta name="refresh" content="60" /> Code (markup): Why is this even there? It doesn't seem to have a point on the page. And it should be <meta http-equiv="refresh" content="60"> if you truly need it. It MAY hinder spidering if the page actually changes with each refresh. And if the page doesn't change, it shouldn't even be there. Not opnly that but you have two of them on the page... [code]<meta name="robots"content="index,follow" /> Code (markup): You also have two of these. Neither is necessary. All you are doing is saying, "Spiders! Pay attention, please! Do what you were already going to do natrually as a matter of course before I interrupted you! Thank you! That is all! As you were!"... <meta name="copyright" content="Copyright 2003. Mucker Group. All Rights Reserved." /> <meta name="author" content="Mucker Group" /> Code (markup): Put this on the page, not in the headers. Waste of space. <meta name="revisit-after" content="7" /> Code (markup): A frequently misunderstood meta tag that in most cases should never be there. If it is even paid attention to, this functions as a limiter. What it says is NOT come back often but DON'T come back often - you're saying, "No point in returning here for at least a week because nothing on this site changes anyway". Delete it. Your sitemap link points to an XML page. This shouldn't be in Google sitemap format (you do that differently). It should point to an HTML page which will contain a list of the most important pages on your site. Make the links on sitemap.html text links for sure spidering. Some of your tags are misplaced or missing, as here: <table width="780" border="0" align="center" cellpadding="0" cellspacing="0"> <!--DWLayoutTable--> <tr> <td height="68" colspan="6" valign="top"><table width="780" border="0" cellpadding="0" cellspacing="0"> <!--DWLayoutTable--> <tr> <td width="717" height="68" valign="top" class="banner"><p><img src="banner.gif" alt="CD Burner Help Online Technical Support" width="338" height="68" /></p></td> <td width="11"> </td> </tr> </table></td> </tr> <tr> <td height="200" colspan="6" valign="top"><table width="728" border="0" cellpadding="0" cellspacing="0"> <!--DWLayoutTable--> <tr> Code (markup): Note the stray </td></tr> after the closing </table>. That is likely going to create problems for interpreting the code that follows. Your page doesn't have to validate for W3C (spiders don't give a damn about that) but it does need to be error free or spiders won't be able to decipher it, even though IE is pretty forgiving. This tool will help simulate what Googlebot will see: http://gritechnologies.com/tools/spider.go?q=www.cd-burner-help.com This looks like a Dreamweaver template. Use the code validator in Dreamweaver to find errors. Try these changes for starters...
Thank you both for replying, I appreciate this. Minstrel you are correct that I am using templates in Dreamweaver - The code of the page is something new to me so I have been burning lots of hours trying to learn it - your tips are extremely helpful. As for the refresh tag there is no reason why that is there, I may have placed it on with one of the tools I use - it will be removed. The robots follow tag must be again from another tool, they will be removed too. Copyright tag will be removed as this is on the page as you suggested. The revisit tag is something I misunderstood and I did play around with the revisit rate, I'll remove it. The sitemap is something new to me and I did have it in html before xml - I'll change this round again. I'll go over the code and try and fix anything out of place. Thanks for the link I'll read over it fully and let you know how it all works out. Thanks very much.