Website: http://www.turkeyrenting.com I'm at my wit's end trying to get my site fully indexed by Google, so I thought I might find some wise words of guidance here. I'll try to give a summary of the major details here. The index page, LINK, has been indexed for about three weeks now. Its cache seems to be updated daily. I maintain a full sitemap and submit it to Google Sitemaps every week, or when I make a major update. I uploaded a copy to http://www.turkeyrenting.com/config.xml (it's not the exact copy I submit to Google but a slimmed down copy just for demo - the structure is the same and all major pages are on it). Sitemaps returns no errors. I am fully listed in Yahoo and MSN and have been for 2-3 weeks now. What's more, the site performs well for any reasonably targeted search on those engines, typically in the first page of results. Most of the pages use header and footer files (templates). There are two header and footer sets - one used by the index page and the other set used by, eg http://www.turkeyrenting.com/aegean.php. The website was actually partly indexed about 4 weeks ago, and a search for site:turkeyrenting.com returned two pages (one from each set) and a line saying "Other pages were found that were very similar..." and clicking there produced 10 or so more pages. But these disappeared from the index after only a few days, leaving only the index page. The website is fully validated, only half a dozen or so minor warnings which I am working on presently. I don't use a robots file. The pages on the website are mostly php, and some are dynamic but with only one variable. I don't use any SEO. I did a little a few weeks ago but removed it all in a desperate attempt to get listed. It was mainly hidden text, randomly generated. I'm working on building some links at the moment. A basic search for turkeyrenting.com returns several results, but nothing for link:turkeyrenting.com. Well that's all that comes to mind at the moment... Any ideas would be appreciated!
Create one! When I created my first site, I thought it's a waste of time. But I was surprised how deeper bots go when you have one. That's my 2 cents - From Google Information to Webmaster : "[SIZE=-1]Make use of the robots.txt file on your web server. This file tells crawlers which directories can or cannot be crawled. Make sure it's current for your site so that you don't accidentally block the Googlebot crawler. Visit http://www.robotstxt.org/wc/faq.html to learn how to instruct robots when they visit your site[/SIZE]"
How ridiculous lol....Since when does a robot file influences the indexing capability of a search engine? Your site is new i presume, so google is just waiting to find nice links pointing back to you. You homepage is indexed, this means that google knows bout your site. You just need good incoming links now, that's all
Oh yeah, I've checked on your HTML codes. REMOVE all this crap from your pages: <meta name="ROBOTS" content="ALL"> <meta name="ROBOTS" content="INDEX"> <meta name="ROBOTS" content="FOLLOW"> <meta name="REVISIT-AFTER" content="5 days"> <meta http-equiv="expires" content="never"> <meta name="content-language" content="EN"> <meta http-equiv="Pragma" content="no-cache"> <meta name="copyright" content="Copyright (c) 2005 by Aaron Mulvihill and turkeyrenting.com"> <meta http-equiv="ImageToolbar" content="No"> You use <meta name="REVISIT-AFTER" content="5 days"> and expect to get indexed asap? lol
ok, i took your advice and scrapped the META tags. So... now I wait? and iskandar, I had a robots file earlier but nothing was happenning there so I removed it for a while.
The robots txt is an EXCLUSION protocol. Nobody but the owner of the robot can tell a robot what TO do, only what NOT to do. You need links, and if your pages are dynamic they must be delivered quickly or this can slow down spidering.
well not quite "wait". i'm submitting to directories, etc. just another quick question. there are a lot of dynamic links on my site (eg http://www.turkeyrenting.com/go_direct.php?rental_code=93). would these be a problem for google?
If you use only 1 variable in the link then it basically won't but it is recommended that you mod rewrite them