Hey guys I a am a newbie to internet marketing, seeking your precious wisdom. How can I know if google has crawled my page. I did a lot of reading on this and read the forums, but cant seem to get an answer for this question . The postings say crawled, but the replies from users keep refering to indexing, and I believe that is different from crawling..(correct me if i am wrong on this please...) so if anyone can tell me how I can know if google crawled my page...many thanks to you!
Hey RazorSoft, and welcome to Internet Marketing There's a really easy way of finding out whether your site's being crawled or not. Simple head over to Google Webmasters and submit your site + the script they provided and it will eventually start crawling + indexing your site. Once it's been crawled, Google Webmaster Dashboard will tell you what time it was crawled, whether it was successfully able to crawl and also any errors it picked up along the way. Hope that helps! Regards M3rC
Wow guys, thank you for the hasty response. M3rC, I submitted to google using the google webmaster (had to create a gmail account first), verified site...did the file upload. and now I cant firgure out where I would look for the crawled information. Australianfranchises talking a littel too advanced for me lol.. but i do appreciate the effort greatly. xml sitemap (is that what simply refered to as a sitemap). Adding robot.txt, where do i add that.? Looking forward to getting confused..*wink*
Just sign up for a google webmaster tools account. Google will tell you exactly what you are asking. don't submit your url and have it on a waiting list for 3 months. Add the link to your signature here for a fast index.
Hey Razor, You should see the details as soon as you login to your Webmasters account. Here what mine looks like, and the "red box" is what your after;
M3rC you are very detailed and very helpfull. This is what mine looks like, and I am not seeing the "red box". I submitted it about 3 months ago, coudn't remember my account information (created another g-mail account) and sumbitted my site again tonight. You think this will cause google to punish me. Oh boy because of the size of the file it wont allow me include the attachment. I am working on resizing it (using ifranview and searching google for how to)...then i'll repost it.
Ok this is the smallest i can get it without severly effecting quality. I'll keep trying to get the quality better and keep the size to below 97.7kb, but at least you get an idea of what i mean.
I can't see anything yet, you can use imageshack and send the the direct URL (don't post on the thread if it's too big, because people get annoyed) host it at imageshack and post the "direct URL" here in the thread
do you have your website log file analyzed? i think it's the only and stable way to find out whether Google or other search engines crawled your websites or not.
Hmm this is strange cause I can see the crawl results just at the very bottom.. try adding your URL to the Google URL Adder. Allow couple hours for the bot to pick it up, when did you add the Webmaster's code? Also read this. M3rC
It doesn't hurt to add it I didn't suggest to depend on it, but till the crawler gets moving after adding the code to Google Webmaster - there's no harm in adding to that URL adder too. It's free, simple and quick
yea i am not seeing the "red box" - [home page crawl:] you have on yours. I'll read the link you sent me, and follow some of the suggestions there. As for the sitemap suggestion, sounds too important, so I'll definately do some research on google. lindamood1- you said "create Xml.Sitemap and websites sitemap" are those two things completely different or same thing 2 names. Please be patient with me I am a total newbie, but also doing a fair bit of research on my own. M3rC- Site was submitted about 4 hours ago, so i'll wait until the morning and see what changed then. By the way I signed up to imageshack and uploaded my image..but the forum will not allow me to put any URL links as I just became a member. well it's almost 3 am, and I am starting to see doubles, we'll attempt this in the morning. Thanks for all your help guys...and happy holidays.
I am signed up for google webmaster. submitted the site last nite, and i want to know where in google webmaster tools do i look for crawls. I see indexed but crawling i am not seeing it.
how can you know if your website is indexed by google? Just type this: site:www.yourdomain.com in google search.. just be patient, it might takes a few days or weeks if your website is new.