A Simple 4 Step Approach To Have Google Crawl Your Site Today Guaranteed!

Discussion in 'Google' started by cybernetik, Apr 25, 2008.

Thread Status:
Not open for further replies.
  1. #1
    Extra, Extra Google Now Gives you feedback. By Creating a Google Sitemap using free online tools you can get Google to crawl your site within 24 Hours. As an Added bonus after Google Crawls your site they give you feedback about any problems they encountered. To take advantage of this amazing service from yahoo just follow these 4 simple steps.

    Step 1 Get a Google Site Map Account

    In order to create a Google Sitemap account just cut and paste the below URL in your browser and follow the simple directions

    https://www.google.com/webmasters/sitemaps/login)

    Step 2 Create Your Site map

    You can create your Sitemap either as an XML file or a TXT file. XML is the PPreferred method since you can give Google more information about your Web Site. You do not need to know XML to create a Google Sitemap. Not with this free web based tool. Simply go to the below web site type in your domain and it will automatically spider your site and create a Google Site Map for you. http://www.sitemapspal.com/

    If You prefer to use a text file simply following the below direction taken directly from the Google Help File (https://www.google.com/webmasters/sitemaps/docs/en/other.html)

    Google accepts simple text files that list URLs. As the text files contain only a list of URLs, Google prefers that you use the Sitemap protocol so you can provide additional information about your URLs. The text file must follow these guidelines:

    # The text file must have one URL per line. The URLs cannot contain embedded new lines.

    # You must fully specify URLs as Google attempts to crawl them exactly as provided.

    # Each text file can contain a maximum of 50,000 URLs. If you site includes more than 50,000 URLs, you can separate the list into multiple text files and submit each one separately.

    # The text file must use UTF-8 encoding. You can specify this when you save the file (for instance, in Notepad, this is listed in the Encoding menu of the Save As dialog box).

    # The text file should contain no information other than the list of URLs.

    # The text file should contain no header or footer information.

    # You can name the text file anything you wish. Google recommends giving the file a .text extension to identify it as a text file (for instance, sitemap.txt).

    # You should upload the text file to the highest-level directory you want search engines to crawl and make sure that you don't list URLs in the text file that are located in a higher-level directory.

    Step 3 Upload your Site Map File To Your Web Page

    Once you have created an XML or TXT Sitemap using the instructions in Step 2 you would just upload it to your web page either by FTP or by using the Cpanel from your Web Host.

    Step 4 Tell Google

    The last step in this process is to tell Google about your Sitemap. You simply Log In to your Google site map account and add the URL of you Site Map. Be sure and check back a few hours later to make sure it uploaded correctly. https://www.google.com/webmasters/sitemaps/login

    Now be sure and repeat the above 4 Steps whenever you change your website

    Bonus Step 5

    After Google has read your Sitemap and crawled your site (usually 12-24 Hours) you will see a verify link next to your Sitemap name. Click the link and Google will instruct you to create a blank file and place it on your Web Page, Once you have done that Google will tell you any problems it encountered crawling your Page

    About The Author:
    Mike Makler has been Marketing Online Since 2001 When he Built an Organization of over 100,000 Members
     
    cybernetik, Apr 25, 2008 IP
  2. astup1didiot

    astup1didiot Notable Member

    Messages:
    5,926
    Likes Received:
    270
    Best Answers:
    0
    Trophy Points:
    280
    #2
    Or just put a link in your DP signature. ;) There is nothing new with this information.
     
    astup1didiot, Apr 25, 2008 IP
  3. marco608

    marco608 Peon

    Messages:
    11
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Get a Google Site Map Account.

    is good idea

    the sitemaps is very Important
     
    marco608, Apr 25, 2008 IP
  4. sweetfunny

    sweetfunny Banned

    Messages:
    5,743
    Likes Received:
    467
    Best Answers:
    0
    Trophy Points:
    0
    #4
    That's because it was originally posted in 2005 and is published on a few thousand sites. Someone posted (spammed) it on one of my forums the other week, probably the OP lol.
     
    sweetfunny, Apr 25, 2008 IP
  5. Gazzerman

    Gazzerman Active Member

    Messages:
    570
    Likes Received:
    16
    Best Answers:
    0
    Trophy Points:
    60
    #5
    Here is something you wont read anywhere! I created a PHP file called sitemap.php and generated all my page names in that and submitted the page. No need for the .txt extension. Mkes life so much easir than using PHP to generate a txt file everytime its updated. Now my sitemap is dynamic, easy to maintain and crawled daily.
     
    Gazzerman, Apr 25, 2008 IP
  6. Jim4767

    Jim4767 Prominent Member

    Messages:
    4,738
    Likes Received:
    766
    Best Answers:
    10
    Trophy Points:
    305
    #6
    Adjust my thinking, please, if I'm missing something. But the OP said that the sitemap will make Google "crawl your site" within 24 hours. My experience is that a newly submitted sitemap.xml will indeed be crawled that same day. But I do not believe that gives any guarantee that Google will therefore go ahead and crawl your whole site, but just the newly submitted sitemap. I wish it were that simple to get a "deep crawl" anytime I wished. Help me out here if I'm missing something.
     
    Jim4767, Apr 25, 2008 IP
    casinouk and Professional Dude like this.
  7. VideoKid

    VideoKid Peon

    Messages:
    101
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #7
    Hmmm. I'll take a "wait and see" approach to this method. But thanks anyway. :)
     
    VideoKid, Apr 25, 2008 IP
  8. astup1didiot

    astup1didiot Notable Member

    Messages:
    5,926
    Likes Received:
    270
    Best Answers:
    0
    Trophy Points:
    280
    #8
    You are correct, the sitemap just gives a "map" to the crawlers so they don't have to find new web pages via crawling your internal links; it doesn't increase the speed or likely hood of your site getting indexed.
     
    astup1didiot, Apr 25, 2008 IP
  9. BWC

    BWC Peon

    Messages:
    67
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    0
    #9
    Jim4767 & ssandeki are correct, a sitemap submitted via the G sitemaps will not speed up indexing, but might in some cases help get indexed pages that would not have otherwise been found by googlebot.

    A must have for large sites, but as far as I am concerned, I use them, right from the start of all of my new sites. Create the site, publish the site, create a sitemap & submit it via the G webmaster console, again thru the new M$ webmaster console, many webmasters add a line the robots text to point to it, instead of submitting thru the consoles, but I like the G sitemap reporting features(currently missing in the M$ console).

    BWC
     
    BWC, Apr 25, 2008 IP
  10. bermuda

    bermuda Peon

    Messages:
    868
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #10
    Many webmasters are using the Google sitemap and many do not and all of them have their own reasons and ideas. Google sitemaps have shown to be helpful but many websites are doing fine without them as well.
     
    bermuda, Apr 26, 2008 IP
  11. mikelaw

    mikelaw Peon

    Messages:
    148
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #11
    I don't think you're missing anything Jim. This is effectively what Google says it does with sitemaps in the Google Webmaster account - Google does what it likes at the rate it likes and does not guarantee to include all, or indeed any, of the URLs in a submitted sitemap.

    A dofollow backlink from an indexed site is enough to make Google begin indexing a site. The frequency at which it then crawls the site is then down to Google's opinion of how important the site might be.
     
    mikelaw, Apr 26, 2008 IP
  12. abraxas

    abraxas Well-Known Member

    Messages:
    1,422
    Likes Received:
    44
    Best Answers:
    1
    Trophy Points:
    125
    #12
    Nothing new at all...
    A single quality link(of course on a recently indexed page) and some decent site/links structure will do the same...
     
    abraxas, Apr 27, 2008 IP
  13. angilina

    angilina Notable Member

    Messages:
    7,824
    Likes Received:
    186
    Best Answers:
    0
    Trophy Points:
    260
    #13
    I think the simplest method is to put your sites URL in your DP signature. Google will crawl within 24 hours :)
     
    angilina, Apr 27, 2008 IP
  14. casinouk

    casinouk Peon

    Messages:
    279
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #14
    Yeah Jim. As Always you are right, i had seen that my sitemap was downloaded in just 15 mins after submitting it in Webmaster tools,
    Though my pages were not indexed for 2 days. after it got indexed. and any forum links works great.
     
    casinouk, Apr 27, 2008 IP
  15. Professional Dude

    Professional Dude Prominent Member

    Messages:
    6,261
    Likes Received:
    430
    Best Answers:
    0
    Trophy Points:
    330
    #15
    Yes. putting link in DP forum signature is the easiest way ;)
     
    Professional Dude, Apr 27, 2008 IP
Thread Status:
Not open for further replies.