1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Google Sitemaps

Discussion in 'Google Sitemaps' started by digitalpoint, Jun 2, 2005.

  1. getsum80

    getsum80 Peon

    Messages:
    342
    Likes Received:
    10
    Best Answers:
    0
    Trophy Points:
    0
    #61
    getsum80, Jun 4, 2005 IP
    SEMrush
  2. kalius

    kalius Peon

    Messages:
    599
    Likes Received:
    27
    Best Answers:
    0
    Trophy Points:
    0
    #62
    probably but I recommend that you first remove session ID's.

    Do you do an amazon call for each page or all the data is in a database?
     
    kalius, Jun 4, 2005 IP
  3. ziandra

    ziandra Well-Known Member

    Messages:
    142
    Likes Received:
    11
    Best Answers:
    0
    Trophy Points:
    138
    #63
    I did the simple version, just the sitemap.txt with one URL per line.

    Google hit it in about 2 hrs. Then with 8 hrs every single page in that file was hit.

    I am currently working on a script to automatically generate a sitemap.xml for google and a sitemap.php for everyone else. Seems silly to go to all the hassle of selecting which files you want in the sitemap and which ones you don't for only one purpose.
     
    ziandra, Jun 4, 2005 IP
  4. iMacFlats

    iMacFlats Active Member

    Messages:
    92
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    98
    #64
    Well, interesting...

    Yahoo! Slurp raped my site today. A site I put online a week or two ago, and I ONLY submitted via normal Google submit site form and 24 hours ago I did the sitemap thingy. Interestingly, GoogleBot did check my sitemap this evening again, about 24 hours after my first submission. No Google rapes yet though.
     
    iMacFlats, Jun 4, 2005 IP
  5. lingeriediva

    lingeriediva Peon

    Messages:
    268
    Likes Received:
    25
    Best Answers:
    0
    Trophy Points:
    0
    #65
    Interesting possibility for those of us who use Blogger. It looks like the Atom RSS feed can be submitted...Which solves the update issue.
     
    lingeriediva, Jun 5, 2005 IP
    roadies likes this.
  6. Roze

    Roze Guest

    Messages:
    403
    Likes Received:
    29
    Best Answers:
    0
    Trophy Points:
    0
    #66
    This is great - submitted two simple txt lists, I manually generated all 3,000 forum archive URLs that look like this:

    www.site.com/forums/archives/index.php/t-1.html

    Using MS EXCEL. I cut and pasted from the spreadsheet into Dreamweaver and used find and replace to quickly put it in the right format! It was very quick and easy...They're downloaded, lets see what happens!
     
    Roze, Jun 5, 2005 IP
  7. jlawrence

    jlawrence Peon

    Messages:
    1,368
    Likes Received:
    81
    Best Answers:
    0
    Trophy Points:
    0
    #67
    For those of us with big sites, I'm looking at a few linkchecker type scripts. The idea is to simply have the script spew a list of all url's in your site into a text file from which you can just create the sitemap.

    If anyone knows of a script that can do this 'out of the box' then it could be useful. At the moment, I'm trying to pursuade Gbot to crawl a new 30K page site - it'll be an interesting test for this sitemap stuff. I'd normally expect Gbot to take a good couple of months to crawl the site.
     
    jlawrence, Jun 5, 2005 IP
  8. iconv

    iconv Well-Known Member

    Messages:
    190
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    108
    #68
    Just finished setting up an online interface that will generate a Google xml sitemap from a ls -lR directory listing, handy to create a sitemap from your local file system, and then upload that to your web server. Create Google xml sitemap from directory listing
     
    iconv, Jun 5, 2005 IP
  9. Boston_JM

    Boston_JM Peon

    Messages:
    360
    Likes Received:
    11
    Best Answers:
    0
    Trophy Points:
    0
    #69
    i used that tool but dont see anything besides this

    <?xml version="1.0" encoding="UTF-8"?>
    <urlset xmlns="http://www.google.com/schemas/sitemap/0.84">
    </urlset>
     
    Boston_JM, Jun 5, 2005 IP
  10. runnerunner

    runnerunner Active Member

    Messages:
    1,029
    Likes Received:
    32
    Best Answers:
    0
    Trophy Points:
    90
    #70
    how soon would you say the pages get indexed after being visited by google?
     
    runnerunner, Jun 5, 2005 IP
  11. seoeffect

    seoeffect Peon

    Messages:
    1
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #71
    I also had that error on the script :

    <?xml version="1.0" encoding="UTF-8"?>
    <urlset xmlns="http://www.google.com/schemas/sitemap/0.84">
    </urlset>

    The site I submitted in the end was www.ukmp3.co.uk

    This site had 600 pages until May 2005 when more products were added in, making 1,800 pages. There was also a test shopping area added ( affiliate driven ) which left us with over 50,000 pages.

    We used Xenu to grab all the hyperlinks and then AddrView to extract the urls in to a .txt file ( 16MB ). This was "fed" to Google.

    The file was loaded in to Google after about 2 hours and processed fine.

    Looking at the pages present in Google this has already jumped from 800 to 9,100 so all seems to be working.

    I was wondering what was stopping someone taking a sitemap, filling it full of 404 pages ( which Google wont like ) and submitting it !


    There are many scripts on Hotscripts.com in php for site mapping. best one so far is : http://www.hotscripts.com/Detailed/32948.html and its free. If there was a way of making the site map and creating the xml that would be great.

    Maybe Google should make one if they want webmaster to go this way .....
    :eek:
     
    seoeffect, Jun 6, 2005 IP
  12. passat

    passat Peon

    Messages:
    49
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #72
    hmm...how will it look like? I don't want to manually build the xml file.
     
    passat, Jun 6, 2005 IP
  13. boohlick

    boohlick Banned

    Messages:
    736
    Likes Received:
    22
    Best Answers:
    0
    Trophy Points:
    0
    #73
    I've submitted my site map ... but hey errors occurred..

    :confused: PARSING ERRORS!!!!

    Ive read the errors.. and followed some of it that cause the error..

    But nothing happen
     
    boohlick, Jun 6, 2005 IP
  14. NewComputer

    NewComputer Well-Known Member

    Messages:
    2,021
    Likes Received:
    68
    Best Answers:
    0
    Trophy Points:
    188
    #74
    what is your site map page?
     
    NewComputer, Jun 6, 2005 IP
  15. boohlick

    boohlick Banned

    Messages:
    736
    Likes Received:
    22
    Best Answers:
    0
    Trophy Points:
    0
  16. tresman

    tresman Well-Known Member

    Messages:
    235
    Likes Received:
    20
    Best Answers:
    0
    Trophy Points:
    138
    #76
    boohlick ,

    You have to send and xml file that has to be placed on the root of the domain. You failed on both: its a html sitemap and is not in the root. Also, the name has to be "sitemap", not "site-map".

    Your sitemap has look similar to as it follows:

    
    <?xml version=“1.0” encoding=“UTF-8”?>
    <urlset xmlns=“http://www.google.com/schemas/sitemap/0.84”>
    
      <url>
        <loc>WWW.PUT-YOUR-MAIN-URL-HERE.COM</loc>
        <priority>1.0</priority>
      </url>
    
     <!-- delete this comment: repeat the 3 following lines but changing the url for every url of your site -->
      <url>
        <loc>ANOTHER URL </loc>
      </url>
    
    </urlset>
    
    
    Code (markup):
    Now do manuallly or code a script that does the sitemap for you, but this is how it has to be.

    For the techies reading this: yes, you can specify many other things, change the priority, etc... but this would ok.
     
    tresman, Jun 6, 2005 IP
    tradefor likes this.
  17. Cheater

    Cheater Peon

    Messages:
    54
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #77
    Cheater, Jun 6, 2005 IP
  18. BigPhil

    BigPhil Peon

    Messages:
    219
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    0
    #78
    The google sitemaps really work. Got 236 more pages indexed by google :) :)
     
    BigPhil, Jun 6, 2005 IP
  19. boohlick

    boohlick Banned

    Messages:
    736
    Likes Received:
    22
    Best Answers:
    0
    Trophy Points:
    0
    #79

    Thanks bro!! :)
     
    boohlick, Jun 7, 2005 IP
  20. Liminal

    Liminal Peon

    Messages:
    1,279
    Likes Received:
    63
    Best Answers:
    0
    Trophy Points:
    0
    #80
    hi all,

    sorry if this has been covered before. what benefit does submitting my sitemap xml to google have if i know for a fact taht all of my pages are crawled and are being indexed by google after they are posted?
     
    Liminal, Jun 7, 2005 IP