1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

will this spider?

Discussion in 'Programming' started by schlottke, Apr 15, 2004.

  1. SEMrush
  2. digitalpoint

    digitalpoint Overlord of no one Staff

    Messages:
    38,285
    Likes Received:
    2,600
    Best Answers:
    460
    Trophy Points:
    710
    Digital Goods:
    29
    #2
    No, you are using session IDs in the URLs.

    - Shawn
     
    digitalpoint, Apr 15, 2004 IP
  3. schlottke

    schlottke Peon

    Messages:
    2,185
    Likes Received:
    63
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Im sorry for being such a novice.. since there is no way to just 'turn them off' how would i change this?
     
    schlottke, Apr 15, 2004 IP
  4. rfuess

    rfuess Guest

    Messages:
    22
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    These dont look to be session id's, but rather database id's for different articles. To test this theory: open up a browser and click on one of the articles. Bookmark it. If you can get there after you close down all browser sessions, then it is not a session id.

    They will spider in most spiders. Some don't accept anything with a querystring (index.htm?name=value) that would show up as having a questionmark.

    Many do.

    You are currently redirecting to the same page, http://www.wrestling-connection.com/ez-article/index.php, but with a different article id. Some scripting in the back end will decide what to display.

    The most ideal for the largest scope of spiders is to have it go to the default page in a directory like so: http://www.yoursite.com/ or http://www.yoursite.com/coolarticle1/ which would go to default.htm or index.htm

    This is because they will look at this as the beginning or top page of your site.

    The next best thing is to get it in a page without url encoding. (No question marks, no ampersands, . . . )


    - Robert Fuess
    Spiderweb Logic
     
    rfuess, Jun 11, 2004 IP
  5. ProductivePC

    ProductivePC Peon

    Messages:
    362
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Those pages have a page rank of 1 so they have been spidered. For anyone interested in getting a website with session ID's spidered either use a mod_rewrite command with a unix clone or "ISAPI REWRITE" on a windows box. This will rewrite the URL so that the spiders can spider all of yoru pages.

    Hope it Helps

    Wayne
     
    ProductivePC, Jun 11, 2004 IP
  6. schlottke

    schlottke Peon

    Messages:
    2,185
    Likes Received:
    63
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Seems the pages are being spidered- super.
     
    schlottke, Jun 11, 2004 IP
  7. Owlcroft

    Owlcroft Peon

    Messages:
    645
    Likes Received:
    34
    Best Answers:
    0
    Trophy Points:
    0
    #7
    I have no expertise here, but it seems to me that I can recall closing down, say, an Amazon session, and the whole browser, then going back later and being able to re-open that page with the URL (with session ID) as saved in the clipboard. I'm not swearing that is so, but it seems to me that I so recall it.

    For the test to be fully reliable, would not some length of time, anything from (I'm guessing) 90 minutes to 24 hours, have passed before trying the bookmark?
     
    Owlcroft, Jun 12, 2004 IP
  8. nlopes

    nlopes Guest

    Messages:
    103
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #8
    you should change the IDs from md5 hash to something better. Google may think that those MD5 hashes are Session IDs.

    The better for rankings is: /ez-article/index.php?id=some_description
    -or even better-
    /ez-article/article_title (done using mod_rewrite)
     
    nlopes, Jun 14, 2004 IP
  9. Help Desk

    Help Desk Well-Known Member

    Messages:
    1,365
    Likes Received:
    25
    Best Answers:
    0
    Trophy Points:
    180
    #9
    Is that id that is in the url just an article reference ID?
     
    Help Desk, Jun 14, 2004 IP
  10. nlopes

    nlopes Guest

    Messages:
    103
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #10
    it seems to be!
     
    nlopes, Jun 14, 2004 IP