404/Crawling Problem

Discussion in 'Search Engine Optimization' started by HighRankingSEO, Jul 14, 2009.

  1. #1
    Hey everyone. I am having a serious issue here...Google says all my pages are 404, but if you go to them, they all work....so, I figured i would try somewhere else just to make sure it wasn't some fluke...I went to seomoz and ran the crawl test...it gave me back 404 for all my pages!! WTF? Any clue what is happening?

    My site is http://www.rehabilitation-center.org and I have some serious issues if this data is correct with Google and SEOmoz......


    soooo....

    1. Is this really happening?
    2. How do I fix it?
     
    HighRankingSEO, Jul 14, 2009 IP
  2. willybfriendly

    willybfriendly Peon

    Messages:
    700
    Likes Received:
    17
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Sounds like a server configuration issue. Have you used Live HTTP Headers with Firefox? If that too confirms a 404 response, then you need to be looking hard at what is happening on your server.
     
    willybfriendly, Jul 14, 2009 IP
  3. Canonical

    Canonical Well-Known Member

    Messages:
    2,223
    Likes Received:
    141
    Best Answers:
    0
    Trophy Points:
    110
    #3
    Well from home I use this tool to emulate a spider and watch interation between the spider and server. It's a pretty cool tool. It's showing your server returning 404s as well.

    I have never seen this before and am quite puzzled... Since your pages are all HTML I'm guessing you are NOT using server-side scripting like PhP (although you could use Mod Rewrite to force Apache to preprocess the .html files through the .php preprocessor as if they had .php extensions).

    Since you're running on Apache, the FIRST thing I would do is check out every .htaccess file on your web server. There is a remote chance that someone (who supports your site or possibly a hacker) has put a RewriteRule in place similar to:

    I found this in the Apache Mod Rewrite docs where they discuss the R (Redirect) flag:

    While I've never tried this, I read the above as:

    If the "R" flag is used with a non-300-399 value, then the substitution is dropped (which means the original URL requested would be rendered which is similar to using '-' as the substitution pattern for a noop) and Mod Rewrite stops evaluating rules in the file. I believe it would exit with a status 404 if the RewriteRule had R=404 since R=301,L causes it to return a 301 and stop evaluating the rules.

    Because EVERY page on your site seems to be doing it, I would pay special attn to the .htaccess file in the root, or if you're running your own VPS also the httpd.conf file.

    If you can't figure it out I'd get in touch w/ your hosting company. If those 404s stay up too long the engines will start de-indexing your pages. You could put up a splash page that returns a 503 Service Unavailable HTTP Status Code to tell the engines the site is down temporarily.

    Let us know what you find. Sounds like an interesting issue.
     
    Canonical, Jul 14, 2009 IP
  4. Rick Glaser

    Rick Glaser Peon

    Messages:
    153
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Thanks Canonical, We are using Joomla and Sh404 sef. Here is our HTACCESS:

    Not sure if you see anything outside the ordinary but it is VERY frustrating to say the least...
     
    Rick Glaser, Jul 14, 2009 IP
  5. HighRankingSEO

    HighRankingSEO Well-Known Member

    Messages:
    423
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    125
    #5
    can someone pelase help...this is insane! This is what comes up in live http headers:

    HTTP/1.x 404 Not Found
    Date: Wed, 15 Jul 2009 01:47:11 GMT
    Server: Apache/2.2.11 (Unix) mod_ssl/2.2.11 OpenSSL/0.9.8i DAV/2 mod_auth_passthrough/2.1 mod_bwlimited/1.4 FrontPage/5.0.2.2635
    X-Powered-By: PHP/5.2.9
    P3P: CP="NOI ADM DEV PSAi COM NAV OUR OTRo STP IND DEM"
    Expires: Mon, 1 Jan 2001 00:00:00 GMT
    Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
    Pragma: no-cache
    Last-Modified: Wed, 15 Jul 2009 01:47:11 GMT
    Keep-Alive: timeout=10, max=22
    Connection: Keep-Alive
    Transfer-Encoding: chunked
    Content-Type: text/html; charset=utf-8



    FOR EVERY SINGLE PAGE!!
     
    HighRankingSEO, Jul 14, 2009 IP
  6. HighRankingSEO

    HighRankingSEO Well-Known Member

    Messages:
    423
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    125
    #6
    This is what comes up total, in case it helps:

    http://www.rehabilitation-center.org/why.html

    GET /why.html HTTP/1.1
    Host: www.rehabilitation-center.org
    User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.9.0.11) Gecko/2009060215 Firefox/3.0.11 GTB5 (.NET CLR 3.5.30729)
    Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
    Accept-Language: en-gb,en;q=0.5
    Accept-Encoding: gzip,deflate
    Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
    Keep-Alive: 300
    Connection: keep-alive
    Referer: http://www.rehabilitation-center.org/drug.html
    Cookie: __utma=168235298.2282302127045297400.1246477028.1247607009.1247619922.40; __utmz=168235298.1247530948.37.13.utmcsr=google|utmccn=(organic)|utmcmd=organic|utmctr=rehabilitation-center.org; 3f57ff60575e6a000aee2fa377d23f5a=d1bd0762bdc62e9f13ec9ca8c9829b52; __utmb=168235298.37.10.1247619922; __utmc=168235298; c007779939810d3c3a53f6d9849e5eaf=bad4679a9956c0e68f440f3ddc4a98d7

    HTTP/1.x 404 Not Found
    Date: Wed, 15 Jul 2009 01:48:58 GMT
    Server: Apache/2.2.11 (Unix) mod_ssl/2.2.11 OpenSSL/0.9.8i DAV/2 mod_auth_passthrough/2.1 mod_bwlimited/1.4 FrontPage/5.0.2.2635
    X-Powered-By: PHP/5.2.9
    P3P: CP="NOI ADM DEV PSAi COM NAV OUR OTRo STP IND DEM"
    Expires: Mon, 1 Jan 2001 00:00:00 GMT
    Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
    Pragma: no-cache
    Last-Modified: Wed, 15 Jul 2009 01:48:58 GMT
    Connection: close
    Transfer-Encoding: chunked
    Content-Type: text/html; charset=utf-8
    ----------------------------------------------------------
    http://toolbarqueries.google.com/se...litation-center.org/why.html&num=100&filter=0

    GET /search?client=navclient-auto&ch=6-1519731256&features=Rank&q=info:www.rehabilitation-center.org/why.html&num=100&filter=0 HTTP/1.1
    Host: toolbarqueries.google.com
    User-Agent: Mozilla/4.0 (compatible; GoogleToolbar 2.0.114-big; Windows XP 5.1)
    Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
    Accept-Language: en-gb,en;q=0.5
    Accept-Encoding: gzip,deflate
    Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
    Keep-Alive: 300
    Connection: keep-alive
    Cookie: NID=24=l-_-eRG4b4Qqe_MZm_NkE-eMRNfXuV-olPDbG_GNiR84wmx0Wi8Y4k1sbQQrjFhgy8wrAupdDLelhq2J1pPXPpTPRfG4c0vLEVxhlsqxDVQw226aIVAjAdniFAGf2pHC; PREF=ID=395f3fb9c0d3f8cd:U=d85624a8d0b0c961:TB=2:TM=1247330651:LM=1247608300:DV=AA:GM=1:S=tZqlLWiFJ7-7-vCt; SID=DQAAAJsAAAB5IB5JziODJ6flUjixHjk-6ESjkIvJv45Pbh7mNhCklkmLfare9kMRZyc92fDHgZcd4hUGuy-uoQEcFusqu-ePfxjQkABJaYitMJR-P8uaxWtknOicYMioGBRc4BqCP5lQLgA3gw3yWE5TtH3dVvZSRCkBb1BhFo5mAtS9KO1B_hQ9ueLxJOdsxFqHCvTDURZa61nS0xphmHMnUWyOs12H; HSID=AoHoul8pi0zK4pgWt; TZ=240

    HTTP/1.x 200 OK
    Cache-Control: private, max-age=0
    Date: Wed, 15 Jul 2009 01:48:59 GMT
    Expires: -1
    Content-Type: text/html; charset=ISO-8859-1
    Server: gws
    Content-Length: 0
    ----------------------------------------------------------
    http://widget.meebo.com/mm.swf?EWrXvaoujW

    GET /mm.swf?EWrXvaoujW HTTP/1.1
    Host: widget.meebo.com
    User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.9.0.11) Gecko/2009060215 Firefox/3.0.11 GTB5 (.NET CLR 3.5.30729)
    Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
    Accept-Language: en-gb,en;q=0.5
    Accept-Encoding: gzip,deflate
    Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
    Keep-Alive: 300
    Connection: keep-alive
    Referer: http://www.rehabilitation-center.org/why.html

    HTTP/1.x 302 Found
    Date: Wed, 15 Jul 2009 01:48:59 GMT
    Server: Apache/2.2.4
    Location: http://widget-cdn.meebo.com/mm.swf?EWrXvaoujW
    Content-Length: 229
    Connection: close
    Content-Type: text/html; charset=iso-8859-1
    ----------------------------------------------------------
    http://www.google-analytics.com/__u...cmd=organic|utmctr=rehabilitation-center.org;

    GET /__utm.gif?utmwv=4.3.1&utmn=726421473&utmhn=www.rehabilitation-center.org&utmcs=UTF-8&utmsr=1366x768&utmsc=32-bit&utmul=en-gb&utmje=1&utmfl=10.0%20r2&utmdt=TLR%20-%20Why%20The%20Last%20Resort%20Panama%20%7C%20Costa%20Rica%20%7C%20Traditional%20Rehabilitation%20Center&utmhid=1267772707&utmr=0&utmp=/why.html&utmac=UA-5169239-8&utmcc=__utma%3D168235298.2282302127045297400.1246477028.1247607009.1247619922.40%3B%2B__utmz%3D168235298.1247530948.37.13.utmcsr%3Dgoogle%7Cutmccn%3D(organic)%7Cutmcmd%3Dorganic%7Cutmctr%3Drehabilitation-center.org%3B HTTP/1.1
    Host: www.google-analytics.com
    User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.9.0.11) Gecko/2009060215 Firefox/3.0.11 GTB5 (.NET CLR 3.5.30729)
    Accept: image/png,image/*;q=0.8,*/*;q=0.5
    Accept-Language: en-gb,en;q=0.5
    Accept-Encoding: gzip,deflate
    Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
    Keep-Alive: 300
    Connection: keep-alive
    Referer: http://www.rehabilitation-center.org/why.html

    HTTP/1.x 200 OK
    Content-Length: 35
    Date: Fri, 27 Mar 2009 23:00:00 GMT
    Pragma: no-cache
    Cache-Control: private, no-cache, no-cache=Set-Cookie, proxy-revalidate
    Expires: Wed, 19 Apr 2000 11:43:00 GMT
    Last-Modified: Wed, 21 Jan 2004 19:50:30 GMT
    Content-Type: image/gif
    Server: Golfe
    ----------------------------------------------------------
    http://toolbarqueries.google.com/se...http://www.rehabilitation-center.org/why.html

    GET /search?features=Rank:&sourceid=navclient-ff&client=navclient-auto-ff&googleip=O;null;93&iqrn=7OsB&querytime=Re&orig=0gfsr&iqst=404&ch=8ba3bab8b&q=info:http%3A%2F%2Fwww.rehabilitation-center.org%2Fwhy.html HTTP/1.1
    Host: toolbarqueries.google.com
    User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.9.0.11) Gecko/2009060215 Firefox/3.0.11 GTB5 (.NET CLR 3.5.30729) GoogleToolbarFF 5.0.20090324
    Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
    Accept-Language: en-gb,en;q=0.5
    Accept-Encoding: gzip,deflate
    Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
    Keep-Alive: 300
    Connection: keep-alive
    Cookie: NID=24=l-_-eRG4b4Qqe_MZm_NkE-eMRNfXuV-olPDbG_GNiR84wmx0Wi8Y4k1sbQQrjFhgy8wrAupdDLelhq2J1pPXPpTPRfG4c0vLEVxhlsqxDVQw226aIVAjAdniFAGf2pHC; PREF=ID=395f3fb9c0d3f8cd:U=d85624a8d0b0c961:TB=2:TM=1247330651:LM=1247608300:DV=AA:GM=1:S=tZqlLWiFJ7-7-vCt; SID=DQAAAJsAAAB5IB5JziODJ6flUjixHjk-6ESjkIvJv45Pbh7mNhCklkmLfare9kMRZyc92fDHgZcd4hUGuy-uoQEcFusqu-ePfxjQkABJaYitMJR-P8uaxWtknOicYMioGBRc4BqCP5lQLgA3gw3yWE5TtH3dVvZSRCkBb1BhFo5mAtS9KO1B_hQ9ueLxJOdsxFqHCvTDURZa61nS0xphmHMnUWyOs12H; HSID=AoHoul8pi0zK4pgWt; TZ=240

    HTTP/1.x 200 OK
    Cache-Control: private, max-age=0
    Date: Wed, 15 Jul 2009 01:48:59 GMT
    Expires: -1
    Content-Type: text/html; charset=ISO-8859-1
    Server: gws
    Content-Length: 0
    ----------------------------------------------------------
    http://toolbarqueries.clients.google.com/tbproxy/af/query

    POST /tbproxy/af/query HTTP/1.1
    Host: toolbarqueries.clients.google.com
    User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.9.0.11) Gecko/2009060215 Firefox/3.0.11 GTB5 (.NET CLR 3.5.30729)
    Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
    Accept-Language: en-gb,en;q=0.5
    Accept-Encoding: gzip,deflate
    Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
    Keep-Alive: 300
    Connection: keep-alive
    Content-Type: application/x-www-form-urlencoded; charset=UTF-8
    Content-Length: 262
    Cookie: NID=24=l-_-eRG4b4Qqe_MZm_NkE-eMRNfXuV-olPDbG_GNiR84wmx0Wi8Y4k1sbQQrjFhgy8wrAupdDLelhq2J1pPXPpTPRfG4c0vLEVxhlsqxDVQw226aIVAjAdniFAGf2pHC; PREF=ID=395f3fb9c0d3f8cd:U=d85624a8d0b0c961:TB=2:TM=1247330651:LM=1247608300:DV=AA:GM=1:S=tZqlLWiFJ7-7-vCt; SID=DQAAAJsAAAB5IB5JziODJ6flUjixHjk-6ESjkIvJv45Pbh7mNhCklkmLfare9kMRZyc92fDHgZcd4hUGuy-uoQEcFusqu-ePfxjQkABJaYitMJR-P8uaxWtknOicYMioGBRc4BqCP5lQLgA3gw3yWE5TtH3dVvZSRCkBb1BhFo5mAtS9KO1B_hQ9ueLxJOdsxFqHCvTDURZa61nS0xphmHMnUWyOs12H; HSID=AoHoul8pi0zK4pgWt; TZ=240
    Pragma: no-cache
    Cache-Control: no-cache
    <autofillquery clientversion="5.0.20090324-ff"><form signature="0x5b0ac804a0ec1cc4"><field signature="0x9a7e5f39"/><field signature="0xb5f345b3"/><field signature="0xa84819bd"/><field signature="0x9d0cbb01"/><field signature="0x620b7298"/></form></autofillquery>
    HTTP/1.x 200 OK
    Content-Type: text/xml; charset=utf-8
    Content-Encoding: gzip
    Date: Wed, 15 Jul 2009 01:48:59 GMT
    Server: AutoFill Server
    Cache-Control: private, x-gzip-ok=""
    Content-Length: 67
    ----------------------------------------------------------
    http://widgetconfig.meebo.com/E/W/rXvaoujW?1247622539678

    GET /E/W/rXvaoujW?1247622539678 HTTP/1.1
    Host: widgetconfig.meebo.com
    User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.9.0.11) Gecko/2009060215 Firefox/3.0.11 GTB5 (.NET CLR 3.5.30729)
    Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
    Accept-Language: en-gb,en;q=0.5
    Accept-Encoding: gzip,deflate
    Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
    Keep-Alive: 300
    Connection: keep-alive

    HTTP/1.x 200 OK
    Expires: Wed, 15 Jul 2009 01:49:59 GMT
    Cache-Control: max-age=60
    Content-Type: application/octet-stream
    Accept-Ranges: bytes
    Content-Length: 381
    Date: Wed, 15 Jul 2009 01:48:59 GMT
    Server: lighttpd/1.4.19
    Connection: keep-alive
    ----------------------------------------------------------
    http://widget.meebo.com/recv_4.mp3

    GET /recv_4.mp3 HTTP/1.1
    Host: widget.meebo.com
    User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.9.0.11) Gecko/2009060215 Firefox/3.0.11 GTB5 (.NET CLR 3.5.30729)
    Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
    Accept-Language: en-gb,en;q=0.5
    Accept-Encoding: gzip,deflate
    Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
    Keep-Alive: 300
    Connection: keep-alive

    HTTP/1.x 302 Found
    Date: Wed, 15 Jul 2009 01:49:01 GMT
    Server: Apache/2.2.4
    Location: http://widget-cdn.meebo.com/recv_4.mp3
    Content-Length: 222
    Connection: close
    Content-Type: text/html; charset=iso-8859-1
    ----------------------------------------------------------
    http://rd.meebo.com/mm.gif?id=EWrXv...kxrC3&type=event&source=load&tm=1247622542146

    GET /mm.gif?id=EWrXvaoujW&o=dancallahan&uid=AybX5JMcEtYsge6%2FLfj3oWFXuwsfD8BV3u0kxrC3&type=event&source=load&tm=1247622542146 HTTP/1.1
    Host: rd.meebo.com
    User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.9.0.11) Gecko/2009060215 Firefox/3.0.11 GTB5 (.NET CLR 3.5.30729)
    Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
    Accept-Language: en-gb,en;q=0.5
    Accept-Encoding: gzip,deflate
    Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
    Keep-Alive: 300
    Connection: keep-alive

    HTTP/1.x 200 OK
    Content-Type: image/gif
    Accept-Ranges: bytes
    Etag: "3823040773"
    Last-Modified: Fri, 19 Dec 2008 22:55:23 GMT
    Content-Length: 43
    Date: Wed, 15 Jul 2009 01:49:01 GMT
    Server: lighttpd/1.4.19
    ----------------------------------------------------------
    http://widget.meebo.com/send_4.mp3

    GET /send_4.mp3 HTTP/1.1
    Host: widget.meebo.com
    User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.9.0.11) Gecko/2009060215 Firefox/3.0.11 GTB5 (.NET CLR 3.5.30729)
    Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
    Accept-Language: en-gb,en;q=0.5
    Accept-Encoding: gzip,deflate
    Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
    Keep-Alive: 300
    Connection: keep-alive

    HTTP/1.x 302 Found
    Date: Wed, 15 Jul 2009 01:49:01 GMT
    Server: Apache/2.2.4
    Location: http://widget-cdn.meebo.com/send_4.mp3
    Content-Length: 222
    Connection: close
    Content-Type: text/html; charset=iso-8859-1
    ----------------------------------------------------------
    http://guest2.meebo.org/mm?1247622542146965

    POST /mm?1247622542146965 HTTP/1.1
    Host: guest2.meebo.org
    User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.9.0.11) Gecko/2009060215 Firefox/3.0.11 GTB5 (.NET CLR 3.5.30729)
    Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
    Accept-Language: en-gb,en;q=0.5
    Accept-Encoding: gzip,deflate
    Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
    Keep-Alive: 300
    Connection: keep-alive
    Referer: http://widget-cdn.meebo.com/mm.swf?EWrXvaoujW
    Content-type: text/xml
    Content-length: 158

    <body xml:lang="en" to="guest2.meebo.org" wait="30" hold="1" content="text/xml; charset=utf-8" rid="5669770567" xmlns="http://jabber.org/protocol/httpbind" />
    HTTP/1.x 200 OK
    Content-Type: text/xml
    Content-Length: 176
    Date: Wed, 15 Jul 2009 01:49:01 GMT
    Server: lighttpd/1.4.19
    ----------------------------------------------------------
    http://guest2.meebo.org/mm?1247622542381347

    POST /mm?1247622542381347 HTTP/1.1
    Host: guest2.meebo.org
    User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.9.0.11) Gecko/2009060215 Firefox/3.0.11 GTB5 (.NET CLR 3.5.30729)
    Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
    Accept-Language: en-gb,en;q=0.5
    Accept-Encoding: gzip,deflate
    Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
    Keep-Alive: 300
    Connection: keep-alive
    Referer: http://widget-cdn.meebo.com/mm.swf?EWrXvaoujW
    Content-type: text/xml
    Content-length: 283

    <body sid="159604551814513514" rid="5669770568" xmlns="http://jabber.org/protocol/httpbind"><iq xmlns="jabber:client" type="set" id="A01"><query xmlns="jabber:iq:auth"><username>dancallahanmeebme976429</username><resource>meebome</resource><password>mm</password></query></iq></body>
    HTTP/1.x 200 OK
    Content-Type: text/xml
    Content-Length: 107
    Date: Wed, 15 Jul 2009 01:49:02 GMT
    Server: lighttpd/1.4.19
    ----------------------------------------------------------
    http://guest2.meebo.org/mm?124762254249077

    POST /mm?124762254249077 HTTP/1.1
    Host: guest2.meebo.org
    User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-GB; rv:1.9.0.11) Gecko/2009060215 Firefox/3.0.11 GTB5 (.NET CLR 3.5.30729)
    Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
    Accept-Language: en-gb,en;q=0.5
    Accept-Encoding: gzip,deflate
    Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
    Keep-Alive: 300
    Connection: keep-alive
    Referer: http://widget-cdn.meebo.com/mm.swf?EWrXvaoujW
    Content-type: text/xml
    Content-length: 573

    <body sid="159604551814513514" rid="5669770569" xmlns="http://jabber.org/protocol/httpbind"><presence from="dancallahanmeebme976429@guest2.meebo.org/meebome" xmlns="jabber:client"><nick xmlns="http://jabber.org/protocol/nick">meeboguest976429</nick></presence><presence group="Live Chat" type="subscribe" to="dancallahan@meebo.org" from="dancallahanmeebme976429@guest2.meebo.org/meebome" xmlns="jabber:client"><nick xmlns="http://jabber.org/protocol/nick">meeboguest976429</nick></presence><iq id="v1" type="set"><vCard xmlns="vcard-temp"><DESC>3</DESC></vCard></iq></body>
    HTTP/1.x 200 OK
    Content-Type: text/xml
    Content-Length: 106
    Date: Wed, 15 Jul 2009 01:49:02 GMT
    Server: lighttpd/1.4.19
     
    HighRankingSEO, Jul 14, 2009 IP
  7. HighRankingSEO

    HighRankingSEO Well-Known Member

    Messages:
    423
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    125
    #7
    HighRankingSEO, Jul 14, 2009 IP
  8. jitendraag

    jitendraag Notable Member

    Messages:
    3,982
    Likes Received:
    324
    Best Answers:
    1
    Trophy Points:
    270
    #8
    Even when I am using a browser I see 404 response. Is any of your joomla mods sending a header 404? We can see the content but HTTP status is 404.
     
    jitendraag, Jul 14, 2009 IP
  9. Canonical

    Canonical Well-Known Member

    Messages:
    2,223
    Likes Received:
    141
    Best Answers:
    0
    Trophy Points:
    110
    #9
    I would be willing to bet that it has something to do w/ your sh404sef extension for Joomla. It appears you are not the first to experience the problem:

    http://www.google.com/support/forum/p/Webmasters/thread?tid=685b2ef6f73708d5&hl=en
    http://www.experts-exchange.com/Sof...ntent_Management/WebBased_CMS/Q_24315873.html

    It sounds like it is URL rewriting and showing the correct content but returning a 404 even though the page rendered.



    FYI: Your .htaccess looks weird IMO. Whomever wrote it is escaping special characters in all the wrong places and NOT escaping them where they should.

    For example the RewriteRule directive is of the form:

    where pattern is a regular expression pattern and substitution is simply a URL possibly containing $1..$9 and %1..%9 backreference tokens which get replaced with their values. It is only in the pattern that you have to escape characters like '.' when you are referring to the literal period character because '.' has special meaning in a regular expression. You don't have to escape anything in the substitution string.

    Similarly, the RewriteCond directive is of the general form:

    where teststring is a backreference, server variable, etc. (in other words it equates to a string) and condpattern is a regular expression pattern. Again it is only in the condpattern that you have to escape characters like '.' when you are referring to the literal period character because '.' has special meaning in a regular expression.

    So for example if I want to 301 redirect requests for my root index.html (/index.html) to simply '/' then I would code it as...

    which works perfectly... It ONLY works for requests for index.html in the root.

    The person who wrote your .htaccess though would have written it as:

    The escape ('\') characters in the substitution field of the RewriteRule are totally unnecessary (as are the quotes around the URL). Having the pattern in the RewriteCond as "index.html" says to match on any string that start with "index" followed by any single character ("." is a regular expression character and will match single character) followed by "html". So it will incorrectly match strings like "indexxhtml" or "index-html".
     
    Canonical, Jul 14, 2009 IP
  10. HighRankingSEO

    HighRankingSEO Well-Known Member

    Messages:
    423
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    125
    #10
    Canonical...would you like to make some money? I need this shit fixed now. I rank nationally for VERY competitive terms and this is fucking my life up...lol
     
    HighRankingSEO, Jul 14, 2009 IP
  11. Canonical

    Canonical Well-Known Member

    Messages:
    2,223
    Likes Received:
    141
    Best Answers:
    0
    Trophy Points:
    110
    #11
    Your problem seems to be fixed. I'm getting 200s now. Did you modify something? Recache all the links? what?
     
    Canonical, Jul 14, 2009 IP
  12. HighRankingSEO

    HighRankingSEO Well-Known Member

    Messages:
    423
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    125
    #12
    OK, I guess it is time to share the knowledge I have just come across.....FIRST OF ALL...THIS SAD STORY HAS A HAPPY ENDING.

    Steps to prevent this attrosity from happening to you:

    DONT WRITE YOUR OWN HTACCESS IF YOU DONT KNOW IT LIKE THE BACK OF YOUR HAND :) (learned that the hard way. I believe the cause was the Joomla SEF404 component running alongside the Stock SYSTEM SEF PLugin that comes with joomla 1.5. combined with a sad piece of canonicalization work...

    What I did:

    1. Turned off all SEF plugins...everything worked at that point as far as 404 with page still rendering...now I was getting the pretty HTTP 200's :) BUT- The URL's looked like Santas ass after christmas...
    2. Next- Deleted my htaccess and replaced it with the htaccess.txt (rename it to .htaccess when its on your server, of course) that comes with a fresh install of Joomla.
    3. Went back into Joomla admin panel>extensions>plugin manager> and turned on ONLY SH404SEF plugin
    4. Watched Live HTTP headers and every crawler emulator I could find give me back the best 3 numbers you will ever see....200 all around :)
    5. Last but not least, went into CPanel (my host has it, if your host doesnt, find some to write it for you) and canonicalized my homepage which is http://www.rehabilitation-center.org

    Hope that helps someone else...if it doesn't there are a couple other things (little) that might have been a part of it, but I don't think so. I think this covers it really.

    PM me if you need help.

    AND BIG SHOUT OUT TO CANONICAL FOR HELPING...WITHOUT THAT ADVICE TO REVISIT THE HTACCESS FILE I WOULD STILL BE F-U-]<-E-d

    THANKS!!!
     
    HighRankingSEO, Jul 14, 2009 IP
  13. HighRankingSEO

    HighRankingSEO Well-Known Member

    Messages:
    423
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    125
    #13
    seriously, Canonical , thanks a lot...I appreciate it...I would like to buy you a beer :)
     
    HighRankingSEO, Jul 14, 2009 IP
  14. HighRankingSEO

    HighRankingSEO Well-Known Member

    Messages:
    423
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    125
    #14
    <del>PM me if you need help.</del> Keep it in the forum if you need help so other people can benefit from it.
     
    HighRankingSEO, Jul 14, 2009 IP
  15. Canonical

    Canonical Well-Known Member

    Messages:
    2,223
    Likes Received:
    141
    Best Answers:
    0
    Trophy Points:
    110
    #15
    Haha Glad to help... Good to see the 200s. Gratz!
     
    Canonical, Jul 14, 2009 IP
  16. HighRankingSEO

    HighRankingSEO Well-Known Member

    Messages:
    423
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    125
    #16
    Thanks again.
     
    HighRankingSEO, Jul 14, 2009 IP
  17. HighRankingSEO

    HighRankingSEO Well-Known Member

    Messages:
    423
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    125
    #17
    HighRankingSEO, Jul 15, 2009 IP