https ranks lower than http

Discussion in 'Search Engine Optimization' started by Spider-Man, May 19, 2008.

  1. #1
    Hey guys.

    After adding an integrated payment method into our site, I installed an SSL certificate - to give the domain https:// www. cupargardencentre .co.uk only on the checkout and contact page, as this is how things work as default with our ecommerce software.

    The issue is, Google has started to index the https versions of some major pages, and the rankings have disappeared for http:// while https has now began to rank, but much lower than previously. Sticky situation, 'cause we need the SSL certificate installed, but badly need to get Google away from https.

    I've set everything up in WMT to give 'www' the preference, regardless, Google doesn't listen.

    Any tips of what I can do about this? It's badly affecting ranking and thus, revenue.

    Thanks
     
    Spider-Man, May 19, 2008 IP
  2. astup1didiot

    astup1didiot Notable Member

    Messages:
    5,926
    Likes Received:
    270
    Best Answers:
    0
    Trophy Points:
    280
    #2
    For the https protocol (https://yourserver.com/robots.txt)

    User-agent: *
    Disallow: /
     
    astup1didiot, May 19, 2008 IP
  3. salihpk

    salihpk Banned

    Messages:
    689
    Likes Received:
    10
    Best Answers:
    0
    Trophy Points:
    0
    #3
    salihpk, May 19, 2008 IP
  4. Spider-Man

    Spider-Man Banned

    Messages:
    2,684
    Likes Received:
    211
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Thanks for the help - but I forgot to add into the OP - the certificate is from GeoTrust - AFAIK I don't have access to the https side of things, so, now what?:confused::(
     
    Spider-Man, May 19, 2008 IP
  5. astup1didiot

    astup1didiot Notable Member

    Messages:
    5,926
    Likes Received:
    270
    Best Answers:
    0
    Trophy Points:
    280
    #5
    Create a robots.txt called robots-ssl.txt and add the following code...

    
    User-agent: Googlebot 
    Disallow: / 
    
    User-agent: * 
    Disallow: / 
    
    Code (markup):
    Now add in your .htaccess

    
    RewriteCond %{SERVER_PORT} ^443$ 
    RewriteRule ^robots.txt$ robots-ssl.txt
    
    Code (markup):
    This instructs the webserver to direct any requests for the robots.txt file made on port 443 to robots-ssl.txt, you can test by viewing the robots.txt with http and with https and see the difference.
     
    astup1didiot, May 19, 2008 IP
  6. Spider-Man

    Spider-Man Banned

    Messages:
    2,684
    Likes Received:
    211
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Thanks ssandecki, I've done as you said, here's hoping it works without messing anything else up more than it already has:D

    I'm just reviewing what you've said via PM, very interested:)

    Thanks
     
    Spider-Man, May 19, 2008 IP
  7. astup1didiot

    astup1didiot Notable Member

    Messages:
    5,926
    Likes Received:
    270
    Best Answers:
    0
    Trophy Points:
    280
    #7
    Verifty if it works, goto http://www.site.com/robots.txt and https://www.site.com/robots.txt you should see 2 seperate robots.txt
     
    astup1didiot, May 19, 2008 IP
  8. Spider-Man

    Spider-Man Banned

    Messages:
    2,684
    Likes Received:
    211
    Best Answers:
    0
    Trophy Points:
    0
    #8
    Well balls to that:( Didn't work - we're using a Linux server running Zeus - some commands work, some don't - 301 directs work but for redirecting non-www to www, it took a 'rewrite.script' file and quite a bit of code to do. Ah well, suppose I'll raise another pointless support flag, yet they'll still tell me "You can deny robots using robots.txt. Have a nice day."

    :( Thanks for your help though, much appreciated.
     
    Spider-Man, May 19, 2008 IP
  9. astup1didiot

    astup1didiot Notable Member

    Messages:
    5,926
    Likes Received:
    270
    Best Answers:
    0
    Trophy Points:
    280
    #9
    Really, e-mail me over some details on the scripting required I'll set it up for you and include it with your analsyis.
     
    astup1didiot, May 19, 2008 IP
  10. Spider-Man

    Spider-Man Banned

    Messages:
    2,684
    Likes Received:
    211
    Best Answers:
    0
    Trophy Points:
    0
    #10
    Included info in the PM I just sent over to you. Zeus interprets *some* htaccess rules, but not all - hence why this doesn't work through htaccess, but theoretically should work through rewrite.script code.
     
    Spider-Man, May 19, 2008 IP
  11. sweetfunny

    sweetfunny Banned

    Messages:
    5,743
    Likes Received:
    467
    Best Answers:
    0
    Trophy Points:
    0
    #11
    I think the port defined in .htaccess is throwing your server a curve ball. Try:

    Then create a robots-https.txt in root and add:

     
    sweetfunny, May 19, 2008 IP
  12. Spider-Man

    Spider-Man Banned

    Messages:
    2,684
    Likes Received:
    211
    Best Answers:
    0
    Trophy Points:
    0
    #12
    Thanks for your help SweetFunny, unfortunately this Zeus Script doesn't seem to want to co-operate with that either, here's the code to redirect non-www to www using Zeus script. Perhaps somebody might have a suitable script for using on a Zeus server:

    match IN:Host into % with ^cupargardencentre.co.uk$
    if matched then
      match URL into $ with ^/(.*)$
      set Out:Location=http://www.cupargardencentre.co.uk/$1
      set RESPONSE=301
      set BODY=<A HREF="http://www.cupargardencentre.co.uk$1">Click here to redirect</a>
    endif
    
    Code (markup):
    Thanks
     
    Spider-Man, May 19, 2008 IP
  13. sweetfunny

    sweetfunny Banned

    Messages:
    5,743
    Likes Received:
    467
    Best Answers:
    0
    Trophy Points:
    0
    #13
    Oh ok, didn't read the Zeus part... Sorry but sucks to be you, Zeus is an ok server in it's own right but doing simple things can be pretty frustrating at times because it severely lacks support and documentation.

    I haven't run Zeus is a long time, but give this a shot.. No guarantees.

    Then place a /robots-https.txt in your root directory with:

    :cool:
     
    sweetfunny, May 19, 2008 IP
  14. astup1didiot

    astup1didiot Notable Member

    Messages:
    5,926
    Likes Received:
    270
    Best Answers:
    0
    Trophy Points:
    280
    #14
    Isn't Zeus still prone to UDP attacks? I think someone needs to switch web hosting companies :)
     
    astup1didiot, May 19, 2008 IP
  15. Spider-Man

    Spider-Man Banned

    Messages:
    2,684
    Likes Received:
    211
    Best Answers:
    0
    Trophy Points:
    0
    #15
    Unfortunately that didn't work either :(

    The hosting has been fine - Namesco - for the price, why bother paying upwards of £1000 when there's no need - just a few hicups along the way, which, in the end, I got sorted out:D There's no worthwhile hosting company around that doesn't charge rip off prices for what they give, or have very little bandwidth allowances - or very high, like in the case of Hostgator, which at the end of a day, is shit for a UK ecommerce site;)
     
    Spider-Man, May 19, 2008 IP
  16. sweetfunny

    sweetfunny Banned

    Messages:
    5,743
    Likes Received:
    467
    Best Answers:
    0
    Trophy Points:
    0
    #16
    I think the latest release is ok, but lower versions have a stack of vulnerabilities.

    Didn't work, hmm ok it may not even be possible to redirect like this on Zeus. Possibly another workaround would be to create a subdomain secure.cupargardencentre.co.uk and assign the certificate to that and block Google from the whole subdomain to avoid duplicate issues.

    P.S Get a new server, they are cheap lol ;)
     
    sweetfunny, May 19, 2008 IP
  17. Spider-Man

    Spider-Man Banned

    Messages:
    2,684
    Likes Received:
    211
    Best Answers:
    0
    Trophy Points:
    0
    #17
    Can't do it with our ecommerce software, as far as I know anyway.

    A UK based on that is good, reputable and cheap? Prove it:D
     
    Spider-Man, May 19, 2008 IP
  18. sweetfunny

    sweetfunny Banned

    Messages:
    5,743
    Likes Received:
    467
    Best Answers:
    0
    Trophy Points:
    0
    #18
    Sure you can you just need to change your script to use the https at checkout, and Nofollow the links and exclude Google from the subdomain.

    If you can't modify your https robots.txt or your https content, or even do the redirect server side your fast running out of other options.

    Depends what you want, Shared, VPS, Semi-Dedicated, Dedicated or Clustered?
     
    sweetfunny, May 19, 2008 IP
  19. Spider-Man

    Spider-Man Banned

    Messages:
    2,684
    Likes Received:
    211
    Best Answers:
    0
    Trophy Points:
    0
    #19
    Thing that confuses me the most - why/how is Googlebot crawling cgi-bin/perl scripts, I wasn't aware it could until now:eek:

    Depends - as long as it can give at least 1gb disk space, at least 30gb bandwidth - preferably UK based, and be fast, reputable and relatively cheap...AND support cgi-bin scripts...then...the decision is yours:p lol
     
    Spider-Man, May 19, 2008 IP
  20. astup1didiot

    astup1didiot Notable Member

    Messages:
    5,926
    Likes Received:
    270
    Best Answers:
    0
    Trophy Points:
    280
    #20
    If they render and HTML web document why couldn't it. :)

    http://www.vi.net/
     
    astup1didiot, May 19, 2008 IP