1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Bots crawling my non https version of the site

Discussion in 'Traffic Analysis' started by qwikad.com, Jun 12, 2024.

0
  1. #1
    Looks like bots don't care about the https redirect in the .htaccess and keep crawling my http version of the site. Blocking them via the .htaccess only works for the https version. Any ideas how to block them from accessing either version of the site period?
     
    qwikad.com, Jun 12, 2024 IP
  2. sarahk

    sarahk iTamer Staff

    Messages:
    28,974
    Likes Received:
    4,572
    Best Answers:
    124
    Trophy Points:
    665
    #2
    That sounds like a problem in the .htaccess rather than the bots overriding anything.
    Can you ask them nicely in the robots.txt?
     
    sarahk, Jun 12, 2024 IP
  3. GreenHost.Cloud

    GreenHost.Cloud Active Member

    Messages:
    472
    Likes Received:
    34
    Best Answers:
    3
    Trophy Points:
    73
    #3
    One option could be to implement a CAPTCHA on the website to prevent bots from accessing it. Another solution may be to use a bot management tool or service to automatically block known bots. also, regularly monitoring website traffic and manually blocking suspicious IP addresses could help prevent unwanted bot access.
     
    GreenHost.Cloud, Jul 1, 2024 IP