1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Not Indexing Well. Is it robots.txt?

Discussion in 'robots.txt' started by rosn007, Dec 14, 2018.

  1. #1
    Hi,
    I have a website DirectFix (dot) com where I changed the web location from HTTP to HTTPS. I saw a huge drop in ranking immediately after that. Eventually, I realized it's not even showing at caching at cache:domainname. I saw a bug with robots.txt as search console and updated to the following file. directfix(dot)com/robots.txt . Now my search console says " Alternate page with proper canonical tag". Can someone help me understand what am I missing here? Thank you!
    SEMrush
     
    rosn007, Dec 14, 2018 IP
    SEMrush
  2. mmerlinn

    mmerlinn Notable Member

    Messages:
    2,009
    Likes Received:
    235
    Best Answers:
    6
    Trophy Points:
    240
    #2
    Maybe because the indexing robots can't get to your page?
     
    mmerlinn, Dec 15, 2018 IP
  3. mnmani

    mnmani Well-Known Member

    Messages:
    379
    Likes Received:
    11
    Best Answers:
    6
    Trophy Points:
    195
    #3
    remove line Disallow: and add Allow: / at the bottom
    Allow: /
    Code (markup):

    that can be of some help.

     
    mnmani, Dec 15, 2018 IP
  4. Joshuathompson

    Joshuathompson Greenhorn

    Messages:
    11
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    23
    #4
    U should try to create 2 robots.txt files. One is for old http-version and second is for new https-version of your website. And don't forget about 301 redirections from old http-pages to new https. And if u did not verify new https-property in Search Console Google - do that.
     
    Joshuathompson, Jan 3, 2019 IP