Proxy Topsite

Discussion in 'Site & Server Administration' started by Hades, Apr 15, 2007.

  1. #1
    Hello,

    I've recently made a proxy topsite using the aardvark script, and now I am lost. I've installed the script and everything, but I have no clue how to put adsense on it. Can anyone help?

    Also, I would like to know what a robots.txt file is exactly, and how would I make one for the topsite? Are there any examples online or anything.

    Nick

    P.S. To the mods, I've posted here, cause it deals not only with robots.txt, but also with other stuff. Thanks :)
     
    Hades, Apr 15, 2007 IP
  2. dsendecki

    dsendecki Peon

    Messages:
    212
    Likes Received:
    15
    Best Answers:
    0
    Trophy Points:
    0
    #2
    This is straight from the manual, I did it on my topsite.

     
    dsendecki, Apr 15, 2007 IP
    Hades likes this.
  3. momo22

    momo22 Peon

    Messages:
    32
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #3
    robots.txt helps you to keep away robots like i.e. search engines from certain folders or pages.

    It's a simple textfile in the root folder of your webspace. It can be created / edited in i.e. notepad.
     
    momo22, Apr 17, 2007 IP
    Hades likes this.
  4. Hades

    Hades Well-Known Member

    Messages:
    1,873
    Likes Received:
    67
    Best Answers:
    0
    Trophy Points:
    150
    #4
    so would i want a robots.txt file ona proxy topsite?
     
    Hades, Apr 17, 2007 IP
  5. momo22

    momo22 Peon

    Messages:
    32
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Sorry, don't know proxy topsite.

    But you would want to exclude for example an installation folder, folders with just scripts, maybe images ... just everything that is not a file a search engine should index.

    The meaner robots like grabbers do not care for what you have in your robots.txt, they just ignore it.
     
    momo22, Apr 17, 2007 IP
  6. delusion

    delusion Guest

    Messages:
    1,195
    Likes Received:
    77
    Best Answers:
    0
    Trophy Points:
    0
    #6
    If you need help integrating AdSense PM me, I've currently got it on 2 topsites (sig link) + I don't use robots.txt for my topsites, doesn't do anything really... (I think)
     
    delusion, Apr 17, 2007 IP
    Hades likes this.