Search Engine & Private Content

Discussion in 'Search Engine Optimization' started by iBall, Apr 12, 2008.

0
  1. #1
    If I set certain content viewable only for members,

    Can these contain searched and listed by search engine?
     
    iBall, Apr 12, 2008 IP
  2. raymond222

    raymond222 Active Member

    Messages:
    287
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    60
    #2
    Search engines can not access private content.
    Its good to have some public pages to get at least some indexing
     
    raymond222, Apr 12, 2008 IP
  3. kanwarjot

    kanwarjot Notable Member

    Messages:
    3,256
    Likes Received:
    283
    Best Answers:
    0
    Trophy Points:
    230
    #3
    i think yes but u can control that via robots.txt file
     
    kanwarjot, Apr 12, 2008 IP
  4. astup1didiot

    astup1didiot Notable Member

    Messages:
    5,926
    Likes Received:
    270
    Best Answers:
    0
    Trophy Points:
    280
    #4
    Using the robots.txt and robots meta tag you can prevent search engines from indexing\crawling certain web pages; if the web page or directory itself is password protected it won't be able to crawl the web page.
     
    astup1didiot, Apr 12, 2008 IP