Does in a forum crawled every site that exists? How check that indexed or not?

Discussion in 'Google' started by WebtoolMaster, Jan 16, 2011.

  1. #1
    Hi,

    does a search engine in a forum crawled every site that exists with member profils? How check a search enginge that indexed or not?
     
    WebtoolMaster, Jan 16, 2011 IP
  2. atxsurf

    atxsurf Peon

    Messages:
    2,394
    Likes Received:
    21
    Best Answers:
    1
    Trophy Points:
    0
    #2
    yes search engines do usually crawl member sites that they have not been aware of, but discovered via some link including in member profile if it is publicly accessible and not forbidden by robots.txt
     
    atxsurf, Jan 16, 2011 IP
  3. WebtoolMaster

    WebtoolMaster Active Member

    Messages:
    365
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    53
    #3
    Hi,

    yes that is true. But I found lot of non indexed profiles that over 6 month old. No 3nd link, no robot.txt and published official. There are a law that not indexed?
     
    WebtoolMaster, Jan 16, 2011 IP
  4. atxsurf

    atxsurf Peon

    Messages:
    2,394
    Likes Received:
    21
    Best Answers:
    1
    Trophy Points:
    0
    #4
    i guess google sees no value in indexing those profile pages that contain little unique content. it does not mean it won't crawl them and find the links on them, it just won;t put it into index
     
    atxsurf, Jan 16, 2011 IP
  5. EvanP

    EvanP Banned

    Messages:
    1,731
    Likes Received:
    17
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Google will crawl those profiles that are viewed often and regularly updated. And yes, posting on a forum will make your profile get crawled, as your post count is raising in your profile and that is classed as your profile being an active page. So, if you want your profile crawled, post.
     
    EvanP, Jan 16, 2011 IP
  6. WebtoolMaster

    WebtoolMaster Active Member

    Messages:
    365
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    53
    #6
    Hi,

    ok some postings. Does google when crawled the profil links and not indexed them, does it appraised the backlinks or not?
     
    WebtoolMaster, Jan 16, 2011 IP
  7. EvanP

    EvanP Banned

    Messages:
    1,731
    Likes Received:
    17
    Best Answers:
    0
    Trophy Points:
    0
    #7
    Normally it does, well, at least it should do, yes.
     
    EvanP, Jan 16, 2011 IP
  8. lightlysalted

    lightlysalted Active Member

    Messages:
    2,067
    Likes Received:
    32
    Best Answers:
    0
    Trophy Points:
    90
    #8
    Search Bots (including Google) crawl all sites. It depends on what Google makes of the value of the site as to whether it gets indexed or not
     
    lightlysalted, Jan 16, 2011 IP