what does crwaling means does search engines read source code?

Discussion in 'Google' started by sooribabu, Sep 25, 2008.

0
  1. #1
    hi
    i am new to search engine concepts would like to know
    how does search engine read website content?
    1.by reading the source code? if not why to add <meta tags> because <meta tags are not visible without reading source code>
    2.by opening the site in 'text browsers' like(Lynx Viewer)
     
    sooribabu, Sep 25, 2008 IP
  2. fadetoblack22

    fadetoblack22 Well-Known Member

    Messages:
    2,399
    Likes Received:
    62
    Best Answers:
    0
    Trophy Points:
    160
    #2
    fadetoblack22, Sep 25, 2008 IP
  3. websitetools

    websitetools Well-Known Member

    Messages:
    1,513
    Likes Received:
    25
    Best Answers:
    4
    Trophy Points:
    170
    #3
    Well, crawlers will gain more understanding of Javascript over time. E.g. A1 Sitemap Generator can read some Javascript constructs to extract links from them. I also believe Google announced that they to some extent do crawl/understand Javascript.
     
    websitetools, Sep 25, 2008 IP
  4. fadetoblack22

    fadetoblack22 Well-Known Member

    Messages:
    2,399
    Likes Received:
    62
    Best Answers:
    0
    Trophy Points:
    160
    #4
    Was that not flash?
     
    fadetoblack22, Sep 26, 2008 IP
  5. angilina

    angilina Notable Member

    Messages:
    7,824
    Likes Received:
    186
    Best Answers:
    0
    Trophy Points:
    260
    #5
    Read this page,

    en.wikipedia.org/wiki/Web_crawler

    It will give you some idea about how SEs crawl sites.
     
    angilina, Sep 26, 2008 IP